Mirrors
/
uBlock
mirror of https://github.com/gorhill/uBlock.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
uBlock/tools/make-assets.sh

45 lines
1.3 KiB
Bash
Raw Normal View History

Revert "Pass -e flag to bash (#3790)" This reverts commit bb2015949516346edb137384882022f839a187d2.
2021-07-31 12:49:32 -06:00
#!/usr/bin/env bash
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo
2016-04-03 11:07:46 -06:00
#
# This script assumes a linux environment
Use set -e in Bash scripts (#3791)
2021-07-31 15:34:25 -06:00
set -e
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo
2016-04-03 11:07:46 -06:00
DES=$1/assets
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293
2021-07-28 17:40:11 -06:00
echo "*** Packaging assets in $DES... "
this fixes travis?
2016-04-03 12:25:56 -06:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo
2016-04-03 11:07:46 -06:00
rm -rf $DES
Finalize converting resources.txt into immutable resources With hindsight, I revised decisions made earlier during this development cycle: Un-redirectable scriptlets have been removed from /web_accessible_resources and instead put in the new /assets/resources/scriptlets.js, which contains all scriptlets used for web page injection purpose. uBO will no longer fetch a remote version of built-in resources. Advanced setting `userResourcesLocation` will still be honoured by uBO, and if set, will be fetched every time at least one asset is updated.
2019-07-06 10:36:28 -06:00
cp -R ./assets $DES/
Leverage whotracks.me's huge dataset of URLs for benchmark purpose As seen at: https://whotracks.me/blog/adblockers_performance_study.html The requests.json.gz file can be downloaded from: https://cdn.cliqz.com/adblocking/requests_top500.json.gz Copy the file into ./tmp/requests.json.gz If the file is present when you build uBO using `make-[target].sh` from the shell, the resulting package will contain `./assets/requests.json`, which will be looked-up by the method below to launch a benchmark session. From uBO's dev console, launch the benchmark: µBlock.staticNetFilteringEngine.benchmark(); The usual browser dev tools can be used to obtain useful profiling data, i.e. start the profiler, call the benchmark method from the console, then stop the profiler when it completes. Keep in mind that the measurements at the blog post above where obtained with ONLY EasyList. The CPU reportedly used was: https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i7-6600U+%40+2.60GHz&id=2608 Rename ./tmp/requests.json.gz to something else if you no longer want ./assets/requests.json in the build.
2019-02-15 14:18:03 -07:00
Make dev build use its own assets.json: assets.dev.json This will make it easier to safely test new versions of assets.json.
2023-05-04 17:20:18 -06:00
VERSION=$(cat ./dist/version)
if [[ "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
echo "*** Removing $DES/assets.dev.json"
assets.json is not meant to be updated until 1.57 is widespread
2024-03-11 20:23:47 -06:00
rm -f $DES/assets.json
Need new `assets.son` file for next release Related issue: https://github.com/uBlockOrigin/uBlock-issues/issues/3154
2024-03-11 16:41:18 -06:00
rm -f $DES/assets.dev.json
Make dev build use its own assets.json: assets.dev.json This will make it easier to safely test new versions of assets.json.
2023-05-04 17:20:18 -06:00
else
echo "*** Removing $DES/assets.json"
Need new `assets.son` file for next release Related issue: https://github.com/uBlockOrigin/uBlock-issues/issues/3154
2024-03-11 16:41:18 -06:00
rm -f $DES/assets.json
rm -f $DES/assets.1.57.json
Make dev build use its own assets.json: assets.dev.json This will make it easier to safely test new versions of assets.json.
2023-05-04 17:20:18 -06:00
fi
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo
2016-04-03 11:07:46 -06:00
mkdir $DES/thirdparties
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293
2021-07-28 17:40:11 -06:00
Use `git clone` instead of submodule to pull uAssets dependencies Related issue: - https://github.com/uBlockOrigin/uBlock-issues/issues/2358 We need two different branches of uAssets to properly add the default filter lists into the packages. I couldn't figure out how to do this with submodules, using simple `git clone` as a dependency just work.
2022-11-14 07:50:53 -07:00
ASSETS_MAIN=dist/build/uAssets/main
ASSETS_PROD=dist/build/uAssets/prod
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293
2021-07-28 17:40:11 -06:00
Use `git clone` instead of submodule to pull uAssets dependencies Related issue: - https://github.com/uBlockOrigin/uBlock-issues/issues/2358 We need two different branches of uAssets to properly add the default filter lists into the packages. I couldn't figure out how to do this with submodules, using simple `git clone` as a dependency just work.
2022-11-14 07:50:53 -07:00
cp -R $ASSETS_MAIN/thirdparties/pgl.yoyo.org $DES/thirdparties/
cp -R $ASSETS_MAIN/thirdparties/publicsuffix.org $DES/thirdparties/
cp -R $ASSETS_MAIN/thirdparties/urlhaus-filter $DES/thirdparties/
mkdir -p $DES/thirdparties/easylist
Pick only the packaged lists
2023-04-27 11:22:15 -06:00
cp $ASSETS_PROD/thirdparties/easylist.txt $DES/thirdparties/easylist/
cp $ASSETS_PROD/thirdparties/easyprivacy.txt $DES/thirdparties/easylist/
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo
2016-04-03 11:07:46 -06:00
mkdir $DES/ublock
Update as per filter list changes
2023-04-28 15:02:51 -06:00
cp $ASSETS_PROD/filters/badlists.txt $DES/ublock/badlists.txt
Ship minified version of lists in package
2023-10-29 21:38:54 -06:00
cp $ASSETS_PROD/filters/badware.min.txt $DES/ublock/badware.min.txt
Update as per filter list changes
2023-04-28 15:02:51 -06:00
cp $ASSETS_PROD/filters/filters.min.txt $DES/ublock/filters.min.txt
cp $ASSETS_PROD/filters/privacy.min.txt $DES/ublock/privacy.min.txt
Ship minified version of lists in package
2023-10-29 21:38:54 -06:00
cp $ASSETS_PROD/filters/quick-fixes.min.txt $DES/ublock/quick-fixes.min.txt
cp $ASSETS_PROD/filters/unbreak.min.txt $DES/ublock/unbreak.min.txt