Tricks to generate custom geosite dat files

[MkQtS]

Append rules to an existing list

You are welcome to file a PR in this repo if the change is reasonable for most users.

The main.go progarm walks through the data path, reading all files including those in subfolder of the data path. If there are two files with the same name in different paths, like data/lista and data/subfolder/lista, rules will be mixed together in one final list.

Without modifying the source data, you can merge upstream changes smoothly later on.

Remove unwanted lists

Here's an example configuration for datprofile (assuming the file is named dat_diy.json):

[
	{
		"name": "dlc.dat",
		"mode": "all"
	},
	{
		"name": "dlc_tiny.dat",
		"mode": "allowlist",
		"lists": [
			"category-ads-all",
			"geolocation-cn",
			"geolocation-!cn"
		]
	},
	{
		"name": "dlc_nobackward.dat",
		"mode": "denylist",
		"lists": [
			"archive",
			"category-ai-chat-!cn",
			"category-games",
			"cn",
			"google-gemini",
			"speedtest"
		]
	}
]

For mode all, non of existing lists would be removed; for mode allowlist, only allowed lists remains in the generated .dat file; for mode denylist, only denied lists will be removed.

Run go run ./main.go --datprofile='./dat_diy.json', and you will get three .dat files.

This approach does not require modifying the source data and carries no risk of breaking the inclusion chain. As long as the source data is consistent, any list remains in the trimed dat contains the same rules comparing to the list in full dat.

An exmaple script to create custom dats

#!/bin/bash

cd domain-list-community || exit
mkdir -p ./data/playground

# create new list: diy-block
cat > ./data/playground/diy-block <<- EOF
	include:category-ads-all
	include:category-httpdns-cn
	any-domain-i-want-to-block.com
EOF

# create new list: diy-direct
cat > ./data/playground/diy-direct <<- EOF
	include:apple
	include:microsoft
	include:geolocation-cn
	include:geolocation-!cn @cn
	include:private
	any-domain-i-want-to-direct.com
EOF

# create new list: diy-proxy
cat > ./data/playground/diy-proxy <<- EOF
	include:geolocation-!cn @-cn
	any-domain-i-want-to-proxy.com
EOF

# to be mixed with data/private
cat > ./data/playground/private <<- EOF
	internal-domain-of-my-home
	internal-domain-of-my-company
EOF

cat > ./dat_diy.json << EOF
[
	{
		"name": "custom_tiny.dat",
		"mode": "allowlist",
		"lists": [
			"diy-block",
			"diy-direct",
			"diy-proxy"
		]
	},
	{
		"name": "custom_no_diy.dat",
		"mode": "denylist",
		"lists": [
			"diy-block",
			"diy-direct",
			"diy-proxy"
		]
	}
]
EOF

go run ./main.go --datapath='./data' --datprofile='./dat_diy.json'