collinbarrett / filterlists

:shield: The independent, comprehensive directory of filter and host lists for advertisements, trackers, malware, and annoyances.

Senior Software Engineer

Full-Stack ∙ .NET ∙ Azure Certified ∙ Angular ∙ React ∙ GiveCamp Memphis Organizer ∙ FilterLists Founder ∙ Nearly 15yrs solving complex business problems with expressive, durable code ∙ collinmbarrett.com/resume

filterlists's Issues

support creating custom combination lists

In the same vein as Steven Black's project (but for filter lists as well as hosts lists), it could be useful for FilterLists to be able to easily merge and de-duplicate (likely server-side) multiple lists into custom combination lists. Depending on list licensing, FilterLists could even automatically maintain these custom lists so that users could subscribe to them for future updates.

Add internal links to list references in Descriptions

Where another list is referenced in the text of a Description, add an internal link to that list on FilterLists.

Add better support for accessing all lists

Either add an "all lists" page or add a search box that searches all lists rather than just the lists on any given list type page.

frequency

Lists who are updated (rules added and removed) more frequently should receive a boost in FilScore.

Requires #6 .

Weight: Medium

Add prominent link to GitHub in header or footer

add Blacklists UT1 lists

Per @indolering,

Add all lists from Blacklist UT1.

Low priority until #201 is resolved.

Populate language for former "Combo" lists

Regions for combo lists should be pulled from all of their master lists.

Add property or perhaps new list type for exception lists

There are some lists that are purely for "exceptions". The most popular of which is probably ABP's Acceptable Ads list. There are others, though, put out by sites such as cashback or shopping sites that whitelist enough tracking for their users to gain rewards.

While most FilterLists visitors will not be interested, these may still be worth indexing and flagging as the type of list that they are.

Replace json-schema with sample list object in json-data files

For simplicity, replace the json-schema directory with a sample json list object at the top of each json-data file. These sample objects will not be displayed on filterlists.com, but will make it easy for contributors to quickly see all fields (and their purpose) that can be defined for each list.

Increase size of tap targets on mobile

The small + icons to expand list info on mobile are too small. The entire list row should be made "tap-able" to expand the list info.

Filter regions by checkboxes

Filter regions by checkboxes rather than selecting individual regions and region combinations. This will allow lists that target more than one region to be included in the filters of any of the regions selected rather than its own combination region filter selection. For an immediate fix, this will be dependent on the ability to customize the wpdatatables plugin.

uniqueness / furthest upstream

Lists that are more unique should receive a boost in FilScore. Preference should be given to upstream lists in merges and forks (with the caveat that a fork whose upstream list is discontinued should be scored greater).

Requires #9

Weight: High

support comparing lists

Allow users to compare two or more lists for coverage overlap. Think browser-based WinMerge for FilterLists.

user rating

Collect user ratings (upvote/downvote, five-star, etc.) so that higher rated lists should receive a boost in FilScore.

As much as is feasible, we would want to prevent the same user from voting many times for the same list. But, the system should be friction-less and private (no accounts/logins).

Weight: Medium

age

Lists that have been around (and active) for longer should receive a boost in FilScore.

In conjunction with #44 .

Weight: Medium

Change Description font to differentiate between quoted and non-quoted

Many of the list descriptions are blockquotes from copy on the list's homepage. Lists that do not provide a concise description, however, are written by one of the maintainers of FilterLists. There should be a difference in font or some annotation that differentiates the two types of descriptions.

Verify all lists from Steven Black's Hosts are indexed

Verify all lists from Steven Black's Hosts are indexed.

Add EasyList Thailand

Add to Regional:
https://github.com/easylist-thailand/easylist-thailand

(discovered via GitHub's new "topics" feature, which is great!)

Add TopCashback Exception List

Add to Global:
https://www.topcashback.com/Help/164

Related to #34

GitHub stars

Use the list's repo star count to calculate the FilScore.

This would only be factored in lists maintained on GitHub. This would be loosely correlated to #45 , but far easier to calculate.

rule search

Allow users to search for a specific domain or rule across all lists. This would be in the same vein as Adblock Monitor or Adblock-filter search but across all lists indexed on FilterLists.

Requires #6 .

Launch internal links to other lists in modal

It would be neat to launch modal popups when clicking an internal link to another list. For example, when looking at the Combo lists, clicking on the name of one of the master lists from which it was created would launch a modal with all of the relevant information about that master list.

Add Adblock-Persian list

Add to Regional:
.txt
.java

Slim resource loading and verify font support

Currently, CSP blocks loading 3rd-party resources included by the default WordPress theme. However, these resources should be removed altogether. Any resources from the first party domain that are unneeded should be removed as well. Also, self-host all fonts including a slimmed-down version of ionicons just containing the needed icons.

Add a "New" property/badge

Add a "New" property or badge to give lists that have been recently added to FilterLists or recently started a little extra boost.

add Issue template

Finish the template for Issues:
https://github.com/collinbarrett/FilterLists/blob/master/.github/ISSUE_TEMPLATE.md

Add property for list author

It'd be nice to have a property to display each list's author/maintainer. This could be a person's name, a person'a alias, or an organization. The render of the author's name should link to their profile/homepage/twitter/etc if available.

Add FED List

Add to Global:
https://firime.wordpress.com/projects/others/fedlist/

add property for confirmed software support

Add a property for signaling what software tools each list has been verified to support. For each list, provide a list of labels such as "uBlock Origin", "AdBlock Plus", etc. for software tools that the list has been confirmed to work with.

add notifications for urls with HTTP response other than 200 OK

Add email notifications to investigate any URLs in FilterLists that return an HTTP response other than 200 OK.

license

Lists with more permissive licenses should receive a boost in FilScore.

Requires #18 .

Weight: Medium

automatic URL validation

All URLs in the Directory should be periodically validated for the following:

• Is valid URI syntax
• Availability (i.e., HTTP 200 vs 404)
• Prefer direct URL if 301/302 redirected
• Prefer HTTPS if available
• Malware (using VirusTotal API or similar)

community vibrancy

Lists who have more activity in GitHub Issues, GitHub stars, the list's forum, etc. should receive a boost in FilScore.

Weight: Low

Add adblock-leadgenerator-list

Add to Global:
https://github.com/Rpsl/adblock-leadgenerator-list

Add adblock-youtube-ads

Add to Global:
https://github.com/kbinani/adblock-youtube-ads

add lists' syntaxes and the software that supports them

Adblock lists are only useful in a browser-based solution. Host lists can be used in a browser-based solution as well as in a host file to block entire domains/IPs machine-wide. FilterLists should index lists based on their syntax to assist users.

Add uBO-Personal-Filters

Add to Global:
https://github.com/uBlock-user/uBO-Personal-Filters

Add Nopelist

Add to Global:
https://github.com/genediazjr/nopelist

Implement frequent fetches of all lists

Fetch copies of all lists daily and cache older versions. This would allow determining list update frequency, list change notifications, etc. This project likely should not serve as an official mirror of the lists (at least without verifying list licensing, etc.), but implementing this system would allow for some useful features on FilterLists.

Remove filter row from Google Featured Snippets

Google Featured Snippets shows the filter row as a duplicate header row. We should figure out a way around that for SEO purposes.

Alexa or other SEM tool rating

Lists with more backlinks/"buzz" (using Alexa or other similar SEM tool) should receive a boost in FilScore.

Weight: Medium

frequency of list link clicks

Use the frequency of clicks of the View/Add links (unique per visitor per day) from FilterLists to calculate the FilScore.

This data is collected from our anonymized, self-hosted Piwik installation.

Add entity for list license

Add a json property for each list (when available) denoting it's license

Internal linking of forks, combos, and master lists

Lists in the "Forks & Combos" and "Master" fields should internally link to the list's information on FilterLists. For example, if a Global list has a list in its "Forks & Combos" field, that list name should be linked to the list's anchor on it's list type page.

dynamic "Subscribe" buttons (function/visibility)

Add a flag property for if a list is directly "subscribe-able". If it is a .7z, .zip, etc., this flag will indicate that the "Subscribe" button should not be displayed.

Instead of a property, this could be something that is automated as well. (i.e., if file is a .txt vs a .zip, etc.). That would need extensive testing/debugging.

Feature overlap/similar to #7

Eventually, it could be neat to provide a subscribable mirror of these lists if the maintainer permits it.

Though this could encroach user's privacy, it could be neat to try to detect which (if any) browser extension Software the user has installed. Then, only show the "Subscribe" button for lists that are actually supported by that extension. Feedback wanted on this idea, though, if you feel that would violate user's privacy. If not, does anyone know how this could be achieved?

Updated:
Subscribe buttons should be conditionally visible. By default, they should be visible only if they link to a .txt file (to accommodate most browser-based software tools). We could enable the button for compressed (.zip, .7z) or other formats per this if needed after #370 is implemented.

Updated 2:

• We should hide subscribe buttons if the viewUrl is not plain-text (e.g. .7z, .zip).
• We should hide subscribe buttons if the software selected in the software filter select does not support abp:/ubo:-style subscribe links. (isAbpSubscribable)
• We should change "Subscribe" to "Import" if the software selected in the software filter select is AdGuard.

cuz AdGuard doesn't have real subscribe, it'll only import lists to user filters without possible updates. -via

• We should change abp: subscribe links to ubo: subscribe links if the list is only supported by uBO/Nano. -via
• We should support IE/TPL subscribe links. -#289
• We should support Little Snitch subscribe links. -#507
• See if there is a subscribe link format that the Opera browser can support. -via

Automation of moving lists to Stale

Currently, lists are included in the Stale list type if they have not been updated in the past year. This is a manual process, and it will be hard to keep updated. We should eliminate the Stale list type .json file (moving all of its current lists to their most appropriate other list type) and instead display lists on the Stale page by an automated check of their last updated date.

Requires #6

Add Mute

Add to Global:
http://mute.bradconte.com/

Add logo and favicon

Add logo and favicon

Software support

Use the list's software support to calculate the FilScore.

Lists that can be subscribed to in larger numbers of software tools should be rated slightly better.

Requires #11

Add Satterly's ABP Filters

Add to Global:
https://satterly.neocities.org/abp_filters.html