StevenBlack/hosts


Consolidating and extending hosts files from several well-curated sources. You can optionally pick extensions to block pornography, social media, and other categories.

License: MIT

Language: Python

Keywords: ad-blocker, anti-virus, curated-sources, gambling-filter, hosts, malware, porn-filter, pornblocker, privacy, protection, python, ransomware, security, social-media-filter, trojans, unified-hosts


Unified hosts file with base extensions

This repository consolidates several reputable hosts files, and merges them into various unified hosts files with duplicates removed.

  • Here's the raw hosts file containing 26,889 entries.
  • Last updated: March 29 2016.

List of all hosts file variants

Host file recipe Readme Raw hosts Unique domains
Unified hosts = (adware + malware) Readme link 26,889
Unified hosts + gambling Readme link 27,604
Unified hosts + porn Readme link 32,143
Unified hosts + social Readme link 26,997
Unified hosts + gambling + porn Readme link 32,858
Unified hosts + gambling + social Readme link 27,712
Unified hosts + porn + social Readme link 32,251
Unified hosts + gambling + porn + social Readme link 32,966

Expectation: These unified hosts files should serve all devices, regardless of OS.

Sources of hosts data unified here

Updated hosts files from the following locations are always unified and included:

Extensions

The unified hosts file is extensible. You manage extensions by curating the extensions/ folder tree. See the social, gambling, and porn extension which are included in this repo, for example.

Generate your own unified hosts file

The updateHostsFile.py script, which is python 2.7 and Python 3-compatible, will generate a unified hosts file based on the sources in the local data/ subfolder. The script will prompt you Whether it should fetch updated versions (from locations defined by the update.info text file in each source's folder), otherwise it will use the hosts file that's already there.

Usage

Using Python 3:

python3 updateHostsFile.py [--auto] [--replace] [--ip nnn.nnn.nnn.nnn] [--extensions ext1 ext2 ext3]

Using Python 2.7:

python updateHostsFile.py [--auto] [--replace] [--ip nnn.nnn.nnn.nnn] [--extensions ext1 ext2 ext3]

Command line options:

--auto, or -a: run the script without prompting. When --auto is invoked,

  • Hosts data sources, including extensions, are updated.
  • No extensions are included by default. Use the --extensions or -e flag to include any you want.
  • Your active hosts file is not replaced unless you include the --replace flag.

--replace, or -r: trigger replacing your active hosts file with the new hosts file. Use along with --auto to force replacement.

--ip nnn.nnn.nnn.nnn, or -i nnn.nnn.nnn.nnn: the IP address to use as the target. Default is 0.0.0.0.

--extensions <ext1> <ext2> <ext3>, or -e <ext1> <ext2> <ext3>: the names of subfolders below the extensions folder containing additional category-specific hosts files to include in the amalgamation. Example: --extensions porn or -e social porn.

--noupdate, or -n: skip fetching updates from hosts data sources.

--output <subfolder>, or -o <subfolder>: place the generated source file in a subfolder. If the subfolder does not exist, it will be created.

--help, or -h: display help.

How do I control which sources are unified?

Add one or more additional sources, each in a subfolder of the data/ folder, and specify its update url in update.info file.

Add one or more optional extensions, which originate from subfolders of the extensions/ folder. Again the url in update.info controls where this extension finds its updates.

How do I incorporate my own hosts?

If you have custom hosts records, place them in file myhosts. The contents of this file are prepended to the unified hosts file during the update process.

What is a hosts file?

A hosts file, named hosts (with no file extension), is a plain-text file used by all operating systems to map hostnames to IP addresses.

In most operating systems, the hosts file is preferential to DNS. Therefore if a domain name is resolved by the hosts file, the request never leaves your computer.

Having a smart hosts file goes a long way towards blocking malware, adware, and other irritants.

For example, to nullify requests to some doubleclick.net servers, adding these lines to your hosts file will do it:

# block doubleClick's servers
127.0.0.1 ad.ae.doubleclick.net
127.0.0.1 ad.ar.doubleclick.net
127.0.0.1 ad.at.doubleclick.net
127.0.0.1 ad.au.doubleclick.net
127.0.0.1 ad.be.doubleclick.net
# etc...

We recommend using 0.0.0.0 instead of 127.0.0.1

Using 0.0.0.0 is faster because you don't have to wait for a timeout. It also does not interfere with a web server that may be running on the local PC.

Why not use just 0 instead of 0.0.0.0?

We tried that. Using 0 doesn't work universally.

Location of your hosts file

To modify your current hosts file, look for it in the following places and modify it with a text editor.

Mac OS X, iOS, Android, Linux: /etc/hosts folder.

Windows: %SystemRoot%\system32\drivers\etc\hosts folder.

Reloading hosts file

Your operating system will cache DNS lookups. You can either reboot or run the following commands to manually flush your DNS cache once the new hosts file is in place.

Mac OS X

Open a Terminal and run:

sudo dscacheutil -flushcache;sudo killall -HUP mDNSResponder

Windows

Open a Command Prompt:

Windows XP: Start -> Run -> cmd

Windows Vista, 7: Start Button -> type cmd -> right-click Command Prompt -> "Run as Administrator"

Windows 8: Start -> Swipe Up -> All Apps -> Windows System -> right-click Command Prompt -> "Run as Administrator"

and run:

ipconfig /flushdns

Linux

Open a Terminal and run with root privileges:

Debian/Ubuntu sudo /etc/rc.d/init.d/nscd restart

Linux with systemd: sudo systemctl restart network.service

Fedora Linux: sudo systemctl restart NetworkManager.service

Arch Linux/Manjaro with Network Manager: sudo systemctl restart NetworkManager.service

Arch Linux/Manjaro with Wicd: sudo systemctl restart wicd.service

Others: Consult this wikipedia article.

Goals of this unified hosts file

The goals of this repo are to:

  1. automatically combine high-quality lists of hosts,

  2. provide easy extensions,

  3. de-dupe the resultant combined list,

  4. and keep the resultant file reasonably sized.

A high-quality source is defined here as one that is actively curated. A hosts source should be frequently updated by its maintainers with both additions and removals. The larger the hosts file, the higher the level of curation is expected.

For example, the (huge) hosts file from hosts-file.net is not included here because it is very large (300,000+ entries) and doesn't currently display a corresponding high level of curation activity.

It is expected that this unified hosts file will serve both desktop and mobile devices under a variety of operating systems.

Project Statistics

Sourcerank 9
Repository Size 134 MB
Stars 16,235
Forks 1,468
Watchers 560
Open issues 39
Dependencies 0
Contributors 17
Tags 119
Created
Last updated
Last pushed

Top Contributors See all

Steven Black Franco Gagliardi Peter Naudus FadeMind Mateusz Konieczny Old (Unused) Account - See URL Ben Limmer Jonadabe M. Omer Golgeli Boris Schapira tyzbit qqo Nimar Marius Voila Joshua Rosato KingRalph mpsOxygen

Recent Tags See all

v2.3.3 February 18, 2019
v2.3.2 February 12, 2019
v2.3.1 February 06, 2019
v2.3.0 January 30, 2019
v2.2.3 January 26, 2019
v2.2.2 January 22, 2019
v2.2.1 January 14, 2019
v2.2.0 January 10, 2019
v2.1.25 January 05, 2019
v2.1.24 December 30, 2018
v2.1.23 December 29, 2018
v2.1.22 December 24, 2018
v2.1.21 December 15, 2018
v2.1.20 December 11, 2018
v2.1.19 December 04, 2018

Interesting Forks See all

tzuryby/hosts
Extending and consolidating hosts files from several well-curated sources like adaway.org, mvps.o...
Python - MIT - Updated - 23 stars
tyzbit/hosts
Extending and consolidating hosts files from a variety of sources like adaway.org, mvps.org, malw...
Python - Last pushed - 5 stars - 1 forks
borisschapira/hosts
Extending and consolidating hosts files from a variety of sources like adaway.org, mvps.org, malw...
Python - Last pushed - 5 stars
hd074/hosts
Extending and consolidating hosts files from a variety of sources like adaway.org, mvps.org, malw...
Python - Last pushed - 5 stars - 1 forks
CHEF-KOCH/hosts
Consolidating and Extending hosts files from several well-curated sources. You can optionally pic...
MIT - Updated - 1 stars

Something wrong with this page? Make a suggestion

Last synced: 2017-11-24 18:52:06 UTC

Login to resync this repository