This repository provides actively maintained, high-quality domain lists focused on URL shorteners and IP logging services, designed for seamless integration into cybersecurity and web filtering projects. Our lists are strictly validated to be free of duplicates and formatting errors, with all domains conforming to RFC standards and sorted alphabetically. Driven by community contributions, these lists are dedicated to the public domain (CC0 1.0 Universal) and are free to use, modify, and share for any purpose. The lists are provided "as is" without warranty, and while we strive for accuracy, we cannot guarantee they are exhaustive or free of errors.
The domains are organized into three distinct lists: shorteners.txt, iploggers.txt, and whitelist.txt. All files contain only valid and active domains in ASCII/Punycode format. Automated checks ensure the lists are free of invalid characters and duplicates, correctly sorted, and properly formatted.
The shorteners.txt file includes domains that provide URL shortening services. For example, bit.ly allows users to create shorter links that redirect to other web pages.
Access the raw file: shorteners.txt
The iploggers.txt file lists domains associated with services primarily used for IP address logging and user tracking. For example, interacting with a link from a service like grabify.link typically records the user's IP address and other metadata for purposes such as analytics, tracking, or reconnaissance.
Access the raw file: iploggers.txt
The whitelist.txt file contains domains that, while related to shortening services, are used internally for operational purposes. For example, a link like youtu.be is used by a service provider to handle redirects within their own platform (in this case, YouTube). These domains are essential for the service's functionality and do not redirect to arbitrary external websites, only internally within the service itself.
Access the raw file: whitelist.txt
Contributions to this project are welcome. You can contribute by reporting issues or submitting pull requests.
To ensure maximum compatibility, all domain submissions must be in ASCII format.
Internationalized Domain Names (IDNs) containing non-ASCII characters (e.g., bücher.de) must be converted to their Punycode representation (e.g., xn--bcher-kva.de) before submission. Our validation scripts will reject any domains submitted in their native non-ASCII format. An online tool like Punycode Converter can be used for this conversion.
To report a problem or to suggest the addition or removal of a domain, please open a new issue using the appropriate template. Provide as much detail as possible to facilitate a timely resolution.
To contribute directly, please follow these steps:
-
Fork the repository: Create your own copy of the repository to work on.
-
Make your changes: Implement the desired changes in your forked repository, adhering to the domain format requirements mentioned above.
-
Run preparation script: Before committing changes that modify the lists, run the preparation script to ensure the files are clean and adhere to repository standards:
chmod +x tests/prepare.sh ./tests/prepare.sh
This project's validation scripts utilize the Public Suffix List for accurate suffix validation of domains. Specifically, the public_suffix_list.dat file is downloaded directly from their GitHub repository during our automated testing process via GitHub Actions. The Public Suffix List is licensed under the Mozilla Public License, Version 2.0 (MPL-2.0).
This project is dedicated to the public domain under the CC0 1.0 Universal license. You are free to copy, modify, distribute, and use the repository, even for commercial purposes, without permission. While not required, attribution is appreciated.