libpsl/README.md

164 lines
5.5 KiB
Markdown
Raw Permalink Normal View History

2016-09-21 12:34:44 +02:00
[![Travis-CI Status](https://travis-ci.org/rockdaboot/libpsl.png?branch=master)](https://travis-ci.org/rockdaboot/libpsl)
[![Coverity Scan](https://img.shields.io/coverity/scan/10227.svg)](https://scan.coverity.com/projects/rockdaboot-libpsl)
2016-09-23 17:13:32 +02:00
[![Coverage Status](https://coveralls.io/repos/github/rockdaboot/libpsl/badge.svg?branch=master)](https://coveralls.io/github/rockdaboot/libpsl?branch=master)
2014-03-21 21:25:44 +01:00
2016-11-04 14:28:30 +01:00
Solaris OpenCSW [![Build Status Solaris amd64](https://buildfarm.opencsw.org/buildbot/png?builder=libpsl-solaris10-amd64)](https://buildfarm.opencsw.org/buildbot/builders/libpsl-solaris10-amd64)
[![Build Status Solaris i386](https://buildfarm.opencsw.org/buildbot/png?builder=libpsl-solaris10-i386)](https://buildfarm.opencsw.org/buildbot/builders/libpsl-solaris10-i386)
[![Build Status Solaris Sparc](https://buildfarm.opencsw.org/buildbot/png?builder=libpsl-solaris10-sparc)](https://buildfarm.opencsw.org/buildbot/builders/libpsl-solaris10-sparc)
[![Build Status Solaris SparcV9](https://buildfarm.opencsw.org/buildbot/png?builder=libpsl-solaris10-sparcv9)](https://buildfarm.opencsw.org/buildbot/builders/libpsl-solaris10-sparcv9)
2014-03-20 17:17:24 +01:00
libpsl - C library to handle the Public Suffix List
===================================================
A *Public Suffix List* is a collection of Top Level Domains (TLDs) suffixes.
TLDs include *Global Top Level Domains* (gTLDs) like `.com` and `.net`;
*Country Top Level Domains* (ccTLDs) like `.de` and `.cn`;
and *[Brand Top Level Domains](https://icannwiki.org/Brand_TLD)* like `.apple` and `.google`.
Brand TLDs allows users to register their own top level domain that exist at the same level as ICANN's gTLDs.
Brand TLDs are sometimes referred to as Vanity Domains.
2014-04-24 12:41:21 +02:00
Browsers, web clients and other user agents can use a public suffix list to:
2014-04-24 12:41:21 +02:00
- avoid privacy-leaking "supercookies"
2016-07-05 17:49:14 +02:00
- avoid privacy-leaking "super domain" certificates ([see post from Jeffry Walton](https://lists.gnu.org/archive/html/bug-wget/2014-03/msg00093.html))
2014-04-24 12:41:21 +02:00
- domain highlighting parts of the domain in a user interface
- sorting domain lists by site
Libpsl...
- has built-in PSL data for fast access (DAWG/DAFSA reduces size from 180kB to ~32kB)
2014-04-24 12:41:21 +02:00
- allows to load PSL data from files
- checks if a given domain is a "public suffix"
- provides immediate cookie domain verification
- finds the longest public part of a given domain
- finds the shortest private part of a given domain
- works with international domains (UTF-8 and IDNA2008 Punycode)
- is thread-safe
- handles IDNA2008 UTS#46 (if libicu is available)
2014-04-24 12:41:21 +02:00
2016-12-07 09:14:04 +01:00
Find more information about the Public Suffix List [here](https://publicsuffix.org/).
2018-10-13 22:01:36 +02:00
Download the Public Suffix List [here](https://github.com/publicsuffix/list/blob/master/public_suffix_list.dat).
2014-03-20 17:17:24 +01:00
2018-10-13 22:01:36 +02:00
The original DAFSA code is from the [Chromium Project](https://code.google.com/p/chromium/).
2014-04-24 12:41:21 +02:00
API Documentation
-----------------
You find the current API documentation [here](https://rockdaboot.github.io/libpsl).
Quick API example
-----------------
#include <stdio.h>
#include <libpsl.h>
int main(int argc, char **argv)
{
const char *domain = "www.example.com";
const char *cookie_domain = ".com";
const psl_ctx_t *psl = psl_builtin();
int is_public, is_acceptable;
is_public = psl_is_public_suffix(psl, domain);
printf("%s %s a public suffix.\n", domain, is_public ? "is" : "is not");
is_acceptable = psl_is_cookie_domain_acceptable(psl, domain, cookie_domain);
printf("cookie domain '%s' %s acceptable for domain '%s'.\n",
cookie_domain, is_acceptable ? "is" : "is not", domain);
return 0;
}
Command Line Tool
-----------------
Libpsl comes with a tool 'psl' that gives you access to most of the
library API via command line.
$ psl --help
prints the usage.
2016-07-13 11:14:18 +02:00
Convert PSL into DAFSA
----------------------
The [DAFSA](https://en.wikipedia.org/wiki/Deterministic_acyclic_finite_state_automaton) format is a compressed
representation of strings. Here we use it to reduce the whole PSL to about 32k in size.
Generate `psl.dafsa` from `list/public_suffix_list.dat`
$ src/psl-make-dafsa --output-format=binary list/public_suffix_list.dat psl.dafsa
2016-07-13 11:14:18 +02:00
Test the result (example)
$ tools/psl --load-psl-file psl.dafsa aeroclub.aero
2014-04-24 12:41:21 +02:00
License
-------
Libpsl is made available under the terms of the MIT license.<br>
See the LICENSE file that accompanies this distribution for the full text of the license.
src/psl-make-dafsa and src/lookup_string_in_fixed_set.c are licensed under the term written in
src/LICENSE.chromium.
2014-04-24 12:41:21 +02:00
Building from tarball
---------------------
Choose a release from https://github.com/rockdaboot/libpsl/tags an download the tarball
named `libpsl-{version}.tar.*`. Unpack with `tar xf <filename>`, cd into the libsl* directory.
Build with
```
./configure
make
make check
```
Install with
```
sudo make install
```
2014-03-20 17:17:24 +01:00
Building from git
-----------------
2016-01-04 20:41:24 +01:00
You should have python2.7+ installed.
2014-03-20 17:17:24 +01:00
Download project and prepare sources with
2016-07-05 17:49:14 +02:00
git clone https://github.com/rockdaboot/libpsl
2014-03-20 17:17:24 +01:00
./autogen.sh
./configure
make
make check
2014-03-22 08:28:52 +01:00
If you prefer a `meson` build
meson builddir
ninja -C builddir
ninja -C builddir test
There is also an unofficial MSVC nmake build configuration in `msvc/`. Please
see README.MSVC.md on building libpsl with Visual Studio via NMake or Meson.
2014-04-24 12:41:21 +02:00
2014-03-22 08:28:52 +01:00
Mailing List
------------
2018-10-13 21:57:41 +02:00
[Mailing List Archive](https://groups.google.com/forum/#!forum/libpsl-bugs)
2014-03-29 18:42:24 +01:00
2014-03-22 08:28:52 +01:00
[Mailing List](https://groups.google.com/forum/#!forum/libpsl-bugs)
To join the mailing list send an email to
2016-11-10 11:05:00 +01:00
libpsl-bugs+subscribe@googlegroups.com
2014-03-22 08:28:52 +01:00
and follow the instructions provided by the answer mail.
Or click [join](https://groups.google.com/forum/#!forum/libpsl-bugs/join).