Tim Rühsen
2914afa8c7
New linter/ dir with pslint.py selftest
2016-02-18 16:40:06 +01:00
Tim Rühsen
811513f17e
Print message and exit when no suffixes are found
2016-02-12 12:27:25 +01:00
Tim Rühsen
d19c46c003
Make a few enhancements to pslint
2016-02-08 14:11:52 +01:00
Tim Rühsen
36609787d5
Fix python3 UTF-8 runtime error and section detection
2016-02-08 09:40:43 +01:00
Tim Rühsen
568394438d
Add disabled code for 'Group Order' checking
...
The check has been disabled since it turned out that those
'groupings' of PSL entries are not really ordered in the way
(# of labels, TLD, sublabel#1, sublabel#2, ...)
This commit also fixes section detection / verification
2016-02-05 12:16:50 +01:00
Tim Rühsen
aa028e606b
Adjust text in doublette comment in src/pslint.py
2016-02-02 22:49:02 +01:00
Tim Rühsen
a46af675b4
Fix indentation multi-line comment in src/pslint.py
2016-02-02 22:41:18 +01:00
Tim Rühsen
bd70c79c18
Indent src/pslint.py with tabs
2016-02-02 22:20:58 +01:00
Tim Rühsen
98aed19c3a
Convert copyright line to UTF-8 in pslint.py
2016-02-02 19:59:45 +01:00
Tim Rühsen
3ba8903915
Add PSL linter written in Python
2016-02-02 16:43:03 +01:00
Tim Rühsen
8c39291f55
Slightly shorter DAFSA array when sorting input
2016-01-05 10:57:07 +01:00
Tim Rühsen
1bd9347af9
Fix for commit fd928da46e
2016-01-04 22:15:43 +01:00
Tim Rühsen
fd928da46e
Fix python3 incompatibilities in make_dafsa.py
2016-01-04 20:22:13 +01:00
Tim Rühsen
95a5152e56
Update copyright year to 2016
2016-01-02 13:36:49 +01:00
Tim Rühsen
96e0848d81
Release unused memory after loading DAFSA data
2016-01-02 13:31:53 +01:00
Tim Rühsen
748e3ae9cc
Load DAFSA precompiled files (auto-detection)
2016-01-01 22:38:21 +01:00
Tim Rühsen
1604cb3dca
Fix make_dafsa.py to generate 4 bit return values
2016-01-01 22:32:11 +01:00
Tim Rühsen
23345f5f37
Convert lookup_string_in_fixed_set.c into UTF-8
2016-01-01 22:31:01 +01:00
Tim Rühsen
c9d76e4898
Remove unused variable source_date_epoch
2016-01-01 17:20:30 +01:00
Tim Rühsen
cde5e53ea6
Remove psl_builtin_compile_time() for reproducable builds
2016-01-01 15:44:24 +01:00
Tim Rühsen
c699e3c441
Add --input-format and --output-format to make_dafsa.py
2015-12-30 17:52:48 +01:00
Tim Rühsen
355edc152f
Fix for previous commit
2015-12-29 17:20:28 +01:00
Tim Rühsen
82e9445493
Add psl2c --binary to create DAFSA binary file from PSL
2015-12-29 16:53:47 +01:00
Tim Rühsen
5363290cbe
Remove debugging printf
2015-12-26 14:29:10 +01:00
Tim Rühsen
093d5eac3d
Fix ./configure --disable-runtime
...
Added runtime punycode generation code from
http://www.nicemice.net/idn/punycode-spec.gz
2015-12-26 14:15:08 +01:00
Tim Rühsen
e252af877f
Fix ./configure --disable-builtin
2015-12-15 20:46:25 +01:00
Daniel Kahn Gillmor
01a3751524
re-fix psl_builtin_outdated()
2015-12-11 22:59:15 -05:00
Tim Rühsen
0ca3741df6
Use DAWG/DAFSA format for builtin data
...
This data representation reduces the size of the PSL data
drastically and still allows fast lookups.
2015-12-09 09:35:04 +01:00
Tim Rühsen
36139b601d
Merge branch 'develop' into dafsa
2015-12-07 10:33:44 +01:00
Tim Rühsen
9d2e93f0b8
New function psl_is_public_suffix2()
...
The current PSL has two sections, ICANN and PRIVATE.
This new function allows to limit the check for one or both
of these sections.
2015-12-06 21:55:56 +01:00
Tim Rühsen
883e67f008
Create src/suffixes_dafsa.c with DAFSA C array
2015-12-04 21:26:30 +01:00
Tim Rühsen
aa0593460c
Remove .travis.yml from branch
2015-12-04 17:15:03 +01:00
Tim Rühsen
b53273d406
Use absolute PSL path to make psl_builtin_outdated() work reliable
2015-11-19 11:18:17 +01:00
Tim Rühsen
dbefdb6767
Remove include of bits/stat.h
2015-11-19 10:06:04 +01:00
Tim Rühsen
643e523f09
Fix psl_builtin_outdated()
2015-09-27 19:14:13 +02:00
Tim Rühsen
53c2fe31a8
Update copyright years
2015-09-23 14:50:01 +02:00
Tim Rühsen
00b9cfb119
Add function psl_check_version_number()
2015-09-23 14:04:17 +02:00
Tim Rühsen
6a8f33ee39
Add new function psl_builtin_outdated()
2015-09-19 14:00:49 +02:00
Tim Rühsen
34289fa59b
Add function psl_suffix_wildcard_count()
2015-09-19 10:55:09 +02:00
Tim Rühsen
e443d21b61
Code cleanup, faster lookups
2015-09-19 10:50:00 +02:00
Tim Rühsen
597709cb11
Support combination of foo.bar and *.foo.bar
2015-09-15 14:49:53 +02:00
Tim Rühsen
f6a3b96f91
Check PSL entries before generating built-in data
2015-09-15 11:46:21 +02:00
Daniel Kahn Gillmor
ac8ba5a828
Documentation cleanup
2015-08-12 10:06:49 +02:00
Tim Rühsen
3f5e208967
src/psl.c: Fix C99 comment to C89
2015-08-06 12:31:21 +02:00
Tim Rühsen
71835fcd44
Add https://github.com/publicsuffix as git submodule
2015-07-14 13:25:42 +02:00
Daniel Kahn Gillmor
f9a1bdcf80
Embed _psl_compile_time derived from $SOURCE_DATE_EPOCH if set
...
Making packages build byte-for-byte reproducibly from a given
toolchain+source makes it much easier to corroborate builds by testing
against other build infrastructure.
By default, libpsl currently embeds the current unix timestamp in
_psl_compile_time, which makes it bytewise incompatible if it is
rebuild even on the same machine one second later.
See https://wiki.debian.org/ReproducibleBuilds/TimestampsProposal for
more information about $SOURCE_DATE_EPOCH.
2015-07-12 22:55:35 +02:00
Tim Rühsen
998b5515d7
Work around a libidn<=1.30 vulnerability
2015-07-06 13:03:50 +02:00
Giuseppe Scrivano
7a07205f1b
psl.c: fix strndup replacement
...
Do not copy more bytes than the src string length.
2015-02-28 18:52:47 +01:00
Giuseppe Scrivano
225c557e23
psl.c: Do not define _GNU_SOURCE
2015-02-28 18:37:14 +01:00
Tim Rühsen
067f6aee9c
Don't use locale dependent isspace()
...
Fixes an issue on Solaris
Reported-by: Dagobert Michelsen <dam@opencsw.org>
2015-01-26 11:05:32 +01:00
Tim Rühsen
896f7f6ae4
Fix ASCII check in src/psl2c.c
2015-01-26 11:04:22 +01:00
Tim Rühsen
58a4f6c028
add iconv Solaris compatibility
2015-01-23 16:13:19 +01:00
Tim Rühsen
910c4b37b6
add strndup() compatibility code
2015-01-23 15:05:02 +01:00
Tim Rühsen
16d751c7d3
mark API as stable
2015-01-21 15:38:18 +01:00
Tim Rühsen
6f899ae32b
fixed gcc warning about comparison being always true
2015-01-21 12:26:44 +01:00
Tim Rühsen
d5254ac816
removed C99 style comments
2015-01-21 12:21:32 +01:00
Tim Rühsen
c8a9d2d6ff
revoke ec63726165
2014-11-14 17:18:41 +01:00
Tim Rühsen
ec63726165
fixed compiler warning in src/psl.c
2014-11-14 15:52:37 +01:00
Tim Rühsen
bbed26b303
check for alloca.h before including
2014-10-28 15:41:35 +01:00
Tim Rühsen
4a33c2f65c
removed qsort_r() which seems unavailable on CygWin
2014-08-22 17:44:48 +02:00
Tim Rühsen
8c6179e798
added support for IP addresses in psl_is_cookie_domain_acceptable()
2014-08-19 17:46:36 +02:00
Tim Rühsen
c5f61d745b
whitespace correction
2014-08-14 11:05:47 +02:00
Jakub Čajka
c599471282
Fixed ascii string detection on architectures with unsigned char
2014-08-01 09:16:44 +02:00
Tim Rühsen
5c5ee3aad7
added code for all of runtime and builtin options
2014-06-30 13:21:16 +02:00
Tim Ruehsen
373bcb912c
more work on support for libidn, libidn2, libicu
2014-06-29 22:56:33 +02:00
Tim Rühsen
74f715bd9c
started with libidn2 integration
2014-06-27 17:13:30 +02:00
Tim Ruehsen
c9fd29a977
small doc format change
2014-06-23 12:56:13 +02:00
Tim Ruehsen
f7f1408088
removed possible C89 compilation issue
2014-06-20 17:04:22 +02:00
Tim Ruehsen
1c20931896
introduced defines for error codes
2014-06-20 12:36:51 +02:00
Tim Ruehsen
9f5d6b1e9d
added idn2 punycode generation as fallback for missing libicu
2014-06-19 13:15:31 +02:00
Tim Ruehsen
1d13ab1d18
removed redundant code from psl2c.c
2014-06-19 12:06:54 +02:00
Tim Ruehsen
a1a5b5e5d7
fixed c89 compatibility
2014-06-18 16:27:29 +02:00
Tim Ruehsen
4ae0fecc64
some libicu cleanups
2014-06-18 15:21:22 +02:00
Tim Ruehsen
e6e0f7759f
added lowercase conversion to ASCII strings
2014-06-18 12:39:55 +02:00
Tim Ruehsen
935b44b3ea
updated docs, removed printing to stderr
2014-06-18 12:26:45 +02:00
Tim Ruehsen
57394eb1f8
added psl_str_to_utf8lower()
2014-06-17 17:14:02 +02:00
Daniel Kahn Gillmor
ae542f391b
actually report the filename in _psl_filename
2014-06-06 00:52:02 -04:00
Tim Ruehsen
7621dce71d
fixed C89 comment incompatibility
2014-06-05 11:53:29 +02:00
Tim Ruehsen
79cd551b17
fixed libicu implementation, use pkg-config for libicu detection
2014-06-05 11:39:28 +02:00
Tim Ruehsen
58daea97ce
added IDNA2008 UTS#46 via libicu
2014-06-04 13:20:34 +02:00
Tim Ruehsen
ecdadf76e5
added psl_get_version(), bumped version to 0.2.5
2014-05-31 19:33:30 +02:00
Daniel Kahn Gillmor
cadb963475
remove LIBPSL_API_VERSION for simplicity
2014-05-31 18:56:07 +02:00
Tim Ruehsen
0eeec32ee3
fix return value of psl_builtin() to NULL if no builtin PSL data available
2014-05-30 16:08:47 +02:00
Tim Ruehsen
7d3e2eebb2
use alloca instead of malloc for command buffer allocation
2014-05-12 12:27:32 +02:00
Tim Ruehsen
1efb6b75f4
changed code to C89 standard
2014-05-12 12:20:59 +02:00
Tim Ruehsen
608d9d951f
added punycode considerations to the API docs
2014-04-22 16:49:00 +02:00
Tim Ruehsen
ed9562848c
small --disable-builtin cleanups
2014-04-17 13:09:29 +02:00
Tim Ruehsen
ee0064532c
added psl_builtin_filename()
2014-04-17 12:31:06 +02:00
Tim Ruehsen
c18f6fdc6f
fixed docs
2014-04-16 11:36:37 +02:00
Tim Ruehsen
2c7c11d8a6
added psl_is_cookie_domain_acceptable()
2014-04-16 10:52:35 +02:00
Tim Ruehsen
c93268ce25
added ./configure --with-psl-file to set PSL file path
2014-04-13 16:35:28 +02:00
Tim Ruehsen
b49e681d8f
renamed psl_is_public() to psl_is_public_suffix()
2014-04-12 16:04:42 +02:00
Tim Ruehsen
0dad83966d
added the missing function documentation
2014-04-11 16:30:20 +02:00
Tim Ruehsen
c37830f6fc
reverted meaning of psl_is_public (again), started function docs
2014-04-06 22:30:50 +02:00
Tim Ruehsen
9d18b46ed9
moved gettext defines away from header file
2014-04-02 10:26:40 +02:00
Tim Ruehsen
65a1f03939
small code fixes
2014-03-30 21:52:00 +02:00
Tim Ruehsen
31319a3dc7
added ./configure --disable-builtin to build without PSL data
2014-03-30 17:02:56 +02:00
Tim Ruehsen
2cc4be71c4
removed incomplete and unneeded initialization of _builtin_psl
2014-03-30 12:06:16 +02:00
Tim Ruehsen
3d3884fc6f
fixed errors introduced in last change
2014-03-29 18:58:24 +01:00
Tim Ruehsen
834f280100
removed fprintf from library code
2014-03-29 18:54:04 +01:00
Tim Ruehsen
9d2fde5fce
check input params in exported functions
2014-03-29 18:54:04 +01:00
Tim Ruehsen
acb06542c9
finished comment
2014-03-29 18:54:04 +01:00
Tim Ruehsen
535751b6cc
prevailing rule is *
2014-03-28 22:02:42 +01:00
Daniel Kahn Gillmor
fb9ccbf88e
change psl_free() to take a psl_ctx_t *psl
...
This uses the more common convention where the variable freed is the
thing returned from the constructor directly, rather than having the
deallocator also zero out the pointer itself.
2014-03-27 20:01:29 +01:00
Tim Ruehsen
e7599d2ca0
fixed punycode sorting
2014-03-27 10:02:58 +01:00
Tim Ruehsen
fd0ff2023b
added psl_registrable_domain(), renamed psl_registered_domain -> psl_unregistrable_domain
2014-03-26 22:27:31 +01:00
Tim Ruehsen
a18777c2e3
new function psl_registered_domain()
2014-03-26 17:14:25 +01:00
Daniel Kahn Gillmor
73acfc570b
avoid the need for psl_global_init() and psl_global_deinit()
...
There is no need to for an initialization function if the builtin
structs if the comparison function will look at label_buf directly
when label == NULL.
This simplifies the API for users, who now don't have to worry about
library initialization and deinitialization functions (these sort of
functions can cause headaches in chained library loads, esp. in plugin
architectures like PAM).
2014-03-24 18:33:27 -04:00
Daniel Kahn Gillmor
6e7e58aa38
builtin should be returned const
...
callers should never try to do any non-const operation with the
builtin public suffix list.
2014-03-24 18:18:45 -04:00
Tim Ruehsen
2ec5dc7567
small cleanups in Makefile.am
2014-03-24 20:54:34 +01:00
Tim Ruehsen
8b096a5eda
LGPL->MIT license, some cleanups
2014-03-24 20:41:46 +01:00
Tim Ruehsen
9d1c62eb07
merged libpsl and libpsl-inline
2014-03-24 17:29:56 +01:00
Tim Ruehsen
3b94a03638
use idn2 instead of libidn2 to avoid the need for GPL3+ license
2014-03-24 15:54:43 +01:00
Tim Ruehsen
e379ba90cf
replaced md5 by sha1 checksumming
2014-03-24 09:48:01 +01:00
Tim Ruehsen
0771255742
added info functions
2014-03-23 21:49:19 +01:00
Tim Ruehsen
3b33ff2575
added libidn2 to .travis.yml
2014-03-22 23:05:55 +01:00
Tim Ruehsen
4a54c3cf2a
removed punycode debug output
2014-03-22 22:57:10 +01:00
Tim Ruehsen
a906062b85
added IDNA2008 punycode support for psl_inline_is_public()
2014-03-22 22:55:34 +01:00
Tim Ruehsen
99d057d514
revert logic for psl_is_public()
2014-03-22 22:19:20 +01:00
Tim Ruehsen
3998137fd0
added PSL inline library
2014-03-22 20:35:56 +01:00
Tim Ruehsen
a707b267c9
new function psl_load_fp()
2014-03-22 14:28:55 +01:00
Tim Ruehsen
577fd14bb4
renamed psl_is_tld() to psl_is_public()
2014-03-22 10:26:59 +01:00
Daniel Kahn Gillmor
c07ea9d0a0
return NULL from psl_load_file() if the file could not be read.
2014-03-21 14:43:27 -04:00
Daniel Kahn Gillmor
2d99b964ff
avoid a printf in the library
...
In general, we don't want libraries to send data to the standard file
descriptors. There are more that need fixing.
Note: this introduces a new API (psl_suffix_count() and
psl_suffix_exception_count) to enable the same sort of output from the
test. But this new API seems to imply the internal structure of the
public suffix list.
Do we want to expose this API? There could be some other PSL
mechanism (e.g. DBOUND) that doesn't have these counts, and a drop-in
replacement would not know what to return here.
2014-03-21 14:38:30 -04:00
Daniel Kahn Gillmor
e3c28f8a86
fgets into buf directly, rather than the stack
2014-03-21 14:18:36 -04:00
Tim Ruehsen
cf46f5d84b
replaced getline() by fgets() for compatibility reasons
2014-03-21 15:41:27 +01:00
Tim Ruehsen
f22a3fcb71
do not redefine _GNU_SOURCE
2014-03-21 11:05:09 +01:00
Tim Ruehsen
dc05276515
autoconf first version
2014-03-20 22:43:04 +01:00