2014-09-28 19:39:28 +02:00
|
|
|
<html>
|
|
|
|
|
<head>
|
|
|
|
|
<title>pcre2 specification</title>
|
|
|
|
|
</head>
|
|
|
|
|
<body bgcolor="#FFFFFF" text="#00005A" link="#0066FF" alink="#3399FF" vlink="#2222BB">
|
|
|
|
|
<h1>pcre2 man page</h1>
|
|
|
|
|
<p>
|
|
|
|
|
Return to the <a href="index.html">PCRE2 index page</a>.
|
|
|
|
|
</p>
|
|
|
|
|
<p>
|
|
|
|
|
This page is part of the PCRE2 HTML documentation. It was generated
|
|
|
|
|
automatically from the original man page. If there is any nonsense in it,
|
|
|
|
|
please consult the man page, in case the conversion went wrong.
|
|
|
|
|
<br>
|
|
|
|
|
<ul>
|
|
|
|
|
<li><a name="TOC1" href="#SEC1">INTRODUCTION</a>
|
|
|
|
|
<li><a name="TOC2" href="#SEC2">SECURITY CONSIDERATIONS</a>
|
|
|
|
|
<li><a name="TOC3" href="#SEC3">USER DOCUMENTATION</a>
|
|
|
|
|
<li><a name="TOC4" href="#SEC4">AUTHOR</a>
|
|
|
|
|
<li><a name="TOC5" href="#SEC5">REVISION</a>
|
|
|
|
|
</ul>
|
|
|
|
|
<br><a name="SEC1" href="#TOC1">INTRODUCTION</a><br>
|
|
|
|
|
<P>
|
|
|
|
|
PCRE2 is the name used for a revised API for the PCRE library, which is a set
|
|
|
|
|
of functions, written in C, that implement regular expression pattern matching
|
2018-08-13 13:57:09 +02:00
|
|
|
using the same syntax and semantics as Perl, with just a few differences. After
|
|
|
|
|
nearly two decades, the limitations of the original API were making development
|
2018-07-11 12:06:51 +02:00
|
|
|
increasingly difficult. The new API is more extensible, and it was simplified
|
|
|
|
|
by abolishing the separate "study" optimizing function; in PCRE2, patterns are
|
2018-08-13 13:57:09 +02:00
|
|
|
automatically optimized where possible. Since forking from PCRE1, the code has
|
2018-07-11 12:06:51 +02:00
|
|
|
been extensively refactored and new features introduced.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
As well as Perl-style regular expression patterns, some features that appeared
|
|
|
|
|
in Python and the original PCRE before they appeared in Perl are available
|
|
|
|
|
using the Python syntax. There is also some support for one or two .NET and
|
|
|
|
|
Oniguruma syntax items, and there are options for requesting some minor changes
|
|
|
|
|
that give better ECMAScript (aka JavaScript) compatibility.
|
2014-09-28 19:39:28 +02:00
|
|
|
</P>
|
|
|
|
|
<P>
|
2021-04-28 17:37:48 +02:00
|
|
|
The source code for PCRE2 can be compiled to support strings of 8-bit, 16-bit,
|
|
|
|
|
or 32-bit code units, which means that up to three separate libraries may be
|
|
|
|
|
installed, one for each code unit size. The size of code unit is not related to
|
|
|
|
|
the bit size of the underlying hardware. In a 64-bit environment that also
|
|
|
|
|
supports 32-bit applications, versions of PCRE2 that are compiled in both
|
|
|
|
|
64-bit and 32-bit modes may be needed.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
2014-09-28 19:39:28 +02:00
|
|
|
The original work to extend PCRE to 16-bit and 32-bit code units was done by
|
|
|
|
|
Zoltan Herczeg and Christian Persch, respectively. In all three cases, strings
|
|
|
|
|
can be interpreted either as one character per code unit, or as UTF-encoded
|
2014-11-03 19:27:56 +01:00
|
|
|
Unicode, with support for Unicode general category properties. Unicode support
|
2014-11-21 17:45:06 +01:00
|
|
|
is optional at build time (but is the default). However, processing strings as
|
2014-11-03 19:27:56 +01:00
|
|
|
UTF code units must be enabled explicitly at run time. The version of Unicode
|
|
|
|
|
in use can be discovered by running
|
2014-09-28 19:39:28 +02:00
|
|
|
<pre>
|
|
|
|
|
pcre2test -C
|
|
|
|
|
</PRE>
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
2014-10-20 19:28:49 +02:00
|
|
|
The three libraries contain identical sets of functions, with names ending in
|
|
|
|
|
_8, _16, or _32, respectively (for example, <b>pcre2_compile_8()</b>). However,
|
|
|
|
|
by defining PCRE2_CODE_UNIT_WIDTH to be 8, 16, or 32, a program that uses just
|
2014-09-28 19:39:28 +02:00
|
|
|
one code unit width can be written using generic names such as
|
2014-10-20 19:28:49 +02:00
|
|
|
<b>pcre2_compile()</b>, and the documentation is written assuming that this is
|
2014-09-28 19:39:28 +02:00
|
|
|
the case.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
In addition to the Perl-compatible matching function, PCRE2 contains an
|
|
|
|
|
alternative function that matches the same compiled patterns in a different
|
|
|
|
|
way. In certain circumstances, the alternative function has some advantages.
|
|
|
|
|
For a discussion of the two matching algorithms, see the
|
|
|
|
|
<a href="pcre2matching.html"><b>pcre2matching</b></a>
|
|
|
|
|
page.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
Details of exactly which Perl regular expression features are and are not
|
|
|
|
|
supported by PCRE2 are given in separate documents. See the
|
|
|
|
|
<a href="pcre2pattern.html"><b>pcre2pattern</b></a>
|
|
|
|
|
and
|
|
|
|
|
<a href="pcre2compat.html"><b>pcre2compat</b></a>
|
|
|
|
|
pages. There is a syntax summary in the
|
|
|
|
|
<a href="pcre2syntax.html"><b>pcre2syntax</b></a>
|
|
|
|
|
page.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
Some features of PCRE2 can be included, excluded, or changed when the library
|
|
|
|
|
is built. The
|
|
|
|
|
<a href="pcre2_config.html"><b>pcre2_config()</b></a>
|
|
|
|
|
function makes it possible for a client to discover which features are
|
|
|
|
|
available. The features themselves are described in the
|
|
|
|
|
<a href="pcre2build.html"><b>pcre2build</b></a>
|
|
|
|
|
page. Documentation about building PCRE2 for various operating systems can be
|
|
|
|
|
found in the
|
|
|
|
|
<a href="README.txt"><b>README</b></a>
|
|
|
|
|
and
|
|
|
|
|
<a href="NON-AUTOTOOLS-BUILD.txt"><b>NON-AUTOTOOLS_BUILD</b></a>
|
|
|
|
|
files in the source distribution.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
The libraries contains a number of undocumented internal functions and data
|
|
|
|
|
tables that are used by more than one of the exported external functions, but
|
|
|
|
|
which are not intended for use by external callers. Their names all begin with
|
|
|
|
|
"_pcre2", which hopefully will not provoke any name clashes. In some
|
|
|
|
|
environments, it is possible to control which external symbols are exported
|
|
|
|
|
when a shared library is built, and in these cases the undocumented symbols are
|
|
|
|
|
not exported.
|
|
|
|
|
</P>
|
|
|
|
|
<br><a name="SEC2" href="#TOC1">SECURITY CONSIDERATIONS</a><br>
|
|
|
|
|
<P>
|
|
|
|
|
If you are using PCRE2 in a non-UTF application that permits users to supply
|
|
|
|
|
arbitrary patterns for compilation, you should be aware of a feature that
|
2014-11-03 19:27:56 +01:00
|
|
|
allows users to turn on UTF support from within a pattern. For example, an
|
|
|
|
|
8-bit pattern that begins with "(*UTF)" turns on UTF-8 mode, which interprets
|
|
|
|
|
patterns and subjects as strings of UTF-8 code units instead of individual
|
|
|
|
|
8-bit characters. This causes both the pattern and any data against which it is
|
|
|
|
|
matched to be checked for UTF-8 validity. If the data string is very long, such
|
|
|
|
|
a check might use sufficiently many resources as to cause your application to
|
|
|
|
|
lose performance.
|
2014-09-28 19:39:28 +02:00
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
One way of guarding against this possibility is to use the
|
|
|
|
|
<b>pcre2_pattern_info()</b> function to check the compiled pattern's options for
|
2015-06-18 18:39:25 +02:00
|
|
|
PCRE2_UTF. Alternatively, you can set the PCRE2_NEVER_UTF option when calling
|
2017-03-24 17:53:38 +01:00
|
|
|
<b>pcre2_compile()</b>. This causes a compile time error if the pattern contains
|
2015-06-18 18:39:25 +02:00
|
|
|
a UTF-setting sequence.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
The use of Unicode properties for character types such as \d can also be
|
|
|
|
|
enabled from within the pattern, by specifying "(*UCP)". This feature can be
|
|
|
|
|
disallowed by setting the PCRE2_NEVER_UCP option.
|
2014-09-28 19:39:28 +02:00
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
If your application is one that supports UTF, be aware that validity checking
|
|
|
|
|
can take time. If the same data string is to be matched many times, you can use
|
|
|
|
|
the PCRE2_NO_UTF_CHECK option for the second and subsequent matches to avoid
|
|
|
|
|
running redundant checks.
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
2015-06-18 18:39:25 +02:00
|
|
|
The use of the \C escape sequence in a UTF-8 or UTF-16 pattern can lead to
|
|
|
|
|
problems, because it may leave the current matching point in the middle of a
|
2015-12-17 19:44:06 +01:00
|
|
|
multi-code-unit character. The PCRE2_NEVER_BACKSLASH_C option can be used by an
|
2015-10-17 15:50:56 +02:00
|
|
|
application to lock out the use of \C, causing a compile-time error if it is
|
2015-12-17 19:44:06 +01:00
|
|
|
encountered. It is also possible to build PCRE2 with the use of \C permanently
|
2015-10-17 15:50:56 +02:00
|
|
|
disabled.
|
2015-06-18 18:39:25 +02:00
|
|
|
</P>
|
|
|
|
|
<P>
|
2014-09-28 19:39:28 +02:00
|
|
|
Another way that performance can be hit is by running a pattern that has a very
|
|
|
|
|
large search tree against a string that will never match. Nested unlimited
|
|
|
|
|
repeats in a pattern are a common example. PCRE2 provides some protection
|
|
|
|
|
against this: see the <b>pcre2_set_match_limit()</b> function in the
|
|
|
|
|
<a href="pcre2api.html"><b>pcre2api</b></a>
|
2017-07-19 18:04:15 +02:00
|
|
|
page. There is a similar function called <b>pcre2_set_depth_limit()</b> that can
|
2017-03-24 17:53:38 +01:00
|
|
|
be used to restrict the amount of memory that is used.
|
2014-09-28 19:39:28 +02:00
|
|
|
</P>
|
|
|
|
|
<br><a name="SEC3" href="#TOC1">USER DOCUMENTATION</a><br>
|
|
|
|
|
<P>
|
|
|
|
|
The user documentation for PCRE2 comprises a number of different sections. In
|
|
|
|
|
the "man" format, each of these is a separate "man page". In the HTML format,
|
|
|
|
|
each is a separate page, linked from the index page. In the plain text format,
|
|
|
|
|
the descriptions of the <b>pcre2grep</b> and <b>pcre2test</b> programs are in
|
|
|
|
|
files called <b>pcre2grep.txt</b> and <b>pcre2test.txt</b>, respectively. The
|
|
|
|
|
remaining sections, except for the <b>pcre2demo</b> section (which is a program
|
|
|
|
|
listing), and the short pages for individual functions, are concatenated in
|
|
|
|
|
<b>pcre2.txt</b>, for ease of searching. The sections are as follows:
|
|
|
|
|
<pre>
|
2014-11-14 19:41:20 +01:00
|
|
|
pcre2 this document
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2-config show PCRE2 installation configuration information
|
|
|
|
|
pcre2api details of PCRE2's native C API
|
|
|
|
|
pcre2build building PCRE2
|
2018-09-18 18:31:30 +02:00
|
|
|
pcre2callout details of the pattern callout feature
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2compat discussion of Perl compatibility
|
2018-08-13 13:57:09 +02:00
|
|
|
pcre2convert details of pattern conversion functions
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2demo a demonstration C program that uses PCRE2
|
|
|
|
|
pcre2grep description of the <b>pcre2grep</b> command (8-bit only)
|
2014-11-21 17:45:06 +01:00
|
|
|
pcre2jit discussion of just-in-time optimization support
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2limits details of size and other limits
|
|
|
|
|
pcre2matching discussion of the two matching algorithms
|
|
|
|
|
pcre2partial details of the partial matching facility
|
2014-11-23 19:38:38 +01:00
|
|
|
pcre2pattern syntax and semantics of supported regular expression patterns
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2perform discussion of performance issues
|
|
|
|
|
pcre2posix the POSIX-compatible C API for the 8-bit library
|
|
|
|
|
pcre2sample discussion of the pcre2demo program
|
2018-08-13 13:57:09 +02:00
|
|
|
pcre2serialize details of pattern serialization
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2syntax quick syntax reference
|
2014-11-21 17:45:06 +01:00
|
|
|
pcre2test description of the <b>pcre2test</b> command
|
2014-09-28 19:39:28 +02:00
|
|
|
pcre2unicode discussion of Unicode and UTF support
|
|
|
|
|
</pre>
|
|
|
|
|
In the "man" and HTML formats, there is also a short page for each C library
|
|
|
|
|
function, listing its arguments and results.
|
|
|
|
|
</P>
|
|
|
|
|
<br><a name="SEC4" href="#TOC1">AUTHOR</a><br>
|
|
|
|
|
<P>
|
|
|
|
|
Philip Hazel
|
|
|
|
|
<br>
|
|
|
|
|
University Computing Service
|
|
|
|
|
<br>
|
2014-11-21 17:45:06 +01:00
|
|
|
Cambridge, England.
|
2014-09-28 19:39:28 +02:00
|
|
|
<br>
|
|
|
|
|
</P>
|
|
|
|
|
<P>
|
|
|
|
|
Putting an actual email address here is a spam magnet. If you want to email me,
|
|
|
|
|
use my two initials, followed by the two digits 10, at the domain cam.ac.uk.
|
|
|
|
|
</P>
|
|
|
|
|
<br><a name="SEC5" href="#TOC1">REVISION</a><br>
|
|
|
|
|
<P>
|
2021-04-28 17:37:48 +02:00
|
|
|
Last updated: 28 April 2021
|
2014-09-28 19:39:28 +02:00
|
|
|
<br>
|
2021-04-28 17:37:48 +02:00
|
|
|
Copyright © 1997-2021 University of Cambridge.
|
2014-09-28 19:39:28 +02:00
|
|
|
<br>
|
|
|
|
|
<p>
|
|
|
|
|
Return to the <a href="index.html">PCRE2 index page</a>.
|
|
|
|
|
</p>
|
