Moving a subtree from a document created in one thread into a
document of another thread could crash when the rest of the source
document is deleted while the subtree is still in use.
Rare crash when serialising to a file object with certain encodings.
lxml.html.ElementSoup was replaced by a new module
lxml.html.soupparser with a more consistent API. The old module
remains for compatibility with ElementTree's own ElementSoup module.
Setting the XSLT_CONFIG and XML2_CONFIG environment variables at
build time will let setup.py pick up the xml2-config and
xslt-config scripts from the supplied path name.
Passing --with-xml2-config=/path/to/xml2-config to setup.py will
override the xml2-config script that is used to determine the C
compiler options. The same applies for the --with-xslt-config
option.
The generated API documentation was cleaned up and disburdened from
non-public classes etc.
The previously public module lxml.html.setmixin was renamed to
lxml.html._setmixin as it is not an official part of lxml. If
you want to use it, feel free to copy it over to your own source
base.
Passing --with-xslt-config=/path/to/xslt-config to setup.py will
override the xslt-config script that is used to determine the C
compiler options.
Parse-time XML schema validation (schema parser keyword).
XPath string results of the text() function and attribute
selection make their Element container accessible through a
getparent() method. As a side-effect, they are now always
unicode objects (even ASCII strings).
XSLT objects are usable in any thread - at the cost of a deep
copy if they were not created in that thread.
Invalid entity names and character references will be rejected by
the Entity() factory.
entity.text returns the textual representation of the entity,
e.g. &.
Various places in the XPath, XSLT and iteration APIs now require
keyword-only arguments.
The argument order in element.itersiblings() was changed to
match the order used in all other iteration methods. The second
argument ('preceding') is now a keyword-only argument.
The getiterator() method on Elements and ElementTrees was
reverted to return an iterator as it did in lxml 1.x. The ET API
specification allows it to return either a sequence or an iterator,
and it traditionally returned a sequence in ET and an iterator in
lxml. However, it is now deprecated in favour of the iter()
method, which should be used in new code wherever possible.
The 'pretty printed' serialisation of ElementTree objects now
inserts newlines at the root level between processing instructions,
comments and the root tag.
A 'pretty printed' serialisation is now terminated with a newline.
Second argument to lxml.etree.Extension() helper is no longer
required, third argument is now a keyword-only argument ns.
Use default prefixes for some common XML namespaces.
lxml.html.clean.Cleaner now allows for a host_whitelist, and
two overridable methods: allow_embedded_url(el,url) and the
more general allow_element(el).
Extended slicing of Elements as in element[1:-1:2], both in
etree and in objectify
Resolvers can now provide a base_url keyword argument when
resolving a document as string data.
When using lxml.doctestcompare you can give the doctest option
NOPARSE_MARKUP (like #doctest:+NOPARSE_MARKUP) to suppress
the special checking for one test.
In the lxml.htmliter_links method, links in <object>
tags weren't recognized. (Note: plugin-specific link parameters
still aren't recognized.) Also, the <embed> tag, though not
standard, is now included in lxml.html.defs.special_inline_tags.
Using custom resolvers on XSLT stylesheets parsed from a string
could request ill-formed URLs.
With lxml.doctestcompare if you do <tagxmlns="..."> in your
output, it will then be namespace-neutral (before the ellipsis was
treated as a real namespace).
The module source files were renamed to "lxml.*.pyx", such as
"lxml.etree.pyx". This was changed for consistency with the way
Pyrex commonly handles package imports. The main effect is that
classes now know about their fully qualified class name, including
the package name of their module.
Keyword-only arguments in some API functions, especially in the
parsers and serialisers.
The test suites now run gc.collect() in the tearDown()
methods. While this makes them take a lot longer to run, it also
makes it easier to link a specific test to garbage collection
problems that would otherwise appear in later tests.
Tag name validation in lxml.etree (and lxml.html) now distinguishes
between HTML tags and XML tags based on the parser that was used to
parse or create them. HTML tags no longer reject any non-ASCII
characters in tag names but only spaces and the special characters
<>&/"'.
ET.write(), tostring() and tounicode() now accept a keyword
argument method that can be one of 'xml' (or None), 'html' or 'text' to
serialise as XML, HTML or plain text content.
iterfind() method on Elements returns an iterator equivalent to
findall()
itertext() method on Elements
Setting a QName object as value of the .text property or as an attribute
will resolve its prefix in the respective context
Reimplemented objectify.E for better performance and improved
integration with objectify. Provides extended type support based on
registered PyTypes.
XSLT objects now support deep copying
New makeSubElement() C-API function that allows creating a new
subelement straight with text, tail and attributes.
XPath extension functions can now access the current context node
(context.context_node) and use a context dictionary
(context.eval_context) from the context provided in their first
parameter
HTML tag soup parser based on BeautifulSoup in lxml.html.ElementSoup
New module lxml.doctestcompare by Ian Bicking for writing simplified
doctests based on XML/HTML output. Use by importing lxml.usedoctest or
lxml.html.usedoctest from within a doctest.
New module lxml.cssselect by Ian Bicking for selecting Elements with CSS
selectors.
New package lxml.html written by Ian Bicking for advanced HTML
treatment.
Namespace class setup is now local to the ElementNamespaceClassLookup
instance and no longer global.
Schematron validation (incomplete in libxml2)
Additional stringify argument to objectify.PyType() takes a
conversion function to strings to support setting text values from arbitrary
types.
Entity support through an Entity factory and element classes. XML
parsers now have a resolve_entities keyword argument that can be set to
False to keep entities in the document.
column field on error log entries to accompany the line field
Error specific messages in XPath parsing and evaluation
NOTE: for evaluation errors, you will now get an XPathEvalError instead of
an XPathSyntaxError. To catch both, you can except on XPathError
The regular expression functions in XPath now support passing a node-set
instead of a string
Extended type annotation in objectify: new xsiannotate() function
EXSLT RegExp support in standard XPath (not only XSLT)
The ElementMaker in lxml.builder now accepts the keyword arguments
namespace and nsmap to set a namespace and nsmap for the Elements it
creates.
The docinfo on ElementTree objects has new properties internalDTD
and externalDTD that return a DTD object for the internal or external
subset of the document respectively.
Serialising an ElementTree now includes any internal DTD subsets that are
part of the document, as well as comments and PIs that are siblings of the
root node.
lxml now raises a TagNameWarning about tag names containing ':' instead of
an Error as 1.3.3 did. The reason is that a number of projects currently
misuse the previous lack of tag name validation to generate namespace
prefixes without declaring namespaces. Apart from the danger of generating
broken XML this way, it also breaks most of the namespace-aware tools in
XML, including XPath, XSLT and validation. lxml 1.3.x will continue to
support this bug with a Warning, while lxml 2.0 will be strict about
well-formed tag names (not only regarding ':').
Serialising an Element no longer includes its comment and PI siblings (only
ElementTree serialisation includes them).
Module lxml.pyclasslookup module implements an Element class lookup
scheme that can access the entire tree in read-only mode to help determining
a suitable Element class
Parsers take a remove_comments keyword argument that skips over comments
parse() function in objectify, corresponding to XML() etc.
Element.addnext(el) and Element.addprevious(el) methods to support
adding processing instructions and comments around the root node
Element.attrib was missing clear() and pop() methods
Extended type annotation in objectify: cleaner annotation namespace setup
plus new deannotate() function
Support for custom Element class instantiation in lxml.sax: passing a
makeelement function to the ElementTreeContentHandler will reuse the
lookup context of that function
'.' represents empty ObjectPath (identity)
Element.values() to accompany the existing .keys() and .items()
collectAttributes() C-function to build a list of attribute
keys/values/items for a libxml2 node
DTD validator class (like RelaxNG and XMLSchema)
HTML generator helpers by Fredrik Lundh in lxml.htmlbuilder
ElementMaker XML generator by Fredrik Lundh in lxml.builder.E
Support for pickeling objectify.ObjectifiedElement objects to XML
update() method on Element.attrib
Optimised replacement for libxml2's _xmlReconsiliateNs(). This allows lxml
a better handling of namespaces when moving elements between documents.
Support for regular expressions in benchmark selection
get/set emulation (not .attrib!) for attributes on processing instructions
ElementInclude Python module for ElementTree compatible XInclude processing
that honours custom resolvers registered with the source document
ElementTree.parser property holds the parser used to parse the document
setup.py has been refactored for greater readability and flexibility
--rpath flag to setup.py to induce automatic linking-in of dynamic library
runtime search paths has been renamed to --auto-rpath. This makes it
possible to pass an --rpath directly to distutils; previously this was being
shadowed.
code cleanup: redundant _NodeBase super class merged into _Element class
Note: although the impact should be zero in most cases, this change breaks
the compatibiliy of the public C-API
Comments and processing instructions return '<!-- coment -->' and
'<?pi-target content?>' for repr()
Parsers are now the preferred (and default) place where element class lookup
schemes should be registered. Namespace lookup is no longer supported by
default.
Support for Python 2.5 beta
Unlock the GIL for deep copying documents and for XPath()
New compact keyword argument for parsing read-only documents
Support for parser options in iterparse()
The namespace axis is supported in XPath and returns (prefix, URI)
tuples
The XPath expression "/" now returns an empty list instead of raising an
exception
XML-Object API on top of lxml (lxml.objectify)
Customizable Element class lookup:
different pre-implemented lookup mechanisms
support for externally provided lookup functions
Support for processing instructions (ET-like, not compatible)
Public C-level API for independent extension modules
Module level iterwalk() function as 'iterparse' for trees
Module level iterparse() function similar to ElementTree (see
documentation for differences)
Element.nsmap property returns a mapping of all namespace prefixes known at
the Element to their namespace URI
Reentrant threading support in RelaxNG, XMLSchema and XSLT
Threading support in parsers and serializers:
All in-memory operations (tostring, parse(StringIO), etc.) free the GIL
File operations (on file names) free the GIL
Reading from file-like objects frees the GIL and reacquires it for reading
Serialisation to file-like objects is single-threaded (high lock overhead)
Element iteration over XPath axes:
Element.iterdescendants() iterates over the descendants of an element
Element.iterancestors() iterates over the ancestors of an element (from
parent to parent)
Element.itersiblings() iterates over either the following or preceding
siblings of an element
Element.iterchildren() iterates over the children of an element in either
direction
All iterators support the tag keyword argument to restrict the
generated elements
Element.getnext() and Element.getprevious() return the direct siblings of an
element
filenames with local 8-bit encoding were not supported
1.1beta did not compile under Python 2.3
ignore unknown 'pyval' attribute values in objectify
objectify.ObjectifiedElement.addattr() failed to accept Elements and Lists
objectify.ObjectPath.setattr() failed to accept Elements and Lists
XPathSyntaxError now inherits from XPathError
Threading race conditions in RelaxNG and XMLSchema
Crash when mixing elements from XSLT results into other trees, concurrent
XSLT is only allowed when the stylesheet was parsed in the main thread
The EXSLT regexp:match function now works as defined (except for some
differences in the regular expression syntax)
Setting element.text to '' returned None on request, not the empty string
iterparse() could crash on long XML files
Creating documents no longer copies the parser for later URL resolving. For
performance reasons, only a reference is kept. Resolver updates on the
parser will now be reflected by documents that were parsed before the
change. Although this should rarely become visible, it is a behavioral
change from 1.0.
Support for copy.deepcopy() on elements. copy.copy() works also, but
does the same thing, and does not create a shallow copy, as that
makes no sense in the context of libxml2 trees. This means a
potential incompatibility with ElementTree, but there's more chance
that it works than if copy.copy() isn't supported at all.
Increased compatibility with (c)ElementTree; .parse() on ElementTree is
supported and parsing of gzipped XML files works.
implemented index() on elements, allowing one to find the index of a
SubElement.
Use xslt-config instead of xml2-config to find out libxml2
directories to take into account a case where libxslt is installed
in a different directory than libxslt.
Eliminate crash condition in iteration when text nodes are changed.
Passing 'None' to tostring() does not result in a segfault anymore,
but an AssertionError.
Some test fixes for Windows.
Raise XMLSyntaxError and XPathSyntaxError instead of plain python
syntax errors. This should be less confusing.
Fixed error with uncaught exception in Pyrex code.
Calling lxml.etree.fromstring('') throws XMLSyntaxError instead of a
segfault.
has_key() works on attrib. 'in' tests also work correctly on attrib.
INSTALL.txt was saying 2.2.16 instead of 2.6.16 as a supported
libxml2 version, as it should.
Passing a UTF-8 encoded string to the XML() function would fail;
fixed.
parameters (XPath expressions) can be passed to XSLT using keyword
parameters.
Simple XInclude support. Calling the xinclude() method on a tree
will process any XInclude statements in the document.
XMLSchema support. Use the XMLSchema class or the convenience
xmlschema() method on a tree to do XML Schema (XSD) validation.
Added convenience xslt() method on tree. This is less efficient
than the XSLT object, but makes it easier to write quick code.
Added convenience relaxng() method on tree. This is less efficient
than the RelaxNG object, but makes it easier to write quick code.
Make it possible to use XPathEvaluator with elements as well. The
XPathEvaluator in this case will retain the element so multiple
XPath queries can be made against one element efficiently. This
replaces the second argument to the .evaluate() method that existed
previously.
Allow registerNamespace() to be called on an XPathEvaluator, after
creation, to add additional namespaces. Also allow registerNamespaces(),
which does the same for a namespace dictionary.
Add 'prefix' attribute to element to be able to read prefix information.
This is entirely read-only.
It is possible to supply an extra nsmap keyword parameter to
the Element() and SubElement() constructors, which supplies a
prefix to namespace URI mapping. This will create namespace
prefix declarations on these elements and these prefixes will show up
in XML serialization.
Killed yet another memory management related bug: trees created
using newDoc would not get a libxml2-level dictionary, which caused
problems when deallocating these documents later if they contained a
node that came from a document with a dictionary.
Moving namespaced elements between documents was problematic as
references to the original document would remain. This has been fixed
by applying xmlReconciliateNs() after each move operation.
Can pass None to 'dump()' without segfaults.
tostring() works properly for non-root elements as well.
Cleaned out the tostring() method so it should handle encoding
correctly.
Cleaned out the ElementTree.write() method so it should handle encoding
correctly. Writing directly to a file should also be faster, as there is no
need to go through a Python string in that case. Made sure the test cases
test both serializing to StringIO as well as serializing to a real file.
Changed setup.py so that library_dirs is also guessed. This should
help with compilation on the Mac OS X platform, where otherwise the
wrong library (shipping with the OS) could be picked up.
Tweaked setup.py so that it picks up the version from version.txt.
