Python parse XML with lxml library

In this article, you will learn about Python lxml library and how it can be used to perform xml parsing and data scraping.

Python has many libraries for reading and writing data from XML formats. The lxml is one that has consistently strong performance and easy to use in parsing large files. Here, we have mentioned the installation process and some important features of lxml library.

Install lxml library

First, we need to install the lxml library. The following command on terminal window install the library using pip tool -

pip install lxml

On successful installation, it returns something like this -

Collecting lxml
  Downloading lxml-4.5.0-cp37-cp37m-win_amd64.whl (3.7 MB)
     |████████████████████████████████| 3.7 MB 384 kB/s
Installing collected packages: lxml
Successfully installed lxml-4.5.0

lxml objectify

In lxml.objectify, element trees provide an API that models the behavior of normal Python object trees as closely as possible. So, we have imported the library as follows -

from lxml import objectify

xml parse() method

The parse() method can be used to parse from files and file-like objects.

Get XML element children

We can retrieve a list of all children of element by calling the getchildren() method.

Python Code to parse XML with lxml library

Suppose, we have the following xml file -

<vehicle>
	<car>
		<name>Suzuki Dzire</name>
		<engine>VVT Petrol</engine>
		<displacement>1197CC</displacement>
		<cylinder>4</cylinder>
		<drivetrain>FWD</drivetrain>
		<emission>BS VI</emission>
		<seating>5</seating>
		<mileage>22kmpl</mileage>
		<power_steering>Yes</power_steering>
		<tyre_type>tubeless</tyre_type>
	</car>	
</vehicle>

Here is the code to parse the XML file, it skips the given elements and displays the remaining elements and their values -

from lxml import objectify
path = 'vehicle.xml'
parsed = objectify.parse(open(path))
root = parsed.getroot()

data = []
skip_fields = ['tyre_type','power_streeing','emission']
for elt in root.car:
    el_data = {}
    for child in elt.getchildren():
        if child.tag in skip_fields:
            continue
        el_data[child.tag] = child.pyval
    data.append(el_data)

print(data)

Once we will execute the above code, it returns the following output -

Related Articles