Tag: web crawler
-
Updated
Scrapy: The Web Scraping Framework for Python
Category: Python, Web Development
Scrapy is a fast high-level web crawling and web scraping framework. Notes on install, the interactive shell, spiders, items, pipelines, and debugging.
-
Updated
lxml: Parse HTML or XML with XPath in Python
Category: Python, Web Development
It might look old school, but `lxml` is the most feature-rich and easy-to-use library for processing XML and HTML in Python.