Contribute Media
A thank you to everyone who makes this possible: Read More

Aaaarrgghh, Spider! Web scraping with Scrapy


A quick yet reasonably thorough introduction to Scrapy, the high-level web crawling & scraping framework for Python. Includes a demo, cause I like living on the edge. The "core concepts demo" is a hands-on introduction, starting from a simple example and progressively adding more features. It covers the following topics: * Spiders (Spider, CrawlSpider, etc) * Selectors (XPath, CSS, Regex, etc) * Items & item loaders * Input & output processors * Pipelines Slides from the previous version of this talk:

Ruby developer since ~2003. Py-curious, Love FP. I talk a lot about programming.


Improve this page