Contribute Media
A thank you to everyone who makes this possible: Read More

What we learned from scraping 1 billion webpages every month


Speaker: Samet Atdag

Web is broken. We learned the hard way. Developers tend to hack, hacks tend to break the web. In this talk, I share what we learned how websites don't obey the protocols and how developers had caused the web became a chaotic medium.

Recorded at the PyConDE & PyData Berlin 2019 conference.

More details at the conference page: Follow us on Twitter:,


Improve this page