A tutorial on web scraping basics using Python's lxml library and XPaths, demonstrated by extracting data from Steam.
A programmer shares a script to automate exporting Storify content before it shuts down, saving time over the manual process.
A technical guide on reverse engineering the Facebook API to download private videos using Python and browser analysis.
A technical guide on reverse engineering Facebook to create a tool for downloading public videos by analyzing network requests.
A guide on reverse engineering the Soundcloud API to bypass download restrictions using Python.
A technical guide on using Puppeteer to scrape and save a complete copy of a website, including all assets, for performance audits.
A developer shares a cautionary tale about the pitfalls of outsourcing an MVP, using a personal project as an example of what can go wrong.
A summary of a Python Frederick talk on using Scrapy, a Python framework for web scraping, including a link to the presentation.
A technical guide on using R's rvest package to scrape book descriptions and genres from Goodreads, adapting code from an existing project.
An analysis of Hacker News moderation tools and practices, based on data scraped from the site's API.
A Fedora maintainer shares a Python script to scrape and email daily reports of failed live CD builds from Koji.
A technical guide on using Python to scrape public data, including answers to questions, from the European Parliament website.
First part of a series on building a Twitter bot using Node.js, covering setup, authentication, and basic search functionality.
A developer shares a Python script to save subscriber-only LWN.net articles to Pocket for offline reading.
A developer documents their journey creating a Whitney Houston song API from scratch using Python, web scraping, and JSON.
Learn how to use PhantomJS, a headless browser, to inject and execute JavaScript for inspecting dynamic websites.
The author asks readers to choose which of his two Python web scraping projects he should write a tutorial about next.
A tutorial on using Ruby and the Mechanize gem to scrape personal fitness data from MyFitnessPal when API access is unavailable.
A technical analysis of reverse-engineering TimeEdit's web interface to extract and parse schedule data via its JSON and HTML endpoints.
The author announces they will be giving their first conference talk on Webscraping in Python at EuroPython 2014.
