Argues for an evolved robots.txt standard with AI-specific rules and regulations to enforce them, citing Perplexity AI's violations.
A guide to installing and configuring Playwright for browser automation on Heroku using Node.js, including dependency management and code structure.
A developer details the process of scraping a restaurant week website's API to create a better UI, covering reverse-engineering and data presentation.
How to automatically check internal links on a static site using Scrapy and GitHub Actions for continuous integration.
A developer shares technical challenges and solutions for building reliable web scraping features for a SaaS website monitoring tool.
A technical analysis of UK rainfall data, covering data scraping, visualization, and processing using Python and APIs.
A technical walkthrough of scraping and visualizing global airline passenger route data using Python, DuckDB, and QGIS.
Advanced techniques for customizing element screenshots in Playwright, including DOM manipulation and image preprocessing.
A technical tutorial on web scraping and text analysis using R and ggplot2 to analyze descriptions of US Wilderness Areas.
A programmer's guide to automating a badminton court booking system using Selenium and Python to secure time slots.
A guide to using GitHub Actions to monitor API responses or web pages for changes and receive automated notifications via SMS or other channels.
A technical tutorial on using R and the rvest package to scrape data from multiple web pages, including handling pagination.
Explores user-built alternatives like Nitter and Invidious that reclaim the web from corporate platforms by offering ad-free, privacy-focused interfaces.
A tutorial on building an automated stock checker for gaming consoles using Playwright, Azure Functions, and Twilio for notifications.
A tutorial on building and scheduling a Python web scraper to run automatically using GitHub Actions, including emailing results.
Learn how to monitor webpage changes using Home Assistant, checking ETag headers or content hashes to trigger automations.
Part 3 of a tutorial series on building a bot that checks for new YouTube videos and automatically tweets the links using Python and Twitter's API.
A PowerShell script to check the version and security status of WordPress sites by parsing HTML and RSS feeds.
A guide on extracting and parsing JSON data from websites and public APIs using R, focusing on converting nested JSON into tidy dataframes.
A technical guide on building a YouTube-to-Twitter bot, focusing on moving channel data into a database and extracting recent video uploads.
