Web scraping tools

Ready-made prompts for writing and fixing code for web scraping tools.

Choose a Python library for my scraping job

Recommends one Python library for your scraping job from a short comparison of the options you name, with a minimal starter outline.

Convert an HTML table to clean CSV rows

Turns a pasted HTML table into clean CSV rows with clear column names, flagging merged cells and values it cannot read.

Design a database table for scraped records

Designs a database table and an upsert statement for scraped records, with keys, timestamps and no secrets in the chat.

Export scraped records to CSV and Excel

Writes a short script that exports scraped records to CSV and an Excel file with safe encoding, headers and no formula injection.

Write a Beautiful Soup parser for HTML I paste

Writes a Beautiful Soup parser for a pasted HTML sample that returns your named fields as a list of records, with safe handling of missing elements.

Write a cleaning script for scraped data

Writes a script that cleans a scraped dataset after reading sample rows, with every change logged and the raw file kept.

Write a polite infinite scroll collector

Writes a script that loads an infinite scroll page step by step with limits and delays, after checking the site's terms allow it.

Write a polite Playwright script for a public page

Writes one Playwright script that reads named fields from a public page, with delays, a clear user agent and a stop on errors.

Write a polite rate limit and retry policy

Writes a rate limit and retry policy for your scraper, with delays, backoff on errors and a stop rule, plus a code outline in your language.

Write an LLM prompt that extracts fields from page text

Writes a reusable extraction prompt and JSON schema that pulls named fields out of page text I am allowed to process.