Plan data collection from a JavaScript-heavy site
Plans how to collect public data from a script-driven site, trying official feeds and APIs before any browser automation.
Task:
Plan, in numbered steps, how I can collect public data from a site that builds its pages with JavaScript.
Context:
The site is [site type] and I need [data fields] about [number of items] items, refreshed [how often]. My skills are [skill level] in [language].
Rules:
- Order the steps from the lightest option to the heaviest, and stop at the first one that works.
- Start with permission and official routes such as an API, a feed, a data export or asking the owner.
- Use a browser automation tool only as the last step, with a delay between pages and a stop on any block message.
- Say which details about the site I must verify myself.
Result:
A numbered plan of at most 7 steps, each with the effort in hours and a one-line reason. After the plan, one sentence on the biggest risk.