Page 1 of 1

How your team keeps scrapers working

About 10 minutes. Please describe real events, not opinions. Short answers are fine, and "never happened" is a useful answer too.

I'm researching this problem to decide whether to build a product. Nothing is for sale here. I'm Hieu Tran; I use AI tools to help with this research, including drafting messages and organising responses. Answers are kept private and only shared in anonymised form.

Think of the last time a scraper you run broke: a layout change, a block, or results that silently came back empty or wrong. What happened, and how did you find out?

What did it cost: hours to fix, bad data downstream, a customer or report affected?

How do you notice today that a scraper has broken? Walk through what alerts you or who notices.

What do you use or pay for (Apify, Zyte, Bright Data, Firecrawl, your own Playwright code…)? What made you choose it?

Your role

Company website

Sites or scrapers you maintain

A
B
C
D

Email for one or two short follow-up questions (optional)