Cloud infrastructure/devops
dataflowkit.com
Dataflow Kit Web Scraper sandbox and mock API
Render Javascript driven pages, while we internally manage Headless Chrome and proxies for you. - Build a custom web scraper with our Visual point-and-click toolkit. - Scrape the most popular Search engines result pages (SERP). - Convert web pages to PDF and capture screenshots. *** ### Authentication Dataflow Kit API require you to sign up for an API key in order to use the API. The API key can b Writes persist, data moves on a schedule and every change can fire a signed webhook.
- Operations
- 5
- Collections
- -
- Event types
- -
example request
curl https://your-dataflowkit.slurry.io/ \
-H "Authorization: Bearer slurry_sim_..."Your simulation gets its own hostname, key and IP allow-list. Built from API version 1.3.
What gets simulated
Collections, relationships and state machines are worked out from the spec when you start the simulation.
- State. Creates, updates and deletes persist and show up in later reads.
- Behaviour. Records move through their states on a schedule you control, and you can fast-forward up to 30 days.
- Webhooks. Every change emits a signed, retried event.
- Failure. Per-endpoint errors, latency and chaos rules, on demand.
Operations
All 5.
- POST/convert/url/pdf
- POST/convert/url/screenshot
- POST/fetch
- POST/parse
- POST/serp