Live pipeline
Live demo connecting…
Watch the collection pipeline work end-to-end — scheduler → RabbitMQ → crawler → object store. Pick a source and run a live crawl.
Pipeline
·
Scheduler
Postgres · claim
→
0
RabbitMQ
media.events
→
0
Crawler
fetch · dedup
→
0
MinIO
raw HTML
Event stream
events 0
in window 0
new 0
duplicates 0
outside window 0
not articles 0
failed 0
Collected articles
Pick a source and press Run crawl to fetch a live listing and collect its articles.