Index the Crawled Web
Hard About 50 min Katabench Pro
Derive a replayable search index from the canonical corpus while keeping query traffic completely off the crawl pipeline.
The full brief is part of Katabench Pro
Pro opens this kata's brief and its grader. To see how the track works first, try Handle Celebrity Fan-out, which is free with an account.
How it is graded
You build the design on a canvas, and Katabench checks the topology against the challenge's design rules.
What it practices
- Search indexing
- Derive a search index asynchronously from the system of record.
Do these first
Related katas
- Moderate and Index Posts Hard Pro Search indexes unreviewed content from an API dual write. Derive moderation and search asynchronously from committed posts.
- Build Video Search Medium Pro Build a searchable video catalog as an asynchronous projection of authoritative metadata.
- Handle Celebrity Fan-out Hard Free with account One celebrity post creates millions of writes. Combine pushed timelines for ordinary authors with a pulled celebrity index at read time.
- Cache the Hot Path Medium Free with account The product page hammers the database directly and melts under load. Design a read path with a load balancer, a cache and a replica, while keeping the client off the database.