Member of Technical Staff (Search Crawler Analyst)
Belgrade · London · Berlin · 4+ years experience · Full-time · Hybrid · Posted Oct 8, 2026
At a glance
- Experience
- 4+ years experience
- Employment
- Full-time
- Workplace
- Hybrid
- Location
- Belgrade · London · Berlin
About the role
- Work at the intersection of data analysis and engineering within Perplexity's complex crawling and storage system.
- Design metrics, build data pipelines, and improve the quality of search and answer systems across URL discovery, crawling, parsing, and indexing.
Responsibilities
- Find and diagnose quality issues in our crawling pipeline
- Train small models that optimize particular aspects of the pipeline (e.g. parsing quality)
- Build datasets for model training, including LLM-as-a-judge labeling pipelines
- Improve page selection algorithms for indexing
- Design and analyze experiments to validate improvements
Requirements
- 4+ years of experience as a data analyst, ML engineer, or in a related role
- Strong coding skills: you should be able to write production-grade code at the level of a mid-level backend engineer
- Experience designing metrics from scratch
- Experience training ML models that shipped to production with measurable metric improvements
Preferred qualifications
- Direct experience working on web crawling or indexing pipelines
