Nebius in London is seeking a Staff Software Engineer to build the content acquisition and crawling infrastructure for a world-scale search platform designed for agentic AI. You will design distributed crawling, scheduling, and ingestion systems capable of handling billions of URLs and terabytes of data.
Collaborate with indexing and ML teams, improve observability, optimize resource use, and drive safe experimentation with crawling strategies.
#J-18808-Ljbffr
We would love to welcome a new Staff Software Engineer, Web-Scale Crawling & Ingestion to our group in Greater London, England, United Kingdom.
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
Learn more about the Staff Software Engineer, Web-Scale Crawling & Ingestion role in the description above.
We appreciate your interest in this position.