Backend Infrastructure Engineer, Anti-Bot
Description
About the Role
Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.
What You'll Do
Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.
Improve extraction success rates against websites with active anti-bot and anti-scraping defenses.
Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.
Monitor the health and cost efficiency of the proxy layer.
Diagnose intermittent failures across the stack and deliver lasting fixes.
Own production systems end to end, including reliability and on-call responsibilities.
What We're Looking For
More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction.
Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics.
Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.
Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.
Compensation & Benefits
Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.
Location
Hybrid, San Francisco, California, United States.
Skills
As published by ashby · 2 questions
Basics
Name, Email, Resume
Short answers (1)
- LinkedIn Profile URL optional
Pick from a list (1)
- Do you have work authorization for the country this role is based in? optional