F

Firecrawl

Web-data platform for AI agents

Web Automation Engineer

Backend EngineeringUpdated on Nov 11
Full-time

About the Job

Requirements

  • Strong JavaScript, TypeScript, and/or Python skills, with the ability to learn additional languages as needed.
  • A practical understanding of browser rendering, JavaScript engines, headless browser automation, the Chrome DevTools Protocol, Playwright, and Puppeteer.
  • A solid grasp of HTTP, TLS, proxies, and browser and device fingerprinting.
  • Ability to read minified and obfuscated code and determine what it checks.
  • Ability to investigate how systems work and ship resulting fixes to production.
  • At least 3 years of experience building browser automation, web infrastructure, or systems-level software.

Responsibilities

  • Research how modern websites detect and challenge automated traffic, and analyze their detection mechanisms and challenge flows.
  • Identify browser, device, network, and behavioral signals that distinguish automated access from human traffic.
  • Reproduce those signals synthetically in authorized test environments to validate and harden approaches.
  • Build automation, diagnostic, and monitoring tools to maintain scrape reliability as the web changes.
  • Measure scrape success rates, explain regressions, and ship fixes.
  • Work with platform engineers to roll improvements out across the crawling fleet at scale.

Desired Qualifications

  • Experience deobfuscating JavaScript and VM-based obfuscation.
  • Experience with network-level fingerprinting, including TLS/HTTP2 signatures and JA3/JA4.
  • Experience running large browser or proxy fleets in production.
  • Prior work at a scraping, web data, security research, or automation company.

About the Company

Firecrawl

Web-data platform for AI agents

Firecrawl provides a context API for AI agents to search, crawl, scrape, and retrieve clean content from the live web and structured indexes at scale. Its platform handles crawling, rendering, parsing, and cleanup so teams don’t need to build their own extraction pipelines. The Alexandria layer unifies official data providers, custom connectors, and Firecrawl indexes with the live web, enabling agents to discover sources and pull knowledge, including paid access like Wikimedia Enterprise. The service supports scale to millions of users and funds deeper indexes, search capabilities, and knowledge-contributor payouts.

Company size
51-200
Company stage
Late Stage VC
Total funding
$89.5M
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Firecrawl

See more jobs