Full-Time

Senior AI Software Engineer

Bishop Fox

Bishop Fox

201-500 employees

Offensive cybersecurity services and risk management

No salary listed

Oakland, CA, USA

Hybrid

Remote-first with occasional ad-hoc in-office meetings; must be based in the San Francisco Bay Area.

Category
Software Engineering (1)
Required Skills
LLM
Kubernetes
Microsoft Azure
Python
React.js
Docker
TypeScript
AWS
Go
REST APIs
LangChain
penetration testing
DevOps
Google Cloud Platform
Requirements
  • 5+ years of software engineering experience with a track record of shipping production systems
  • Deep AI/ML expertise with hands-on experience using large language models and agent frameworks (such as LangChain, AutoGPT, CrewAI) or autonomous AI systems
  • Advanced programming skills in Python and Golang with clean, scalable code practices
  • Full-stack capabilities including building robust APIs, designing database schemas, and working with modern frontend frameworks (React/TypeScript experience valued)
  • Practical experience designing, evaluating, and improving agent reliability, including handling failures, edge cases, and non-deterministic behavior
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes)
  • Understanding of CI/CD pipelines and DevOps practices for reliable deployments
  • Ability to architect systems that can scale from prototype to enterprise-grade solutions
  • Must be based in the San Francisco Bay Area; remote-first with occasional in-office meetings only when necessary.
Responsibilities
  • Design and build intelligent autonomous security testing agents using large language models and cutting-edge AI/ML techniques
  • Create systems that can autonomously perform reconnaissance, identify vulnerabilities, and execute sophisticated attack chains
  • Push the boundaries of what's possible when artificial intelligence meets offensive security
  • Build robust planning, tool-use, and failure-handling mechanisms for agents operating in real-world, unpredictable applications
  • Develop services that think and act like elite attackers, but operate 24/7 across thousands of targets
  • Transform manual testing processes into intelligent, scalable automation pipelines
  • Build systems that continuously evolve and improve their attack strategies
  • Implement long-running agent memory and context management so agents retain state, avoid redundant actions, and accumulate application knowledge
  • Connect your AI agents into Bishop Fox's Cosmos cloud platform
  • Scale your creations to serve Fortune 100 clients with enterprise-level reliability
  • Design architectures that can handle massive concurrent testing operations
  • Develop browser and application interaction infrastructure that enables agents to navigate, interact with, and test modern web applications
  • Prototype breakthrough approaches to AI-driven security testing
  • Build sophisticated feedback loops that make your agents smarter over time
  • Implement safety mechanisms and ethical guardrails for responsible AI deployment
  • Measure, iterate, and continuously enhance agent performance
  • Design evaluation and monitoring systems that distinguish real vulnerabilities from false positives or hallucinated findings
  • Work directly with world-class penetration testers and security researchers
  • Partner with data scientists and AI specialists to solve novel technical challenges
  • Contribute to a team culture where hacking expertise meets cutting-edge artificial intelligence
  • Apply real-world production feedback from customer environments to refine agent behavior and system reliability
Desired Qualifications
  • Experience in penetration testing, red teaming, ethical hacking, or security research
  • Understanding of common vulnerabilities, attack vectors, and security frameworks
  • Knowledge of security tools and methodologies (but we'll teach you what you don't know!)
  • Open-source contributions, especially in AI/automation or security domains
  • Hackathon victories or compelling side projects that demonstrate your creativity
  • Experience in startup environments or greenfield product development
  • Publications, talks, or thought leadership in AI or security communities
  • Familiarity with multi-agent systems, reinforcement learning, or swarm intelligence
  • Experience with vector databases, RAG pipelines, or advanced prompt engineering
  • Understanding of AI safety, alignment, and responsible AI development practices

Bishop Fox focuses on offensive cybersecurity, testing clients’ networks and applications against real-world attack techniques to find and fix vulnerabilities before attackers exploit them. Its flagship Cosmos blends automated scanning with expert testing to continuously identify and remediate high-risk exposures on dynamic attack surfaces. Unlike many firms that rely on point-in-time tests, Bishop Fox emphasizes hands-on, real-world attack simulations and ongoing remediation across a broad set of services. The goal is to help organizations continuously reduce risk by exposing and closing security gaps before they can be exploited.

Company Size

201-500

Company Stage

Series B

Total Funding

$154M

Headquarters

Phoenix, Arizona

Founded

2005

Simplify Jobs

Simplify's Take

What believers are saying

  • Revenue hit $73.5 million in 2025 from rising offensive security demand.
  • $129 million Series B funding in 2022 fuels expansion into Europe and AI tools.
  • Launched AIMap on May 1, 2026, capturing AI infrastructure security market.

What critics are saying

  • Google's Mandiant acquisition bundles offensive security, eroding Cosmos market share by 2027.
  • Bishop Fox's open-source AIMap enables competitors to replicate AI scanning immediately.
  • No funding since 2022 exhausts cash on 2026 executive hires, risking shutdown by 2028.

What makes Bishop Fox unique

  • Bishop Fox leads with Cosmos platform for continuous threat exposure management.
  • Largest private offensive security firm simulates real-world attacks on AI and cloud.
  • Designed Fortune 100 third-party security program testing over 1,000 partners since 2019.

Help us improve and share your feedback! Did you find this helpful?

Your Connections

People at Bishop Fox who can refer or advise you

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Plan

401(k) Company Match

Paid Vacation

Paid Holidays

Remote Work Options

Flexible Work Hours

Family Planning Benefits

Fertility Treatment Support

Parental Leave

Wellness Program

Gym Membership

Phone/Internet Stipend

Growth & Insights and Company News

Headcount

6 month growth

1%

1 year growth

2%

2 year growth

1%
The Manila Times
Feb 11th, 2025
Bishop Fox appoints Christopher Martin as Chief Operating Officer

Bishop Fox also expanded its European presence, and added former @Stake and Neohapsis CEO, James Mobley to its Advisory Board.

HIT Consultant
Aug 29th, 2024
Penalizing Hospitals Won’T Stop Ransomware: Why Collaboration, Not Fines, Is Key To Healthcare Cybersecurity

Chris Bowen, Founder and CISO, ClearDATAThe recent $50 million initiative announced by the Advanced Research Projects Agency for Health (ARPA-H) can’t hurt in the ongoing battle against ransomware in the healthcare sector. This investment is aimed at strengthening the cybersecurity defenses of hospitals nationwide, protecting sensitive patient data, and enhancing the resilience of healthcare systems against cyber threats. However, I must emphasize that while $50 million is a step in the right direction, it is merely a drop in the bucket given the scale of the problem. For years, the healthcare sector has been a prime target for cybercriminals, with ransomware attacks becoming alarmingly frequent and increasingly destructive. Major organizations like Change Healthcare and Ascension have faced significant disruptions due to these breaches. The 2023 Ponemon Institute report indicates that 45% of healthcare organizations experienced a ransomware attack, with 67% of those incidents causing significant disruptions to patient care. These attacks not only compromise patient data but also jeopardize the delivery of essential healthcare services, potentially endangering lives. The introduction of ARPA-H’s Universal PatchinG and Remediation for Autonomous DEfense (UPGRADE) program is a timely and necessary intervention. A Proactive Approach to Cybersecurity The UPGRADE program aims to develop a comprehensive and scalable software suite to enhance the cybersecurity posture of hospitals. By reducing the patching time for vulnerable healthcare products from months to mere days, UPGRADE seeks a transformative shift in how hospitals can defend against cyber threats. The initiative focuses on four key areas:  creating a vulnerability mitigation platform developing high-fidelity digital twins of hospital equipment rapidly detecting software vulnerabilities developing defenses for each identified vulnerability These technical goals represent a proactive approach to cybersecurity, moving away from the reactive measures that have characterized the healthcare sector’s responses in the past. For instance, developing digital twins will allow hospitals to simulate and test the impact of patches and updates in a controlled environment, thereby reducing the risk of unintended consequences that could disrupt patient care and providing hospital staff and patients with much-needed confidence and peace of mind. Penalties Are Counterproductive Despite the strategic direction of the UPGRADE program, it is crucial to reconsider how regulatory bodies like the Office for Civil Rights (OCR) approach cybersecurity in healthcare

SecurityBrief Asia
Mar 4th, 2024
Bishop Fox launches comprehensive service for business application security

Bishop Fox launches comprehensive service for business application security.

Bishop Fox
Oct 24th, 2023
Cosmos: Unleashing the Power of Perimeter Protection

To add real-world context behind attackers' actions, Bishop Fox launched the groundbreaking 2022 SANS Survey Report: Inside the Minds & Methods of Modern Adversaries, where Bishop Fox delved deep into the minds and tactics of modern adversaries.

Phoenix New Times
Jul 18th, 2023
Bishop Fox appoints Patrick Davis as CFO

Bishop Fox appoints Patrick Davis as CFO.