G

Gramian Consulting Group

Cybersecurity Engineer – AI Benchmarking Lead

Offensive Security & TestingPosted on Nov 18
Full-timeRemote in BrazilNo salary listed

About the Job

Requirements

  • At least 6 years of professional software engineering experience.
  • Expert-level proficiency in at least one of Python, JavaScript, TypeScript, Java, C, C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
  • Strong understanding of software security concepts, including CWE, CVE, and the OWASP Top 10.
  • Ability to reproduce software vulnerabilities and develop proof-of-vulnerability tests.
  • Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep.
  • Strong proficiency with Git, Linux, Bash, and Docker.
  • Strong technical judgment when evaluating verifier robustness, security patches, and AI-generated code.
  • Experience reviewing technical work and maintaining consistent quality standards across multiple contributors.
  • Some experience mentoring engineers, trainers, or technical contributors.
  • Excellent technical writing and documentation skills.
  • Ability to work independently in a fully remote, research-oriented environment.
  • A proven track record working on this project or equivalent software security dataset, benchmark development, or security evaluation work.

Responsibilities

  • Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets.
  • Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule.
  • Lead weekly client reporting, communicate delivery status, and proactively escalate risks involving tooling issues, rate limits, safety blocks, and resource constraints.
  • Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes.
  • Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards.
  • Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria.
  • Use throughput and quality data to forecast staffing needs across project phases.
  • Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.
  • Research vulnerabilities, reproduce security issues, develop proof-of-vulnerability tests, and create or review benchmark tasks during periods of high workload.
  • Maintain documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Gramian Consulting Group

See more jobs