C

Cohere

Builds language models and workplace AI tools

Senior/Staff Software Engineer - Developer Experience

Test Automation EngineeringPosted on Nov 13
Full-timeNo salary listed

About the Job

Requirements

  • At least 5 years of software engineering experience focused on automation and testing infrastructure.
  • Expert proficiency in Python and TypeScript.
  • Extensive experience with GitHub workflows and actions.
  • Deep understanding of testing methodologies and best practices.
  • Experience building and maintaining continuous integration and continuous deployment (CI/CD) pipelines.
  • Experience with containerization using Docker and Kubernetes.
  • Experience with benchmarking and performance testing methodologies.
  • Experience with a cloud platform such as AWS, GCP, or Azure.
  • Background in developer tools or platform engineering.
  • Ability to design and implement complex automation systems.

Responsibilities

  • Design and implement automation pipelines that support comprehensive testing across multiple environments with varying feature flags and realistic customer data profiles.
  • Create intelligent testing agents that simulate real user behavior to validate different configuration combinations.
  • Develop and maintain GitHub workflows and actions to automate testing, deployment, and validation processes.
  • Manage and optimize Helm charts for deployment consistency across environments.
  • Implement and maintain ArgoCD workflows for continuous deployment and environment management.
  • Establish best practices for testing methodologies and ensure adoption across engineering teams.
  • Build scalable infrastructure that supports parallel test execution across diverse configurations.
  • Develop infrastructure-as-code templates and configurations for reproducible test environments.
  • Implement containerization strategies for test environments and dependencies.
  • Create benchmarking frameworks to measure performance and reliability across different configurations.
  • Monitor and improve test coverage and reliability metrics.
  • Collaborate with product and engineering teams to understand testing requirements and translate them into automated solutions.
  • Troubleshoot and resolve complex testing infrastructure issues.
  • Enhance the testing platform to let engineers spin up environments with specific feature-flag combinations using infrastructure-as-code.
  • Enable engineers to load test configurations with realistic customer data volumes in containerized environments.
  • Enable engineers to run comprehensive test suites across multiple environment configurations with automated benchmarking.
  • Generate detailed performance and reliability reports across different cloud environments.
  • Automatically detect and flag regressions in diverse usage scenarios.
  • Scale testing infrastructure to accommodate a growing customer base.

Desired Qualifications

  • Experience working with large language models (LLMs) in production environments.
  • Familiarity with infrastructure-as-code principles.
  • Experience with container orchestration and management.
  • Knowledge of performance testing tools and frameworks.
  • Experience with monitoring and observability tools.
  • Background in test framework development.
  • Strong working knowledge of Helm charts and ArgoCD.
  • Infrastructure-as-code experience with Terraform, Pulumi, or similar tools.

About the Company

Cohere

Builds language models and workplace AI tools

Cohere develops language models and AI software for businesses that need to search documents, generate text and automate work. Its customers include large organizations and developers building AI features into their own applications, with tools that connect company information to employee workflows. The North platform brings assistants and task automation into a shared workspace, while its models handle text generation and retrieval through software interfaces. Cohere earns revenue from paid model usage, dedicated deployment capacity and enterprise software agreements tailored to customer needs. The company was founded in 2019 and has its headquarters in Toronto, Ontario.

Company size
501-1,000
Company stage
Series E
Total funding
$2.1B
Headquarters
Toronto, Canada
Founded
2019

Recently Posted Jobs

Explore more opportunities at Cohere

See more jobs