C

ContactMonkey

Internal communications platform with engagement analytics

Applied AI Engineer

AI Application Engineering +1Updated on Nov 10
Full-timeToronto, ON, Canada

About the Job

Requirements

  • A Bachelor's degree or higher in Computer Science, Statistics, Mathematics, or Engineering, or equivalent practical experience.
  • At least 3 years of professional software engineering experience, including hands-on work with AI/ML or LLM-powered features.
  • Strong full-stack experience, ideally with Ruby on Rails or another backend framework and Vue.js or React, and comfort working in a production SaaS codebase and unfamiliar systems.
  • Hands-on infrastructure-as-code experience; Terraform is preferred. Experience authoring modules, reviewing plans before applying them, and recovering from mismatched state is needed. Terragrunt, CloudFormation, or CDK experience transfers.
  • Working knowledge of AWS beyond the console, including IAM and least privilege, VPC and networking basics, secrets management, and deploying and observing containerized workloads. Kubernetes familiarity is a plus.
  • Experience taking LLM work beyond a prototype by iterating on prompts against real usage and making it work for customers.
  • Experience building evaluation beyond trial and error, measuring accuracy, safety, and latency, and distinguishing real benchmark improvements from noise.
  • Ability to structure reliable LLM calls using function calling and structured outputs, systematically test responses, and design for failure modes.
  • Ability to reason about AI-feature operating costs, including tokens, context size, retries, and caching, and treat cost as an engineering constraint.
  • Familiarity with RAG architectures and vector stores, and interest in multi-agent orchestration frameworks.
  • Excellent written and verbal communication, and comfort working independently and collaboratively in an agile team.

Responsibilities

  • Build agentic workflows and orchestration patterns, including dynamic routing, tool-using agents, and feedback loops; help design these systems and own implementation of well-scoped components.
  • Own evaluation harnesses for shipped features, including datasets, automated grading, and offline regression suites to measure whether changes improve results.
  • Turn production failures into evaluations that catch similar failures in the future and raise evaluation standards across the team.
  • Build infrastructure as code for AI features, including the deployment path for AI workloads on EKS, alongside SRE and platform engineers.
  • Track token spend, latency, and failure rates; design for hallucinations, timeouts, rate limits, and cost spikes so systems degrade gracefully; respond to unexpected production behavior.
  • Manage prompts as versioned, reviewable, and reversible artifacts, and own safe production rollout and rollback of prompt or model changes.
  • Ensure AI features respect regional deployments, keep customer data in-region, log model invocations, and verify that submitted model inputs are intended; address prompt injection and PII exposure risks.
  • Take defined problems forward and contribute to the quarterly AI roadmap; benchmark model value and iterate on prompts, retrieval, and model configurations using data.
  • Work with Product to turn ideas into technical work for customer-facing features and internal automation; participate in design discussions and code reviews, share learnings, and help the engineering culture evolve.

Desired Qualifications

  • Terraform experience is preferred.
  • Kubernetes familiarity is a plus.
  • Experience building agentic systems that reason across multiple steps and act on tool outputs, including side projects.
  • Experience building an evaluation harness that influenced a ship, hold, or rollback decision.
  • Experience operating AI in production through a cost spike, provider outage, model deprecation, or quality regression.
  • Experience with Amazon Bedrock or informed opinions about model routing and provider abstraction.
  • Experience in the email ecosystem or a similar high-scale communication platform.
  • Experience building with AI coding agents and an informed view of their strengths and limitations.

About the Company

ContactMonkey

Internal communications platform with engagement analytics

ContactMonkey provides tools to improve internal communications and employee engagement within organizations. Its core product is a drag-and-drop email builder for creating newsletters and surveys, plus analytics like open rates, click rates, and eNPS. It differentiates itself with a focus on internal communications analytics and a scalable subscription model for small to large teams. Its goal is to help organizations keep employees informed, connected, and motivated to drive a more productive workforce.

Company size
51-200
Company stage
Series A
Total funding
$55.8M
Headquarters
Toronto, Canada
Founded
2010

Recently Posted Jobs

Explore more opportunities at ContactMonkey

See more jobs