O

Olly Olly

Digital marketing platform for small businesses

Staff Software Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listedRemote

About the Job

Requirements

  • At least 7 years of experience building production software.
  • Have taken a product or major feature from concept to launch, then owned it after launch as a live, measured, used product; startup, founder, or lead experience is ideal.
  • Be able to learn new programming languages, frameworks, and domains as needed.
  • Have shipped a production feature built on large language model output and owned its failures, including hallucinations, poor output, and cost, beyond API integration.
  • Have deep experience with TypeScript and SQL/PostgreSQL building production software used by many people.
  • Use AI coding agents such as Claude Code or Cursor daily in production work and own the quality of their output.
  • Raise the team's quality through code review, written standards, and mentoring.
  • Raise risks early and present options.

Responsibilities

  • Partner with the Engineering Manager and Product team to define project scope and scale.
  • Own the architecture of the AI content pipeline, including model context, task decomposition, model selection at each step, and balancing quality, cost, and latency.
  • Build automated quality checks for AI-generated content to catch hallucinations before human review, using evaluation sets built from real data to measure the impact of prompt changes.
  • Develop, design, and maintain scalable web applications, mobile applications, and RESTful APIs.
  • Write clean, efficient, well-documented code while maintaining code quality and security.
  • Collaborate with cross-functional teams to design, develop, and deploy applications.
  • Troubleshoot and debug applications.
  • Identify bottlenecks and continually improve software efficiency.
  • Stay current with emerging trends and technologies in software development.

Desired Qualifications

  • Experience with Supabase, including PostgreSQL and Deno Edge Functions.
  • Experience with Google Cloud Functions and Pub/Sub.
  • Experience with Flutter and Dart.
  • Experience evaluating large language model output with rubrics or LLM-as-judge graders.
  • Experience with multi-step large language model generation using critic or validation passes.
  • Experience with retrieval or fact-checking pipelines.
  • Experience generating local search engine optimization or marketing copy.

About the Company

Olly Olly

Digital marketing platform for small businesses

Olly Olly helps small businesses handle digital marketing without the constant back-and-forth of trying to do it all themselves. The company focuses on simplifying and coordinating online marketing efforts so business owners don’t have to chase trends or pop between channels. Its offerings are designed to be a practical support system that handles strategy and execution in one place, freeing owners to focus on running their business. Unlike DIY-heavy marketing approaches or fragmented agency services, Olly Olly aims to provide a clear, manageable path for maintaining an online presence. The goal is to reduce the burden of online marketing for small businesses and help them grow with steadier, more efficient online activity.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Boston, MA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Olly Olly

See more jobs