G

Gong.io

AI-powered revenue operations and forecasting

Software Architect - AI Applications

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeTel Aviv-Yafo, IsraelNo salary listed

About the Job

Requirements

  • At least 10 years of backend development experience, with strong expertise in Java and modern frameworks such as Spring Boot.
  • Proven Staff- or Principal-level impact across multiple teams, with the ability to lead through influence rather than authority.
  • Hands-on experience shipping production large language model applications, such as agents, tool calling, retrieval-augmented generation, or structured generation, and an understanding of their failure modes.
  • Deep expertise in designing large-scale distributed systems, including asynchronous, event-driven, and streaming architectures.
  • Ability to dive into unfamiliar codebases, switch context across teams, and identify high-impact opportunities.
  • Ability to communicate complex ideas clearly to diverse stakeholders.
  • Track record of driving adoption of AI-assisted development.

Responsibilities

  • Define the Revenue Harness reference architecture and contracts between agents, tools, context, and models, providing a shared, scalable foundation for teams.
  • Embed with teams across domains and contribute directly to design and code.
  • Establish evaluation methodology, regression gates, and production monitoring for non-deterministic systems.
  • Raise design quality and engineering best practices across the group through mentorship.
  • Drive adoption of coding agents, AI code review, and agentic workflows to improve velocity and quality.
  • Design agent orchestration, planning and reasoning loops, multi-step execution, and multi-agent coordination for long-running revenue workflows.
  • Build a secure, extensible tool ecosystem, including tools and connectors based on the Model Context Protocol, enabling agents to read and act on company data, customer relationship management systems, email, and calendars.
  • Build retrieval pipelines across calls, emails, deals, and accounts using retrieval-augmented generation, hybrid search, knowledge graphs, and short- and long-term memory.
  • Establish offline and online evaluation of accuracy, groundedness, and task success, with guardrails, permissions, and human-in-the-loop controls.
  • Develop multi-provider model routing, streaming, large language model observability, and cost and latency management.
  • Build high-concurrency infrastructure for stateful and stateless agents, including lifecycle management, isolated workers, task queues, and distributed state persistence.
  • Deploy cloud-native Kubernetes services with multi-region rollout, zero-downtime updates, canary releases for non-deterministic workflows, and strict tenant sandboxing.
  • Improve reliability of large language model behavior through structured outputs, tool-call validation, fallbacks, and defined failure modes.
  • Improve context retrieval across millions of conversations, deals, and accounts.
  • Enforce data boundaries, user permissions, and tenant isolation, and defend against prompt injection and unintended actions.
  • Balance quality, cost, and latency through model selection, caching, and routing.
  • Clarify cross-team problems, surface blind spots, and guide teams toward aligned, reusable patterns.
  • Identify architectural gaps early and make pragmatic trade-offs so systems can evolve with changing models and tools.
  • Help sales professionals shift time from busywork to selling.
  • Reduce duplication and accelerate delivery while maintaining long-term platform health.

Desired Qualifications

  • Experience with agent frameworks and protocols such as the Model Context Protocol, Spring AI, LangChain, or LangGraph, or with building an in-house equivalent.
  • Experience with large language model evaluation, including large-language-model-as-judge approaches, golden datasets, online monitoring, observability, and multi-provider routing.
  • Experience with vector databases, search infrastructure such as Elasticsearch or OpenSearch, or knowledge graphs.
  • Familiarity with artificial intelligence security concerns, including prompt injection, data leakage, and agent permission models.
  • Working knowledge of Python alongside a Java Virtual Machine stack.
  • Background in business-to-business software as a service, customer relationship management, or revenue technology.

About the Company

Gong.io

AI-powered revenue operations and forecasting

Gong builds AI software that captures and analyzes customer interactions to inform decisions and automate revenue workflows across sales engagement, revenue forecasting, and sales enablement. It records conversations across calls, emails, and chats, uses AI to extract insights, forecast revenue, and guide sales activity, and uses AI agents to automatically follow up and update the pipeline. It serves revenue teams from sales reps to executives and charges per-user licenses with a platform fee based on the number of users supported. Its goal is to help revenue teams close more deals by turning customer conversations into actionable insights and automated actions.

Company size
1,001-5,000
Company stage
Series E
Total funding
$586M
Headquarters
San Francisco, CA
Founded
2015

Recently Posted Jobs

Explore more opportunities at Gong.io

See more jobs