G

Guidepoint

Connects businesses with global expert advisors

Senior Data/AI Engineer

AI Application Engineering +1Confirmed live in the last 24 hours
Full-timeToronto, ON, Canada

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, or a related technical field with 6+ years of professional experience, or a master's degree with 4+ years of professional experience in backend software engineering and Generative AI.
  • A proven track record of designing, building, and scaling distributed, production-grade systems.
  • Deep expertise in Python, a major backend framework such as FastAPI or Flask, and asynchronous programming such as asyncio.
  • Proficiency in designing RESTful APIs, microservices, and the complete operational lifecycle, including comprehensive testing, CI/CD such as ArgoCD, observability, monitoring, alerting, maintaining high uptime, and executing zero-downtime deployments.
  • Hands-on experience deploying and managing applications on a major cloud platform (Azure preferred; AWS or GCP acceptable) using Docker and orchestration technologies such as Kubernetes and Helm.
  • At least 2 years of experience building applications that use large language models from providers such as OpenAI, Anthropic, or Google Gemini.
  • Direct experience with retrieval-augmented generation, hybrid search using vector databases such as Pinecone or Elasticsearch, multi-agent AI systems with tool calls, and prompt engineering.
  • Experience designing and implementing robust evaluation frameworks for LLM-based systems, including rubric-based scoring, LLM Judges, or MLflow, alongside monitoring for performance and drift.
  • Familiarity with large-scale data processing platforms and tools such as Databricks and Apache Spark.
  • Practical experience with libraries and frameworks such as LangChain or LlamaIndex for building LLM-powered applications.
  • Demonstrated ability to lead complex technical projects and foster the growth of other engineers.

Responsibilities

  • Design, build, and operate scalable, low-latency backend services and APIs for Generative AI features, including retrieval-augmented generation pipelines and complex agentic systems.
  • Own the end-to-end lifecycle of AI-powered applications, including system design, development, deployment, monitoring, and optimization in production environments such as Databricks and Azure Kubernetes Service.
  • Continuously improve retrieval and generation quality through retrieval optimization, including tuning k-values and chunk sizes, using re-rankers and advanced chunking strategies, and prompt engineering to reduce hallucinations.
  • Engineer solutions that combine large language models with proprietary knowledge repositories, external APIs, and real-time data streams to create copilots and research assistants.
  • Collaborate with data science and engineering teams to establish and implement LLMOps best practices, including automated evaluation using frameworks such as LLM Judges or MLflow, AI observability, and system monitoring.
  • Evaluate and apply advanced prompt engineering methods such as Chain-of-Thought and ReAct, and other model interaction techniques, to optimize the performance and safety of proprietary and open-source large language models.
  • Provide technical leadership to junior engineers through code reviews, mentorship, and design discussions, helping elevate the team's engineering standards.
  • Partner with product and business stakeholders to translate user needs into technical requirements, define priorities, and shape future AI product offerings.

About the Company

Guidepoint

Connects businesses with global expert advisors

Guidepoint connects businesses with a global pool of experts to deliver on-demand research and advisory services. It maintains a network of over 1.5 million specialists across more than 150 industries and offers tailored research solutions, including one-on-one consultations, surveys, and in-person engagements. Clients access customized insights through a managed process, while Guidepoint handles logistics and matching. Its products work by aligning client needs with relevant experts, delivering fast, accurate information, and charging fees via subscriptions, pay-per-use, or project-based pricing. What sets Guidepoint apart is the sheer size and diversity of its expert network, global reach, and end-to-end service that covers sourcing, scheduling, and delivery of insights. The company’s goal is to help institutional investors, corporations, and legal firms make smarter investment and business decisions by providing timely market intelligence and vetted research.

Company size
1,001-5,000
Company stage
Not listed
Total funding
Not listed
Headquarters
New York City, New York
Founded
2003

Recently Posted Jobs

Explore more opportunities at Guidepoint

See more jobs