B

Blue Cross Blue Shield of Massachusetts

AI Engineer

AI Application EngineeringUpdated on Nov 15
Full-timeIn-person

About the Job

Requirements

  • A Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent practical experience.
  • At least 5 years of software engineering experience, including at least 2 years focused on AI/ML or LLM-based agentic development.
  • Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Storage, Cloud Run, or Cloud Functions.
  • Hands-on experience with Vertex AI Agent Builder, Vertex AI Search, or Dialogflow CX.
  • Experience with Google Cloud SDKs, including Vertex AI SDK and Google Gen AI SDK, for model invocation, tuning, and deployment workflows.
  • Strong proficiency in Python and familiarity with machine learning and artificial intelligence frameworks and libraries such as LangChain, LlamaIndex, TensorFlow, or PyTorch.
  • Experience building agentic applications that leverage large language models, including prompt engineering, function calling, embeddings, and retrieval-augmented generation.
  • Understanding of API design, microservices architecture, and cloud-native development patterns.
  • Familiarity with version control using Git, CI/CD pipelines, and infrastructure as code such as Terraform or Cloud Build.

Responsibilities

  • Design and develop AI assistants using Vertex AI, including model selection, prompt engineering, grounding, retrieval-augmented generation, and agent orchestration.
  • Build multi-step AI agents using the Google Agent Development Kit, including agent architectures with tool use, sub-agents, callbacks, and session management for complex conversational workflows.
  • Develop and integrate applications using Google Cloud AI/ML SDKs, including the Vertex AI SDK for Python and Google Gen AI SDK, to access foundation models, embeddings, tuning, and prediction endpoints.
  • Design agentic architectures using Agent Development Kit orchestration capabilities, including sequential agents, loop agents, parallel agents, and custom agent hierarchies for multi-turn, multi-domain use cases.
  • Implement tool and function calling patterns within Agent Development Kit agents, connecting them to enterprise APIs, databases, and external services to enable grounded, domain-specific responses.
  • Implement responsible AI practices, including safety filters, bias detection, guardrails, hallucination mitigation, and content moderation.
  • Architect scalable, production-grade solutions using Vertex AI Agent Builder, Vertex AI Search, Cloud Run, Cloud Functions, Pub/Sub, BigQuery, and other Google Cloud Platform services.
  • Develop evaluation and monitoring frameworks to measure assistant quality, latency, cost, and user satisfaction in production, including the Agent Development Kit's built-in evaluation and tracing capabilities.
  • Collaborate with product managers, data engineers, and business stakeholders to translate requirements into AI-powered solutions.
  • Stay current with the evolving AI landscape, evaluate emerging models, tools, and techniques, and recommend adoption where appropriate.

Desired Qualifications

  • Google Cloud certifications, such as Professional Machine Learning Engineer or Professional Cloud Architect.
  • Exposure to multi-agent architectures, tool-use patterns, and agentic AI frameworks.
  • Experience with vector databases, such as Vertex AI Vector Search, AlloyDB, Pinecone, or Weaviate, and embedding-based retrieval.
  • Knowledge of MLOps practices, including experiment tracking, model versioning, A/B testing, and production monitoring.
  • Experience working in regulated industries such as healthcare, finance, or insurance, with an understanding of data privacy and compliance requirements.

About the Company

Company size
1,001-5,000
Company stage
Not listed
Total funding
$199.6M
Headquarters
Boston, MA
Founded
1937

Recently Posted Jobs

Explore more opportunities at Blue Cross Blue Shield of Massachusetts

See more jobs