B

Blue Cross Blue Shield of Massachusetts

Associate Director - AI Solution Architecture

AI Application EngineeringUpdated on Nov 15
Full-timeBoston, MA, USA

About the Job

Requirements

  • A Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or a related technical field, or equivalent practical experience.
  • At least 8 years of experience in software engineering or solution architecture, including at least 3 years designing large-scale AI/ML or large language model-based agentic solutions.
  • At least 3 years of experience directly managing and leading teams of technical architects or systems designers.
  • Hands-on architectural experience with Google Cloud Platform services, including Vertex AI Agent Builder, Vertex AI Search, BigQuery, Cloud Storage, and Cloud Run.
  • Expertise designing solution architectures that leverage large language models, including retrieval-augmented generation, embeddings, complex function calling, and multi-agent frameworks.
  • Strong command of application programming interface design, microservices, cloud-native development patterns, and integrating AI capabilities into existing enterprise product ecosystems.
  • Knowledge of MLOps practices, including designing frameworks to measure and monitor large language model quality, latency, and cost in production.
  • Ability to translate ambiguous business problems into structured technical architectures and present them clearly to diverse audiences.

Responsibilities

  • Lead, mentor, and manage a high-performing team of AI solution architects, providing technical guidance, architectural oversight, and career development.
  • Partner with the AI Engineering team to conduct business-needs assessments and identify high-impact agentic use cases.
  • Translate complex business requirements into robust, scalable technical blueprints that enable production-grade engineering delivery.
  • Oversee the architectural design of AI assistants and establish enterprise best practices for model selection, prompt orchestration, retrieval-augmented generation, and agent orchestration.
  • Guide the design of intelligent, multi-step AI agents, defining patterns for sequential, loop, parallel, and hierarchical architectures for multi-turn, multi-domain use cases.
  • Architect secure, scalable tool-use and function-calling patterns so AI agents connect with enterprise application programming interfaces, databases, and third-party systems.
  • Partner with AI Governance to embed ethical considerations, fairness, transparency, hallucination mitigation, and data privacy into AI solutions.
  • Design highly available, production-grade solutions and collaborate with engineering leads to ensure architectural concepts translate into reliable, high-performance deployments.
  • Serve as the primary architectural liaison and explain the value, mechanics, and design of agentic AI solutions to non-technical business leaders and executive stakeholders.

Desired Qualifications

  • Google Cloud Professional Cloud Architect or Professional Machine Learning Engineer certification.
  • Experience designing architectures for autonomous tool-use patterns and frameworks such as Google ADK, LangChain, or LlamaIndex.
  • Experience integrating and scaling enterprise vector databases, such as Vertex AI Vector Search, AlloyDB, or Pinecone, for high-performance, embedding-based retrieval.
  • Experience in healthcare, insurance, or finance, with a strong understanding of data privacy frameworks such as HIPAA and compliance requirements in solution design.

About the Company

Company size
1,001-5,000
Company stage
Not listed
Total funding
$199.6M
Headquarters
Boston, MA
Founded
1937

Recently Posted Jobs

Explore more opportunities at Blue Cross Blue Shield of Massachusetts

See more jobs