Principal Solution Architect

Overview

Who we are

To save time applying, Toyota does not offer sponsorship of job applicants for employment-based visas or any other work authorization for this position at this time.

Who we’re looking for

Toyota Financial Services is seeking a Principal Solution Architect - AI Infrastructure to design the systems and platforms that enable enterprise-scale MLOps and LLMOps. This is a senior-level individual contributor role within the Architecture organization, focused on building the foundational infrastructure for deploying, managing, and scaling AI and GenAI workloads in production.

You’ll work across cloud infrastructure, platform engineering, data, and cybersecurity teams to architect robust, secure, and performant environments that power model training, inference, orchestration, and retrieval-augmented generation (RAG) systems.

This role is ideal for architects who deeply understand infrastructure, cloud-native systems, and the unique demands of production-scale AI workloads.

What you’ll be doing

• Architect and evolve cloud-native infrastructure to support AI/ML and LLM workloads in production
• Build platform capabilities for MLOps and LLMOps—including model training, versioning, deployment, monitoring, and rollback
• Enable GPU-accelerated compute environments optimized for model performance, scalability, and cost-efficiency
• Integrate and standardize infrastructure for vector databases, model registries, and orchestration frameworks
• Establish reusable patterns for model serving, inference scaling, prompt management, and latency optimization
• Design secure, multi-tenant environments that enforce access controls, auditability, and usage limits for AI models
• Partner with engineering, platform, and data teams to ensure seamless data flow, observability, and operational resiliency
• Contribute architecture documentation, governance models, and standards to support AI infrastructure delivery across teams
• Stay informed on emerging technologies in GenAI, distributed systems, and infrastructure trends

What you bring

• 10+ years of experience in infrastructure or cloud architecture roles
• 3+ years building infrastructure to support AI/ML workloads (training, tuning, inference)
• Deep expertise with AWS and infrastructure-as-code tools (Terraform, CDK, CloudFormation)
• Hands-on experience with Kubernetes (EKS or equivalent), containerization, and CI/CD pipelines
• Strong knowledge of GPU infrastructure, serverless compute, and scalable microservice patterns
• Familiarity with model hosting, inference scaling, and observability (Datadog, CloudWatch, Prometheus)
• Strong communication and documentation skills to align technical design across domains

Added bonus if you have

• Experience with LLMOps tooling and GenAI infrastructure (e.g., LangChain, RAG pipelines, embedding stores)
• Worked with vector databases (e.g., Pinecone, FAISS, Weaviate), model registries, and orchestration tools (e.g., MLflow, Airflow, Ray)
• Knowledge of prompt management, token usage optimization, and model performance tuning
• Familiarity with AWS AI/ML services (SageMaker, Bedrock, Kendra, Titan)
• AWS Solutions Architect Professional or Machine Learning certification
• Experience operating in regulated environments (e.g., financial services, healthcare)

What we’ll bring
 
During your interview process, our team can fill you in on all the details of our industry-leading benefits and career development opportunities. A few highlights include:

• A work environment built on teamwork, flexibility, and respect
• Professional growth and development programs to help advance your career, as well as tuition reimbursement
• Team Member Vehicle Purchase Discount
• Toyota Team Member Lease Vehicle Program (if applicable)
• Comprehensive health care and wellness plans for your entire family
• Toyota 401(k) Savings Plan featuring a company match, as well as an annual retirement contribution from Toyota regardless of whether you contribute
• Paid holidays and paid time off
• Referral services related to prenatal services, adoption, childcare, schools and more
• Tax Advantaged Accounts (Health Savings Account, Health Care FSA, Dependent Care FSA)
• Relocation assistance (if applicable)

#LI-DNI

Belonging at Toyota

Our success begins and ends with our people. We embrace all perspectives and value unique human experiences. Respect for all is our North Star. Toyota is proud to have 10+ different Business Partnering Groups across 100 different North American chapter locations that support team members’ efforts to dream, do and grow without questioning that they belong.

Applicants for our positions are considered without regard to race, ethnicity, national origin, sex, sexual orientation, gender identity or expression, age, disability, religion, military or veteran status, or any other characteristics protected by law.

Have a question, need assistance with your application or do you require any special accommodations? Please send an email to [email protected].