Full-Time

Director of AI Platforms

Texas Institute for Electronics

Updated on 8/23/2026

University of Texas at Austin

University of Texas at Austin

Public research university in Austin, TX

No salary listed

Company Does Not Provide H1B Sponsorship

Austin, TX, USA

In Person

Occasional travel may be required.

Bachelor's, Master's, PhD

Category
DevOps & Infrastructure (2)
,
Required Skills
LLM
Service Mesh
MLOps
Incident Response
Distributed Systems
Machine Learning
Docker
RAG
SOC 2
Observability
REST APIs
LangChain
DevOps

Get referred to University of Texas at Austin

See people who can refer or advise you

Requirements
  • A bachelor's degree in Computer Science, Engineering, or a related field is required.
  • At least 8 years of software engineering experience, including at least 3 years focused on artificial intelligence, machine learning, and large language model applications, is required.
  • Deep knowledge of large language model architectures and tools, including transformer models, tokenization, embedding techniques, prompt engineering, and fine-tuning methods, is required.
  • A proven track record of productionizing large language model applications end-to-end in real-world production environments is required, including commercial application programming interfaces, open-source models, and on-premises or private-cloud deployments.
  • Hands-on experience building pipelines with vector databases for embedding storage and search and using large language model orchestration frameworks such as LangChain or LlamaIndex is required.
  • Experience with modern model serving and scaling is required, including familiarity with vLLM, LMDeploy, Ray for distributed inference, or Triton Inference Server.
  • Strong engineering and problem-solving skills are required, including the ability to design solutions for complex challenges and debug issues across the machine learning stack.
  • Strong communication skills are required, including the ability to explain complex technical concepts to engineers, founders, and other stakeholders, document architectures, write project plans, and mentor others.
  • The ability to work effectively in fast-paced environments, act with urgency, adapt to new information, and take ownership is required.
  • Demonstrated execution experience driving projects forward in a hands-on role, managing multiple priorities, staying organized, and delivering results in a lean team setting is required.
Responsibilities
  • Define and lead the software architecture and implementation roadmap for a scalable, modular artificial intelligence infrastructure platform across backend, orchestration, and deployment layers, with a focus on performance, security, and reliability.
  • Build and manage an engineering team comprising backend developers, platform engineers, and site reliability engineers, including mentoring, hiring, and establishing technical excellence and operational discipline.
  • Own core services powering artificial intelligence pipelines, including application programming interfaces for data ingestion and transformation, model-inference job orchestration, and integration with large language model orchestration layers and vector stores.
  • Establish technical strategy and design standards supporting rapid prototyping, automated testing, and code reuse across teams, and lead system design, code reviews, and architectural discussions.
  • Lead the on-premises deployment strategy for hybrid environments, including air-gapped deployments, resource management, and update rollouts in constrained environments.
  • Collaborate with artificial intelligence engineering, product management, and customer success to align engineering priorities with product goals and translate high-level needs into deliverable milestones.
  • Implement and maintain continuous integration and continuous delivery pipelines and DevOps practices focused on security, observability, rollback safety, and developer productivity.
  • Develop and enforce service-level agreements and service-level objectives for critical services, including monitoring, alerting, and incident response practices to ensure uptime and stability in enterprise deployments.
  • Evaluate evolving technologies in distributed systems, containerization, service mesh, observability, and developer tooling to future-proof the platform.
  • Perform other related functions as assigned.
Desired Qualifications
  • A master's degree or PhD in Computer Science, Machine Learning, or a related discipline.
  • Prior technical leadership experience, including leading an engineering team or serving as a technical lead for complex artificial intelligence or machine learning projects, mentoring others, and managing project roadmaps or teams.
  • Domain expertise in natural language processing and large language models, including publications, open-source contributions, or recognized expertise such as contributions to transformer libraries or research in language modeling.
  • Enterprise artificial intelligence experience, including handling sensitive data, ensuring compliance such as GDPR or SOC 2, and integrating with enterprise information technology systems.
University of Texas at Austin

University of Texas at Austin

View

University of Texas at Austin is a public research university in Austin, Texas. It offers undergraduate, graduate, and professional education across a broad range of fields.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A

Get referred to University of Texas at Austin

See people who can refer or advise you