R

Red Hat

Enterprise open-source software subscriptions and services

AI/ML Customer Engineer

Applied Machine LearningPosted on Nov 11
Full-timeSingaporeNo salary listedIn-person

About the Job

Requirements

  • A bachelor's or master's degree in Computer Science, Computer Engineering, or a related quantitative field.
  • A strong understanding of software engineering fundamentals, including clean code principles, test-driven development, continuous integration and continuous delivery automation pipelines, and Git version-control workflows.
  • Clear verbal and written communication skills in English, including the ability to explain complex technical architectures to engineers and technical stakeholders.
  • Hands-on proficiency in Python for machine learning and systems programming.
  • Familiarity with PyTorch and natural language processing and computer vision ecosystems, including Hugging Face Transformers, datasets, and tokenizers.
  • Practical experience deploying containerized applications on Kubernetes or production-grade enterprise container orchestration platforms.
  • Conceptual and hands-on understanding of model-serving lifecycles, data ingestion, and automated packaging.
  • Experience in some target knowledge domains, including platform and pipeline engineering; generative AI and agentic architectures; hardware heterogeneity and runtime optimization; or regulated deployments.

Responsibilities

  • Design and build comprehensive, production-ready architecture blueprints and reference codebases that account for enterprise requirements such as systems-level hardening, infrastructure scalability, and network-isolation boundaries, without performing last-mile hands-on production deployment.
  • Package repeatable, extensible technical architectures as open-source AI Quickstarts to solve industry problems and accelerate ecosystem adoption.
  • Collaborate with external engineering teams, including semiconductor partners, regional AI programs, and software vendors, to validate joint-architecture blueprints and ensure stable integrations across the system stack.
  • Design and integrate automated testing, evaluation harnesses, and system-level telemetry into blueprints to monitor latency, throughput, cost, and model quality.
  • Incorporate data-privacy standards, secure network perimeters, and localized hosting considerations into solution blueprints to meet compliance and risk-management requirements in regulated environments.

Desired Qualifications

  • Familiarity with Go or C/C++ system languages.
  • Experience with distributed computing frameworks and cluster schedulers such as Ray; workflow orchestration such as MLflow or Kubeflow; distributed unstructured-data parsing tools such as Docling; and vector database structures.
  • Familiarity with LLM orchestration engines such as LangChain, LlamaIndex, or LangGraph; agentic workflows such as AgentOps; tool-calling protocols such as Model Context Protocol; and model fine-tuning such as PEFT or SFT.
  • Understanding of model-serving runtimes such as vLLM; runtime optimization for latency and throughput, including KV-cache offloading and chunked prefill; and benchmarking across CUDA, ROCm, and emerging GPU/NPU architectures.
  • Experience designing isolated, air-gapped container networks, secure registry services, and local inference environments to meet data-residency, privacy, and compliance policies.
  • Experience applying AI/ML architectures in financial services, including risk-assessment models, fraud-detection patterns, or regulatory compliance.
  • Experience handling sensitive or anonymized datasets, building secure data boundaries, or deploying solutions under strict government compliance protocols in the public sector or healthcare.
  • Experience with edge AI deployments, high-throughput streaming pipelines, or low-latency remote architectures in telecommunications or manufacturing.

About the Company

Red Hat

Enterprise open-source software subscriptions and services

Red Hat sells enterprise open-source software with a subscription model that includes updates, security patches, and professional support. Its products—RHEL for hybrid cloud servers, OpenShift for containerized apps, and the Ansible Automation Platform for IT automation—are open-source at core but provided with guaranteed enterprise support. Red Hat differentiates itself by pairing open-source code with a deep services layer and an integrated stack designed for hybrid/multicloud environments, backed by IBM. Its goal is to help large organizations deploy, manage, and scale open-source software across complex IT landscapes with reliable software and predictable, ongoing support.

Company size
10,001+
Company stage
IPO
Headquarters
Raleigh, NC
Founded
1993

Recently Posted Jobs

Explore more opportunities at Red Hat

See more jobs