D

DecisionPoint

Defense IT services and mission support

AI/ML & Machine Learning Operations Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeRemote in USANo salary listed

About the Job

Requirements

  • Active Secret clearance or higher is required.
  • A bachelor's degree in computer science, data science, mathematics, engineering, or a related field, or a permitted equivalent, is required.
  • A minimum of 12 years of relevant professional experience is required.
  • Experience leading the architecture of production machine learning systems is required.
  • Experience designing and operating production machine learning or MLOps environments is required.
  • Experience developing and maintaining training, validation, and testing datasets is required.
  • Experience establishing model-evaluation methods, performance measures, validation criteria, and acceptance thresholds is required.
  • Experience deploying machine learning models into production environments is required.
  • Experience automating model build, test, deployment, promotion, rollback, or retraining processes is required.
  • Experience implementing model and data drift monitoring is required.
  • Experience with model governance and data governance is required.
  • Experience controlling model, dataset, pipeline, and configuration updates is required.
  • Experience with cloud-based machine learning platforms or production cloud architectures is required.
  • Experience implementing model, dataset, code, artifact, and configuration versioning is required.
  • Experience building or integrating automated testing, continuous integration, and continuous delivery capabilities for machine learning systems is required.
  • Experience monitoring production model performance, reliability, and operational health is required.
  • Understanding of secure data pipelines, access controls, audit logging, encryption, secrets management, and software supply-chain security is required.
  • Ability to establish traceability across datasets, transformations, model versions, evaluation results, deployments, and operational outcomes is required.
  • Ability to document and communicate model limitations, performance, drift, risks, incidents, and corrective actions is required.
  • CompTIA Security+ CE or another approved IAT Level II certification is required.

Responsibilities

  • Lead the design and implementation of secure, scalable, and supportable production machine learning architectures.
  • Develop, maintain, and govern training, validation, and testing datasets used for model development and evaluation.
  • Establish repeatable processes for dataset ingestion, preparation, transformation, labeling, validation, versioning, and approval.
  • Ensure datasets are maintained in or transformed into analysis-ready and model-ready formats.
  • Implement controls for dataset quality, completeness, integrity, provenance, lineage, security, and authorized use.
  • Design and automate end-to-end machine learning pipelines covering data preparation, training, evaluation, packaging, deployment, monitoring, retraining, and retirement.
  • Deploy machine learning models into approved cloud, application, analytical, and operational environments.
  • Establish automated model build, test, validation, promotion, deployment, rollback, and recovery procedures.
  • Implement model registries and controlled repositories for model artifacts, dataset versions, code, configurations, dependencies, evaluation results, and approvals.
  • Develop automated tests for model pipelines, data transformations, interfaces, deployment packages, and production behavior.
  • Define model evaluation frameworks, performance thresholds, validation criteria, and release-readiness requirements.
  • Evaluate model accuracy, reliability, robustness, performance, scalability, security, and alignment with documented mission requirements.
  • Implement production monitoring for model performance, data drift, concept drift, inference quality, latency, availability, errors, and resource utilization.
  • Establish thresholds, alerts, escalation paths, and response procedures for model degradation, drift, data-quality issues, and operational failures.
  • Investigate model and pipeline anomalies and coordinate corrective actions with data, application, infrastructure, security, and mission teams.
  • Control updates to production models, datasets, features, pipelines, configurations, and dependencies through documented review and approval processes.
  • Maintain traceability among source datasets, data transformations, model versions, evaluation results, deployment records, and production outcomes.
  • Develop rollback and recovery procedures for models, datasets, pipelines, and supporting services.
  • Support secure data pipelines used for AI development, model evaluation, deployment, monitoring, and operational decision support.
  • Implement technical controls supporting model and data governance, including version control, separation of environments, approval gates, auditability, and change management.
  • Maintain audit-ready documentation covering model purpose, training data, evaluation methods, limitations, dependencies, approvals, changes, performance, and known risks.
  • Support the evaluation and auditing of model outputs to identify inaccurate, unsupported, or unexpected results.
  • Help establish human-review checkpoints and escalation procedures for model outputs that could materially affect mission or operational decisions.
  • Support compliance with applicable Government data-handling, cloud-security, cybersecurity, and operational-risk requirements.
  • Integrate model development and deployment workflows with continuous integration, continuous delivery, automated testing, infrastructure-as-code, monitoring, and incident-management capabilities.
  • Partner with cybersecurity teams to address vulnerabilities, access controls, secrets management, software dependencies, logging, encryption, and authorization requirements.
  • Coordinate with data warehouse and data engineering teams on data models, metadata, Extract-Transform-Load processes, data quality, and governed access.
  • Provide technical leadership, architecture guidance, code and design reviews, troubleshooting support, and knowledge transfer.
  • Prepare architecture diagrams, model lifecycle documentation, deployment procedures, monitoring plans, test results, operating guides, and technical reports.
  • Communicate model performance, drift, risks, incidents, corrective actions, and deployment status to technical teams, Government stakeholders, and program leadership.

Desired Qualifications

  • AWS Certified Machine Learning Engineer - Associate or a comparable machine learning platform certification is preferred.
  • An advanced AWS, Microsoft Azure, Google Cloud, Databricks, or comparable cloud architecture or data engineering certification is preferred.
  • Experience supporting federal or Department of Defense programs is preferred.
  • Experience operating machine learning capabilities in regulated, controlled, or mission-critical environments is preferred.
  • Experience with MLflow, Amazon SageMaker, Azure Machine Learning, Google Vertex AI, Databricks, Kubeflow, or comparable platforms is preferred.
  • Experience with containerization, Kubernetes, infrastructure as code, and cloud-native deployment patterns is preferred.
  • Experience implementing feature stores, model registries, metadata repositories, experiment tracking, or data-lineage tools is preferred.
  • Experience with observability platforms, automated alerting, incident response, and production reliability engineering is preferred.
  • Familiarity with responsible AI, explainability, output validation, human oversight, bias evaluation, and model-risk management practices is preferred.
  • Familiarity with DoD Impact Level 4 or comparable Government cloud and data-protection requirements is preferred.
  • Experience with analytical models, generative AI, retrieval workflows, or agentic AI systems is preferred.
  • Experience leading technical teams, architecture reviews, or cross-functional machine learning delivery initiatives is preferred.

About the Company

DecisionPoint

Defense IT services and mission support

DecisionPoint delivers IT support services to U.S. defense and federal agencies, helping them improve mission delivery. The company uses four Centers of Excellence to design and implement solutions that blend skilled professionals, mature processes, and smart technologies to tackle government challenges. It differentiates itself through its Service Disabled Veteran Owned Small Business (SDVOSB) status and its center-based approach to delivering large-scale IT programs across defense and federal sectors. Its goal is to help government agencies transform and enhance performance to meet critical mission requirements.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Gaithersburg, MD
Founded
2011

Recently Posted Jobs

Explore more opportunities at DecisionPoint

See more jobs