P

Peraton

Runs and secures technology for federal agencies

Operations Engineering Senior Advisor

Site Reliability EngineeringUpdated on Nov 5
Full-timeBaltimore, MD, USAIn-person

About the Job

Requirements

  • A minimum of 12 years of professional experience with a BS/BA, 10 years with an MS/MA, or 7 years with a Ph.D.
  • Experience leading production operations for a large, mission-critical AWS system, including monitoring, incident response, and high-availability operations.
  • Demonstrated experience leading production support teams and coordinating incident response across multiple technical teams and external partners.
  • Experience owning disaster recovery and continuity, including DR playbooks, RTO/RPO, contingency plan testing, and failover/failback execution.
  • Experience with release and change management in a SAFe/Agile environment with CI/CD pipelines.
  • Experience supporting federal government systems that process personally identifiable information and financial transactions.
  • Ability to obtain and maintain the CMS background investigation and HSPD-12 PIV credential required for the position.
  • Experience operating batch processing and file-based data exchanges with external partners on fixed processing calendars.
  • Working knowledge of federal security operations, including FISMA, NIST SP 800-53, incident reporting, vulnerability remediation, POA&M management, and ATO support.
  • Hands-on knowledge of AWS operations, including compute, containers, serverless, databases, networking, monitoring, and security services.
  • Experience with observability tooling, centralized logging, alerting, and on-call management.
  • Experience with production database operations, including availability, backup, recovery, and data integrity.
  • Understanding of CMS and Medicare program operations, and of how production issues affect beneficiaries, plans, and payments.

Responsibilities

  • Lead real-time monitoring of MARx jobs, system health, cost and usage, and security events using CMS-approved tools, including Splunk, Splunk On-Call, Datadog, Amazon CloudWatch, and Amazon QuickSight dashboards; identify and resolve anomalies and errors before they affect plans or beneficiaries.
  • Manage and maintain 99.9% system availability and response time across the production environment, and report performance against that target.
  • Maintain scalability and code portability for cloud operations while working with the DevOps Lead and Architectural Lead.
  • Apply the AWS Well-Architected Framework to production operations to achieve operational excellence, security, reliability, performance efficiency, and cost optimization in the cloud hosting environment.
  • Plan capacity for periodic peak processing loads, including monthly payment processing, the Annual Enrollment Period, and New Year Preparation.
  • Identify the causes of processing errors and correct them quickly to minimize system downtime.
  • Own the MARx Disaster Recovery Playbook, including organizational roles and contacts, management and escalation, declaration and testing guidelines, notifications, infrastructure and network configuration details, and step-by-step failover and failback procedures.
  • Meet the Recovery Time Objectives and Recovery Point Objectives defined in the Business Impact Assessment.
  • Lead MARx participation in annual Contingency Plan tabletop tests and requested DR exercises, and turn results into corrective actions.
  • Lead production incident response from detection through recovery, coordinating scrum teams, the DevOps and Security Leads, and partner systems.
  • Ensure suspected or confirmed security and privacy incidents and breaches are reported to the CMS Incident Response Team, the COR, and the CO within one hour; ensure HHS CSIRC and CMS IRT alerts and indicators of compromise receive a response within 24 hours.
  • Support the Incident and Breach Response Plan by providing requested logs, images, and event data, and produce post-incident reports covering impact, threat vector, information affected, lessons learned, and mitigation.
  • Lead root cause analyses for production defects and track preventive actions to closure.
  • Ensure users and partners receive timely, accurate notice of releases, maintenance, outages, and downtime, and maintain the downtime communications playbook.
  • Work with the Architectural Lead and DevOps Lead to turn recurring incident causes into long-term fixes.
  • Direct daily, monthly, quarterly, and annual MARx operations, including transmission of plan payment files to the Automated Plan Payment System on the monthly payment cycle.
  • Oversee inbound and outbound data exchanges with MAOs, SSA, RRB, and internal partners, including the shared Split and Push file transmission service, the File Mover process (CMS EFT and S3-to-S3), and partner exchanges defined in the Plan Communications User Guide.
  • Lead operational readiness for New Year Preparation and the Beneficiary Rate Increase from July through March, and for the Annual Enrollment Period.
  • Coordinate the semiannual lower-environment data refresh, including the de-identification hand-off, and semiannual and qualifying-beneficiary data archival processes in line with CMS retention requirements.
  • Oversee the premium withhold and premium reduction request process with SSA and RRB, which runs on daily, weekly, bi-monthly, monthly, and annual schedules.
  • Identify issues with information exchanges proactively, and test and implement fixes thoroughly to minimize negative impact on partners.
  • Govern production deployments for the current twice-weekly release cadence, including production readiness reviews, post-implementation reviews, and rollback readiness.
  • Ensure every production change follows the CMS Target Life Cycle and MEPS Change Control Board process, and that production-equivalent branches maintain their protection rules and CMS approval requirements.
  • Serve as the operations point of contact for MBOSC, provide timely SME support on urgent tickets, lead working sessions with MBOSC and business owners, deliver time-sensitive data fixes, and keep ticket status visible across MARx, MBOSC, and CMS.
  • Maintain help desk scripts with the MAPD Help Desk, the CMS IT Service Desk, and other CMS help desks.
  • Triage aging tickets during transition-in and draft the backlog reduction plan; record improvement opportunities in production operations, ticket handling, and automation.
  • Drive the aging ticket backlog toward the CMS goal of no open tickets more than one year old by the beginning of 2029.
  • Ensure production vulnerabilities and findings are remediated within HHS POA&M timelines—critical within 15 days, high within 30 days, medium within 90 days, and low within 360 days—and track items that cannot meet those timelines in the POA&M.
  • Support maintenance of the MARx Authority to Operate and CMS Acceptable Risk Safeguards controls, CMS penetration testing and vulnerability scans, and mandated audits such as CFO and A-123, including pulling documentation, running queries, and attending auditor meetings.
  • Manage MARx resource usage responsibly to limit costs CMS incurs, using cost and usage dashboards; cloud hosting is paid under a separate CMS contract.
  • Identify and implement automation of operational work, including responsible use of Super Intelligence (also called Artificial Intelligence) under the approved SI Compliance and Risk Management Plan, toward the CMS goal of moving the O&M-to-enhancement split from about 75/25 to 50/50 by the end of the period of performance.
  • Participate in CMS-led innovation efforts and recommend process improvements in operations.
  • Evaluate Super Intelligence and machine learning uses suited to production operations, such as anomaly detection for payment and premium processing, optimization of batch processing schedules, and AI-powered chatbots for user support.
  • Maintain a working understanding of the MARx business functions supported by production, including enrollment and disenrollment processing and daily reporting to Medicare Advantage Organizations; premium calculation, premium withholding with SSA and RRB, and Premium Withhold Accounting reconciliation; monthly plan payment calculation, retroactive adjustments, and payment files to APPS; and reports and data files to plans and partners and New Year Preparation.
  • Oversee production database availability, backup, and recovery for MARx data stores (MySQL Community, Aurora MySQL, and Aurora PostgreSQL) in line with Recovery Point Objectives.
  • Promote data integrity so data remains accurate and accessible, and apply practices that prevent data corruption and incidents requiring data clean-up.
  • Work with CMS business owners and OIT on operational priorities, production issues, and changes that affect operations.
  • Facilitate communication and engagement on operational matters across multiple CMS groups, states, and federal agencies.
  • Coordinate with partner and upstream system teams (SSA, RRB, HPMS, APPS, RASS, and MEPBS/CME) on exchange schedules, incidents, and fixes.
  • Explain operational risks, incident status, and trade-offs clearly to technical and nontechnical audiences.
  • Participate in MEPS Program Increment Planning in person when needed and follow the MEPS iteration schedule.
  • Plan production operations capacity alongside enhancement work, and advise the Program Manager on prioritizing unplanned work.
  • Note deviations from the PI plan and report them to CMS OIT staff.
  • Provide production operations input to risk and issue management and to the quarterly QASP self-assessment, delivered within one month of each PI ending.
  • Maintain current, organized operations documentation for continuity and traceability, including SOPs, data fix documents, data validation and verification documents, production readiness reviews, and post-implementation reviews.
  • Mentor production support analysts and engineers, and spread operational knowledge across the scrum teams to avoid single points of failure.
  • Contribute production operations content to MARx training, including self-paced computer-based training modules, and train CMS staff as needed.

Desired Qualifications

  • Experience with CMS systems and processes, especially Medicare Advantage and Part D enrollment, premium, and payment operations, and the New Year Preparation cycle.
  • Hands-on experience with the MARx stack's operations tools: Splunk and Splunk On-Call, Datadog, CloudWatch, AWS Security Hub and GuardDuty, and Amazon QuickSight.
  • Familiarity with Aurora MySQL and PostgreSQL, ECS Fargate, Lambda, AWS Batch, SQS/SNS, and CMS Enterprise File Transfer.
  • An industry certification such as AWS Certified SysOps Administrator or DevOps Engineer, ITIL 4, or an equivalent.
  • Experience leading SRE-style automation that measurably reduced operational workload.
  • Direct experience with MARx production operations, including its batch schedule, interfaces, and operational calendar.
  • Familiarity with CMS governance, including the Target Life Cycle, Technical Reference Architecture, Acceptable Risk Safeguards, and the MEPS Change Control Board process.
  • Experience with HHS/CMS incident and breach response procedures, including breach reporting under OMB M-17-12.
  • Experience with ServiceNow incident and case workflows.
  • Experience applying SI-enabled monitoring or automation, such as anomaly detection, in a regulated environment.

About the Company

Peraton

Runs and secures technology for federal agencies

Peraton builds and runs secure technology for American defense, intelligence, space, and civilian agencies, from military networks to satellite ground stations. In 2025, the Federal Aviation Administration chose it to manage the overhaul of the nation's air traffic control system, replacing copper wiring with fiber and upgrading radar and radios. Its engineers, many holding security clearances, run and defend agency networks and data centers, write mission software, and operate space and communications systems, and agencies pay for this work through multiyear contracts. Peraton was formed in 2017, when private-equity firm Veritas Capital bought Harris Corporation's government IT business, and is based in Reston, Virginia.

Company size
10,001+
Company stage
Grant
Total funding
$60M
Headquarters
Reston, VA
Founded
2017

Recently Posted Jobs

Explore more opportunities at Peraton

See more jobs