G

Guidehouse

Advises agencies and runs regulated operations

Cleared Data Engineer

Data EngineeringPosted on Nov 13
Full-timeArlington County, Arlington, VA, USA

About the Job

Requirements

  • An active and current Secret federal security clearance is required.
  • A bachelor's degree is required.
  • Six years of total experience in a data or programming discipline, including three years of experience in data engineering, is required.
  • Proficiency in data engineering-related programming languages such as Python, PySpark, and/or SQL is required.
  • Experience scheduling, monitoring, troubleshooting, and optimizing production ETL/ELT pipelines is required.
  • Experience with data engineering principles and best practices is required.
  • The selected candidate must be able to commute to client and Guidehouse offices as needed.

Responsibilities

  • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
  • Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting.
  • Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks.
  • Define appropriate handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective action with data owners.
  • Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels.
  • Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management.
  • Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
  • Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness.
  • Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
  • Maintain effective working relationships with client management and staff, anticipate stakeholder needs, communicate delivery risks and dependencies, and resolve issues in a timely and professional manner.
  • Organize and lead client meetings by coordinating schedules, developing and distributing agendas and pre-read materials, facilitating discussions and decisions, recording minutes, maintaining required documentation, and tracking action items through closure.
  • Participate in peer reviews, testing, release activities, and continuous-improvement efforts to strengthen engineering practices, reduce recurring defects, and improve the reliability and usability of data products.

Desired Qualifications

  • A master's degree in computer science or a related field is preferred.
  • Experience working with system and application logs is preferred.
  • Familiarity with the Databricks platform is preferred.

About the Company

Guidehouse

Advises agencies and runs regulated operations

Guidehouse advises government agencies and companies in regulated industries on strategy, technology and day-to-day operations. Its work combines business advice with software implementation and ongoing management, so a client uses the same firm to plan a change, build the systems and run the resulting processes. Teams modernize cloud platforms, apply data analysis and artificial intelligence, and redesign organizations to meet operating and regulatory requirements. Clients pay for consulting projects and technology work or outsource continuing business functions to its managed services teams. Guidehouse was founded in 2018 and is headquartered in McLean, Virginia.

Company size
10,001+
Company stage
Acquired
Total funding
$750K
Headquarters
McLean, VA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Guidehouse

See more jobs