J

J5 Consulting

Secures IT systems and manages cybersecurity operations

Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeMcLean, VA, USA

About the Job

Requirements

  • Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment.
  • Demonstrated experience working effectively in high-performing, cross-functional teams with multiple concurrent projects.
  • Demonstrated experience working directly with stakeholders to gather requirements, understand needs, and translate them into technical solutions with minimal oversight.
  • Demonstrated experience in self-directed work with a strong ownership mentality and commitment to code quality, testing, and documentation.
  • Demonstrated experience context-switching between projects and systems as priorities demand.
  • Demonstrated experience building production data pipelines and extract, transform, and load/extract, load, and transform workflows at scale.
  • Demonstrated experience with Apache Spark and PySpark for distributed data processing.
  • Demonstrated experience with advanced Python programming, including Pandas, NumPy, and data engineering best practices.
  • Demonstrated experience understanding data security, privacy, governance, and compliance principles.
  • Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow.
  • Demonstrated experience with containerization such as Docker or Podman and deploying data applications in cloud environments.
  • Demonstrated experience with Amazon Web Services, particularly S3, Lambda, and Step Functions.
  • Demonstrated experience with PostgreSQL and MySQL in production environments, including performance tuning and schema design.
  • Demonstrated experience with SQL and query optimization for complex analytical workloads.
  • Demonstrated experience with version control using Git and continuous integration/continuous delivery practices for data pipelines.
  • Demonstrated experience working with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.
  • Demonstrated experience with problem-solving and debugging for data quality issues, pipeline failures, and performance bottlenecks.
  • U.S. citizenship is required.
  • An active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph is required.

Responsibilities

  • Build production data pipelines and extract, transform, and load/extract, load, and transform workflows at scale.
  • Design and deploy data applications in cloud environments.
  • Work with stakeholders to gather data requirements, assess feasibility, and design appropriate technical solutions.
  • Support code quality, testing, documentation, data governance, and compliance for data engineering solutions.

Desired Qualifications

  • Demonstrated experience with data lakehouse architectures using Apache Iceberg.
  • Demonstrated experience configuring, deploying, and integrating Apache Ranger, Trino, data catalogs such as Unity Catalog OSS and Apache Polaris, and Apache Superset.
  • Demonstrated experience with Bash scripting for automation and data processing tasks.
  • Demonstrated experience with Infrastructure as Code using Terraform or CloudFormation for data infrastructure.
  • Demonstrated experience tracking data lineage with tooling such as OpenLineage.
  • Demonstrated experience with Java.
  • Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies.
  • Demonstrated experience or background with large-scale data migrations or platform modernization efforts.
  • Demonstrated experience integrating artificial intelligence and machine learning services and models, large language models, and retrieval-augmented generation pipelines.
  • Demonstrated experience with geospatial data processing using H3, PostGIS, or similar tools.
  • Demonstrated experience contributing to data engineering documentation, best practices, or design patterns.
  • Demonstrated experience with NoSQL databases such as DynamoDB.
  • Demonstrated experience communicating effectively with technical and non-technical audiences.

About the Company

J5 Consulting

Secures IT systems and manages cybersecurity operations

J5 Consulting is a cybersecurity and IT services company serving government agencies and commercial organisations. Its work combines security assessments, risk management and compliance support with cloud computing, systems integration, application support and ongoing IT operations. The company evaluates vulnerabilities, develops tailored remediation plans and implements controls intended to protect clients' systems and data. Its managed services cover infrastructure monitoring, cloud administration, patching and security reporting, while its consulting teams support technology and programme decisions. Established in 2006 as J5 Holdings Corporation, J5 Consulting is headquartered in Bowie, Maryland, United States.

Company size
1-10
Company stage
Not listed
Total funding
Not listed
Headquarters
Bowie, MD
Founded
2006

Recently Posted Jobs

Explore more opportunities at J5 Consulting

See more jobs