Data Engineer - AWS/Databricks
About the job
- At least 4 years of experience in data engineering and Agile analytics.
- At least 4 years of experience creating software for retrieving, parsing, and processing structured and unstructured data.
- At least 2 years of experience building scalable extract, transform, and load and extract, load, and transform workflows for reporting and analytics.
- At least 2 years of experience building enterprise data engineering solutions in the cloud, with preferred experience using Amazon Web Services and Databricks cloud-native technologies.
- Experience with data quality, validation frameworks, and storage optimization strategies.
- A Bachelor of Arts or Bachelor of Science degree.
- Must be a United States citizen with the ability to obtain and maintain United States suitability.
- Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data.
- Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.
- Develop extract, transform, and load and extract, load, and transform workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.
- Use Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to data warehouse modeling best practices.
- Collaborate with data architects and engineers to implement cloud-native data solutions on Amazon Web Services using S3, Glue, RDS, and IAM for secure, scalable storage and access control.
- Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.
- Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with continuous integration and continuous delivery tools such as GitLab or Jenkins.
- Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and Amazon Web Services CloudWatch, identify bottlenecks, and optimize cost-performance tradeoffs.
- Conduct technical discovery and mapping of legacy source systems, identify required transformations, and design end-to-end data flows.
- Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic.
- Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams.
- Preferred experience with cloud-native technologies from Amazon Web Services and Databricks.
About the company
Acuity, Inc. provides federal technology consulting services from its Reston, Virginia headquarters. The company helps government clients plan for the future, improve current operations, and reduce costs by delivering mission-focused results that matter to taxpayers. It combines practical technology, specialized services, and proven management techniques to continuously enhance how U.S. agencies serve and protect citizens. What sets Acuity apart is its emphasis on deep industry expertise, cost savings for taxpayers, and real, measurable outcomes tailored to government missions. The company’s goal is to help clients operate more effectively while delivering accountable, tangible results for Americans.
Company Size
201-500
Company Stage
N/A
Total Funding
N/A
Headquarters
Reston, Virginia
Founded
2002
Get referred to Acuity, Inc.
See people who can refer or advise you
Simplify's Take
What believers are saying
- Evolve gives Acuity fresh Department of State work opportunities after March 26, 2026.
- The September 2026 site refresh signals active hiring and a stronger growth posture.
- Cloud, AI, and hyperautomation offerings match agency modernization demand across 2026 procurements.
What critics are saying
- CIO-SP3 small-business access ends October 29, 2026, forcing recompete exposure.
- Acuity’s federal concentration ties revenue to State, SEC, and agency budget cycles.
- Missing Evolve or OneIT recompetes would crush pipeline and threaten Acuity’s viability.
What makes Acuity, Inc. unique
- Acuity holds multiple federal IDIQs, including SEC OneIT and CIO-SP3, through 2026.
- Acuity won State Department Evolve IDIQ on March 26, 2026, extending enterprise IT access.
- Acuity touts Microsoft Cloud Partner status and national-security cloud expertise in 2026.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Health Insurance
Dental Insurance
Vision Insurance
401(k) Retirement Plan
401(k) Company Match
Professional Development Budget
Tuition Reimbursement
Company News
Matthew Contento has been named Vice President, Foreign Affairs at Acuity
With our technological capabilities, recent practice expansions, and a continually growing network of industry partnerships, the time was right to bolster our leadership team. .
Acuity Inc. announces Intelligence Community service expansion hires KC Wilberg to head new Intelligence Business Unit.
Acuity actively supports several national security and public safety missions with advanced cloud solutions. We are pleased that Microsoft has recognized our ability to assist our customers in transforming their mission and business operations to take advantage of new capabilities in the cloud. .
We are committed to the important work of GTSC in serving the homeland security mission. We share the Coalition’s goal of bringing the unique innovation of small and mid-size businesses to protect our nation from man-made and natural threats.”. .