Full-Time

Enterprise Data Engineer

Bespoke Technologies

Bespoke Technologies

No salary listed

No H1B Sponsorship

Herndon, VA, USA

In Person

Fully on-site; no remote option.

US Top Secret Clearance Required

Bachelor's

Category
Data & Analytics (1)
Required Skills
Microsoft Azure
Python
Airflow
Apache Spark
SQL
RDBMS
ETL
Data Engineering
AWS
REST APIs
Hadoop
Data Modeling
Google Cloud Platform
Requirements
  • At least 3 years of experience in data engineering.
  • Strong proficiency in scripting and programming with Python.
  • Expertise in using SQL for data querying, transformation, and optimization.
  • Experience integrating data from diverse sources such as application programming interfaces, relational databases, and file systems.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and teamwork skills for collaboration with technical and business teams.
  • An active polygraph clearance is required; candidates without an active polygraph clearance will not be considered.
Responsibilities
  • Write robust and efficient Python and SQL scripts to automate data processing tasks.
  • Integrate data from diverse sources, such as databases, application programming interfaces, and flat files, into centralized systems.
  • Implement data transformations, enrichment, and modeling workflows to ensure data quality and usability.
  • Ensure data structures are optimized for performance and scalability.
  • Provide technical guidance and support to ensure effective use of Palantir tools across teams.
  • Implement data quality checks, validation, and monitoring mechanisms to ensure the accuracy and reliability of datasets.
  • Ensure proper data transformation and curation to meet business and analytics requirements.
  • Maintain and improve data quality, consistency, and accuracy through validation and cleansing processes.
Desired Qualifications
  • A bachelor's degree in Computer Science, Data Engineering, or a related field.
  • Hands-on experience with Palantir.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform and big data technologies such as Apache Spark or Hadoop.
  • Familiarity with data orchestration tools such as Apache Airflow, Prefect, or similar.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A