D

Deloitte

Audits companies and advises on tax and technology

Data Engineer 2 - Databricks

Data EngineeringConfirmed live in the last 24 hours
Full-timeBaltimore, MD, USA

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, Data Science, or a quantitative field is required.
  • At least 3 years of experience designing, building, and maintaining data pipelines and ETL/ELT workflows is required.
  • At least 3 years of experience using SQL, Python, and PySpark for data ingestion, transformation, and automation is required.
  • At least 1 year of experience developing and deploying solutions on the Databricks platform is required.
  • At least 1 year of experience monitoring data pipelines, troubleshooting issues, and supporting data quality and system reliability is required.
  • The candidate must be able to travel an average of 10%, depending on work and clients served.
  • The candidate must possess an active U.S. Secret security clearance and be able to maintain it throughout employment and assignment.
  • The candidate must be legally authorized to work in the United States without employer sponsorship, now or in the future.
  • The candidate should be able to work independently and collaboratively, communicate effectively in writing and verbally, and maintain attention to detail and quality.
  • The candidate should be able to build professional relationships, lead projects or workstreams, prioritize multiple tasks, provide clear guidance, and meet deadlines.

Responsibilities

  • Design, build, test, and maintain scalable data pipelines and workflows for ingesting, transforming, and delivering structured and unstructured data.
  • Develop and optimize data models, integration patterns, and storage solutions for analytics, reporting, and operational use cases.
  • Collaborate with cross-functional stakeholders to define data requirements, troubleshoot issues, and implement data quality controls.
  • Build and support batch and near-real-time processing solutions using cloud-based and distributed data technologies.
  • Document technical designs, data lineage, and deployment processes, and support testing, release, and production stabilization activities.

Desired Qualifications

  • A master's degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, Data Science, or a quantitative field is preferred.
  • At least 1 year of experience with workflow orchestration tools such as Apache Airflow is preferred.
  • At least 1 year of experience with data warehousing platforms such as Snowflake, Databricks, or Amazon Redshift is preferred.
  • At least 1 year of experience with version control and continuous integration tools is preferred.
  • At least 1 year of experience supporting data quality, metadata, and data lineage processes is preferred.
  • At least 1 year of experience working in Agile delivery environments is preferred.

About the Company

Deloitte

Audits companies and advises on tax and technology

Deloitte audits companies and advises businesses and governments on tax, technology, and risk, and it is one of the Big Four, the world's four largest accounting firms. In 1849 its founder became the first independent auditor of a public company, Britain's Great Western Railway. Its auditors check companies' financial reports for errors and fraud before investors rely on them, while its consultants design strategy, install business software, and defend clients against cyberattacks. Clients pay fees for each audit or project, and each country's Deloitte firm is a separate business owned by its local partners. Deloitte was founded in London in 1845 and is based in New York.

Company size
10,001+
Company stage
Late Stage VC
Total funding
$17.1M
Headquarters
New York, NY
Founded
1845

Recently Posted Jobs

Explore more opportunities at Deloitte

See more jobs