P

Publicis Groupe

Runs advertising and digital transformation services

Senior Data Engineer

Data EngineeringPosted on Nov 10
Full-timeArlington County, Arlington, VA, USA$109k - $130k

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, Information Systems, or a related field is required.
  • At least 4 years of data engineering experience, including hands-on delivery and support of enterprise data pipelines, is required.
  • At least 2 years of hands-on Azure Databricks data engineering experience is required.
  • Strong experience with Databricks, Delta Live Tables (DLT), Delta Lake, PySpark, Python, SQL, and Spark SQL is required.
  • Strong experience orchestrating data pipelines with Azure Data Factory is required.
  • Experience loading and serving data through Enterprise Data Lake, Delta Lake, and Azure Synapse Analytics dedicated SQL pools is required.
  • Experience configuring Databricks compute, data quality rules, monitoring, maintenance processes, and workload optimization is required.
  • Experience performing unit testing and coordinating integration testing and user acceptance testing is required.
  • Experience creating high-level designs, detailed designs, data pipeline documentation, and operational runbooks is required.
  • Experience with Azure DevOps, Git, continuous integration and continuous delivery (CI/CD) pipelines, and production deployment practices is required.
  • Demonstrated experience supporting production data platforms and resolving data pipeline incidents is required.

Responsibilities

  • Create new batch and streaming data pipelines by leveraging and extending existing data ingestion frameworks and tools.
  • Orchestrate, schedule, and monitor data pipelines using Azure Data Factory.
  • Develop and enhance data transformations based on business and technical requirements using PySpark, Python, and SQL.
  • Parse, transform, and load data into the Enterprise Data Lake, Delta Lake, and Azure Synapse Analytics dedicated SQL pools.
  • Build and maintain Databricks data engineering solutions, including Delta Live Tables (DLT), compute configuration, and pipeline maintenance.
  • Configure and maintain data quality rules, validation controls, reconciliation processes, monitoring, and automated alerts.
  • Perform unit testing and coordinate integration testing and user acceptance testing (UAT) with business and technology partners.
  • Create and maintain high-level designs (HLDs), detailed designs (DDs), data mappings, operational runbooks, and support documentation.
  • Tune and optimize Databricks, Spark, SQL, and Synapse workloads for performance, reliability, scalability, and cost efficiency.
  • Provide production support, including incident troubleshooting, root-cause analysis, defect resolution, and operational maintenance.
  • Use Azure DevOps and Git to support source control, CI/CD, release management, and controlled production deployments.
  • Collaborate with data architects, analysts, business stakeholders, and support teams to deliver reliable enterprise data products.

About the Company

Publicis Groupe

Runs advertising and digital transformation services

Publicis Groupe runs advertising, media buying and digital transformation services for companies that want to reach consumers, coordinate campaigns and improve their business systems. Its agency network includes creative and media specialists, while Publicis Sapient builds and modernizes the technology behind clients' operations. Epsilon adds customer data and marketing technology that connect brands with audiences and measure campaign results. Clients pay for consulting, campaign creation and execution, with production and media costs billed through alongside the group's service work. Founded in 1926, Publicis Groupe is headquartered in Paris, France.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1926

Recently Posted Jobs

Explore more opportunities at Publicis Groupe

See more jobs