D

DaCodes

Custom software solutions to scale businesses

Data Engineer Azure Databricks - ETL Automation Specialist

Data EngineeringConfirmed live in the last 24 hours
Full-timeMexico City, CDMX, MexicoMX$35k - MX$40k /moRemote

About the Job

Requirements

  • At least five years of experience in Data Engineering, ETL Development, or Data Integration roles.
  • Demonstrated experience working with Azure Data Factory.
  • Practical experience developing solutions with Databricks.
  • Experience implementing end-to-end ETL processes.
  • Experience processing and integrating structured files and diverse data sources.
  • Proficiency with Azure Data Factory, Azure Databricks, advanced SQL, ETL development and automation, data pipeline design and maintenance, integration and processing of CSV, TXT, and Excel files, troubleshooting and monitoring data processes, Python, and PySpark.
  • Previous experience working in cloud environments based on Microsoft Azure.
  • Availability to join a fast-paced project quickly.

Responsibilities

  • Design, develop, and maintain ETL processes using Azure Data Factory and Databricks.
  • Implement data integration pipelines for ingesting and processing CSV, TXT, Excel, and other information sources.
  • Automate data loading, transformation, and validation processes.
  • Configure and administer Databricks Jobs and Workflows for scheduled process execution.
  • Develop data transformations using SQL and Databricks ecosystem technologies.
  • Monitor, diagnose, and resolve incidents involving pipelines and ETL processes.
  • Ensure the quality, consistency, and integrity of processed data.
  • Collaborate with technical teams and stakeholders to understand integration and automation requirements.
  • Participate in optimizing and continuously improving data processes.

Desired Qualifications

  • Experience with Azure Data Lake Storage (ADLS).
  • Experience with Azure Blob Storage.
  • Experience with Git.
  • Experience optimizing data transformation processes.

About the Company

DaCodes

Custom software solutions to scale businesses

DaCodes provides custom software solutions to help organizations reach their potential. A global team of 220+ DaCoders partners with clients to understand goals, design, build, and support software that improves workflows and scales operations. It stands out by offering client-aligned, ongoing collaboration from a large global talent pool to deliver tailored software that supports long-term strategic goals. The aim is to help organizations grow through technology by increasing efficiency, expanding capabilities, and accelerating innovation.

Company size
201-500
Company stage
Not listed
Total funding
Not listed
Headquarters
Mérida, Mexico
Founded
2014

Recently Posted Jobs

Explore more opportunities at DaCodes

See more jobs