Senior Data Engineer

We are looking for a Data Engineer to join our team and help design, build, and optimize scalable data solutions.

In this role, you will work with modern data technologies such as Databricks, Apache Spark, SQL, Python, and Azure, collaborating with technical teams and business stakeholders to transform large volumes of data into reliable and efficient solutions.

Your responsibilities

• Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
• Build solutions to process and transform large datasets efficiently.
• Monitor and optimize existing data pipelines and workflows, improving performance, scalability, throughput, and reliability.
• Collaborate with data scientists, analysts, engineers, and business stakeholders to understand data needs and translate them into effective technical solutions.
• Implement data quality checks and governance practices to ensure data accuracy, consistency, and compliance.
• Troubleshoot complex data and pipeline issues, identifying root causes and proposing sustainable solutions.
• Maintain clear technical documentation and contribute to engineering standards and best practices across the team.

What we are looking for

• Solid professional experience in Data Engineering, particularly designing and developing data pipelines.
• Hands-on experience with Databricks and Apache Spark.
• Strong knowledge of SQL and experience working with large datasets.
• Proficiency in Python or Scala for data engineering.
• Experience working with Microsoft Azure and cloud-based data solutions.
• Strong analytical and problem-solving skills, including the ability to troubleshoot complex data issues.
• Excellent communication skills in English and Portuguese, with confidence working in collaborative environments and interacting with clients and stakeholders.
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.