M

Mindera

Bespoke software engineering and consulting

Team Lead Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeChennai, Tamil Nadu, India₹3.5M - ₹5M

About the Job

Requirements

  • Strong hands-on experience with AWS Cloud services, including S3, Lambda, IAM, EC2, or equivalent.
  • Extensive experience with Databricks, Delta Lake, and Unity Catalog.
  • Proficiency in Apache Spark; PySpark is preferred.
  • Strong programming skills in Python.
  • Excellent command of SQL, including performance tuning and working with large datasets.
  • Experience working in fast-paced, agile environments.
  • Experience with data governance frameworks and tools such as DataHub or Soda.
  • Experience with CI/CD tools such as GitHub Actions.
  • Availability to support meetings and calls in US Pacific Time (PT).

Responsibilities

  • Design, develop, and maintain scalable data pipelines and transformation workflows using Databricks and Spark.
  • Build and optimize ETL/ELT processes to ingest, cleanse, and prepare large datasets.
  • Use AWS services such as S3, Lambda, IAM, ECS, and CloudWatch to support data architecture and operational needs.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
  • Ensure data quality, reliability, and performance across data systems.
  • Implement and enforce best practices for coding, version control, CI/CD, and environment management.
  • Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
  • Contribute to architectural decisions, documentation, and process improvements.

Desired Qualifications

  • Proficiency in PySpark.

About the Company

Mindera

Bespoke software engineering and consulting

Mindera builds custom software solutions for clients around the world, focusing on web and mobile applications that are tailored to each business. The company delivers these solutions through agile, collaborative work with project-based engagements or long-term consulting partnerships, ensuring frequent iteration and learning. It differentiates itself by emphasizing strong client relationships, empowering its engineering teams, and contributing to the tech community, alongside a global delivery model that adapts quickly to new challenges. Mindera’s goal is to help clients achieve their business objectives by delivering high-quality, scalable, and secure software that meets evolving needs.

Company size
201-500
Company stage
Debt Financing
Total funding
$2.1M
Headquarters
Porto, Portugal
Founded
2014

Recently Posted Jobs

Explore more opportunities at Mindera

See more jobs