I

Illumina

Develops sequencing platforms and consumables

Senior Data Engineer

Data EngineeringUpdated on Nov 22
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • At least 8 years of professional data engineering experience building and scaling data products on cloud platforms such as Databricks and/or Snowflake.
  • Strong proficiency in Python, including reusable framework development using functional and object-oriented programming.
  • Advanced SQL and strong data modeling skills across relational, dimensional, and lakehouse models.
  • A solid understanding of distributed systems and system design for large-scale data processing.
  • Hands-on experience with open table formats such as Delta Lake and/or Apache Iceberg, and big-data file formats such as Parquet.
  • Experience with Spark and modern ELT tooling such as dbt.
  • Experience with data observability, governance, security, and compliance practices, including RBAC, PII, and SOX.
  • Demonstrated adoption of AI in data and analytics engineering workflows.
  • A solid software engineering foundation, including Git, REST APIs, JSON, and CI/CD on at least one cloud environment; AWS is preferred.
  • Strong written and verbal communication skills and the ability to work effectively across business, AI, and platform teams and lead technical discussions.
  • A bachelor's degree in Computer Science, Data Science, Information Systems, Engineering, or Mathematics, or equivalent demonstrable experience.

Responsibilities

  • Partner across business, AI, and platform teams to translate domain needs, such as SAP, Manufacturing, and Quality, into well-modeled, governed, and scalable data products.
  • Design, build, and scale end-to-end data products on Databricks and interoperating with Snowflake, from ingestion through curated, analytics-ready datasets, following a medallion (Bronze/Silver/Gold) architecture.
  • Develop reusable frameworks, libraries, and standardized patterns in Python, using functional and object-oriented programming as appropriate, for ingestion, transformation, validation, and publishing.
  • Design robust data models and apply system-design judgment to build performant, reliable distributed data pipelines using Spark, Delta Lake or open table formats, dbt, and SQL.
  • Embed data quality, reconciliation, validation, and governance into pipelines using Unity Catalog capabilities including lineage, RBAC, masking, and PII handling.
  • Monitor and alert on business-critical datasets, troubleshoot issues, perform root-cause analysis, and adhere to SLAs.
  • Adopt AI in day-to-day data and analytics engineering to accelerate development, testing, and optimization.
  • Set technical standards, lead code reviews, contribute to architecture decisions, mentor engineers, and communicate trade-offs to peers and stakeholders.

Desired Qualifications

  • Domain knowledge of SAP, Manufacturing, and/or Quality data and processes.
  • Experience delivering in GxP, 21 CFR Part 11, or comparable regulated environments such as life sciences, pharma, or medical devices.
  • Experience with Unity Catalog and lakehouse governance at scale.
  • Snowflake-to-Databricks migration experience.
  • Exposure to SAP data (ECC/S/4HANA and CDS views) and SAP data integration patterns such as SAP Business Data Cloud; additional domain knowledge such as Commercial and Finance is a bonus.
  • Databricks and/or dbt certifications.
  • Familiarity with Power BI or Tableau and enabling BI and conversational analytics.

About the Company

Illumina

Develops sequencing platforms and consumables

Illumina develops and sells integrated sequencing systems and the consumables needed to analyze genetic variation and biological function. Its instruments use sequencing-by-synthesis on flow-cell-based platforms, with specialized reagents and library preparation kits that are consumed per run. The company differentiates itself through a broad end-to-end ecosystem, a large installed base that drives repeat purchases, and strategic acquisitions that expand capabilities into multiomics and clinical applications. Its goal is to advance genomic analysis for research and clinical diagnostics to enable personalized medicine and early cancer detection.

Company size
5,001-10,000
Company stage
IPO
Headquarters
San Diego, CA
Founded
1998

Recently Posted Jobs

Explore more opportunities at Illumina

See more jobs