FamPay

Youth fintech platform for quick UPI payments

Data Engineer - Software Engineer 2

Data EngineeringConfirmed live in the last 24 hours

Full-timeBengaluru, Karnataka, India

About the Job

Requirements

Requires 3–5 years of data engineering experience, specifically with distributed systems and cloud-native architectures.
Requires expert-level Python/PySpark and SQL skills.
Requires hands-on experience with AWS services including S3, EKS, and MSK, and infrastructure-as-code.
Requires experience with Airflow or Temporal for complex workflow management.
Requires proficiency using AI tools such as Claude, Codex, and Copilot to write, test, and document code.
Requires the ability to explain trade-offs between storage formats and processing frameworks.
Requires designing domain models for OLAP, including fact, dimension, and cumulative models, types of slowly changing dimensions, and one-big-table pattern tables.
Requires the ability to drive technical initiatives by preparing technical requirements documents and participating in design reviews.
Requires technical leadership, initiative, and contribution of ideas to the team’s growth.
Requires interaction with product and key stakeholders to add value to business workflows using data and analytics.

Responsibilities

Develop a high-performance, scalable data lakehouse supporting sub-minute data latency and unified batch and streaming compute.
Manage complex change data capture flows and optimize distributed query engines.
Use AI to accelerate the development lifecycle.
Own high-throughput ingestion from relational database management systems to the lakehouse using Debezium or PeerDB.
Design and optimize Iceberg, Delta, or Hudi table formats for performance and storage efficiency.
Develop robust extract, transform, and load or extract, load, and transform frameworks in PySpark and Flink for batch and streaming workloads.
Manage data workloads on AWS, including EMR, EKS, MSK, and S3, and automate infrastructure using GitLab or GitHub Actions.
Tune Trino or ClickHouse to power real-time dashboards in Metabase, Superset, and Power BI.
Work with ingestion and change data capture tooling including OLake, PeerDB, Debezium, and Kafka to sync production systems into Alchemy, including Kafka- and S3-based sources.
Work with Alchemy on Apache Iceberg, S3 data lake storage, and AWS Glue Catalog; support Delta or Hudi exposure as applicable.
Develop batch and streaming workloads using PySpark on EMR or EKS, and use Flink and Spark Structured Streaming for low-latency pipelines.
Use MSK or Kafka for event-driven ingestion, change data capture propagation, replay, backfills, and operational monitoring through Kafka UI.
Use Trino over Alchemy or Iceberg for lakehouse analytics, ClickHouse for operational and real-time dashboards, and BigQuery where applicable.
Build Airflow pipelines and data-quality or reconciliation DAGs, manage backfills and SLA-driven jobs, and use Temporal for durable workflow execution in ingestion services.
Implement data-quality checks, freshness and SLA monitoring, source-to-lake reconciliation, deduplication, schema evolution handling, and cataloging and lineage through OpenMetadata.
Manage infrastructure and DevOps using AWS, Kubernetes, Terraform or other infrastructure-as-code, GitLab or GitHub Actions, Grafana or CloudWatch, and production runbooks.
Use Metabase, Superset, Tableau, and Power BI for business dashboards, and model curated marts, fact and dimension tables, slowly changing dimensions, and one-big-table patterns for stakeholder-facing analytics.

Desired Qualifications

Familiarity with Go, Java, or Scala.
Experience designing and optimizing Delta or Hudi table formats in addition to Iceberg.
Exposure to BigQuery.

About Fam (previously FamPay)

Fam is India’s first payments app for everyone above 11. FamApp helps make online and offline payments through UPI and FamCard. We are on a mission to raise a new, financially aware generation, and drive 250 million+ young users in India to kickstart their financial journey super early in their life.

We’re reimagining how the next generation experiences fintech—going beyond payments to build a lifestyle brand that blends money, identity, and everyday experiences into one seamless, intuitive journey.

Founded in 2019 by IIT Roorkee alumni, Fam is backed by some of the most respected investors around the world like Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital) India, Venture Highway, Global Founder’s Capital and the likes of Kunal Shah, Amrish Rao as angel investors.

About the role:-

We are looking for a Data Engineer II (SDE-2) to join our data team. The ideal candidate will be a play a key role to develop of high performant and scalable Data Lake-house, moving us toward a world of sub-minute data latency and unified batch/streaming compute. This is an engineering-heavy role where you will manage complex CDC flows, optimize distributed query engines and leverage AI to accelerate our development lifecycle.

Must Have Requirements-

Experience: 3–5 years in Data Engineering, specifically with distributed systems and cloud-native architectures.
Coding: Expert-level Python/PySpark and SQL. Familiarity with Go/Java/Scala is a plus
Infrastructure: Hands-on experience with AWS (S3, EKS, MSK) and Infrastructure-as-Code.
Orchestration: Experience with Airflow or Temporal for complex workflow management.
AI-Native: Proficiency in using AI tools (Claude, Codex, Copilot) to write, test, and document code efficiently.
Systems Thinking: Ability to explain the trade-offs between different storage formats and processing frameworks.
Tech Execution : Drive key tech initiatives by preparing TRD and actively involve in design reviews.
Domain Modelling - Should be hands on in designing Domain models for OLAP like Fact, Dimension, Cumulative , types of SCD’s and OBT pattern tables.
Self Starter - Lead the team technically and bring in new ideas to contribute to the growth of the charter.
Stakeholder Interaction - Interact with the Product & Key Stakeholders & help them by adding value to the business workflow with data & analytics.

Good to have -

Real-time CDC: Ownership of high-throughput ingestion from RDBMS to Lakehouse using Debezium, PeerDB.
Lakehouse Architecture: Designing and optimizing table formats (Iceberg, Delta, Hudi) for both performance and storage efficiency.
Unified Compute: Developing robust ETL/ELT frameworks in PySpark and Flink (handling both batch and streaming workloads).
Infrastructure & Ops: Managing data workloads on AWS (EMR, EKS, MSK, S3) and automating everything via Gitlab/Github Actions.
Query & BI: Tuning Trino or Clickhouse to power real-time dashboards in Metabase, Superset, and PowerBI.

Our Tech Stack-

Ingestion & CDC: OLake and PeerDB for near real-time sync from production systems into Alchemy; Debezium/Kafka for CDC-heavy use cases, with support for Kafka and S3-based sources.
Lakehouse / Storage: Alchemy on Apache Iceberg with S3 as the data lake storage layer and AWS Glue Catalog for metadata; exposure to Delta/Hudi is a plus.
Processing & Compute: PySpark on EMR/EKS for batch and streaming workloads; Flink and Spark Structured Streaming fundamentals for low-latency pipelines.
Streaming Platform: MSK / Kafka for event-driven ingestion, CDC propagation, replay, backfills, and operational monitoring through Kafka UI.
Query & Serving Layer: Trino over Alchemy/Iceberg for lakehouse analytics, ClickHouse for high-throughput operational and real-time dashboards, and BigQuery exposure where applicable.
Workflow Orchestration: Airflow for scheduled data pipelines, DQ/reconciliation DAGs, backfills, and SLA-driven jobs; Temporal for durable workflow execution in ingestion services.
Data Quality & Governance: DQ checks, freshness/SLA monitoring, source-to-lake reconciliation, deduplication, schema evolution handling, and cataloging/lineage through OpenMetadata.
Infrastructure & DevOps: AWS (S3, EKS, EMR, MSK), Kubernetes, Terraform/IaC, GitLab/GitHub Actions, observability via Grafana/CloudWatch, and production runbook discipline.
BI & Analytics: Metabase, Superset, Tableau, and PowerBI for business dashboards; strong ability to model curated marts, fact/dimension tables, SCDs, and OBT patterns for stakeholder-facing analytics.

Perks That Go Beyond the Paycheck

• Relocation assistance to make your move seamless.

• Free office meals (lunch & dinner).

• Generous leave policy, including birthday leave, period leave, paternity and maternity support, and more.

• Salary advance and loan policies for any financial help.

• Quarterly rewards and recognition programs, and a referral program with great incentives.

• Access the latest gadgets and tools.

• Comprehensive health insurance for you and your family, mental health support.

• Tax benefits with options like food coupons, phone allowances, car/device leasing.

• Retirement perks like PF contribution, leave encashment and gratuity.

Here’s all the tea on FamApp ☕️

FamApp focuses on financial inclusion of the next generation by providing UPI & card payments to everyone above 11 years old. Our flagship Spending Account, FamX, seamlessly integrates UPI and card payments, enabling users to manage, save, and learn about their finances effortlessly.

Revolutionizing Payments and FinTech

FamApp has enabled 10 million+ users to make UPI and card payments across India, removing the inconvenience of carrying cash everywhere. Users get to customise their FamX card with doodles, which lets them add a personal touch to their payments.

Trusted by leading investors

We’re proud to be supported by renowned investors like Elevation Capital, Y-Combinator, Peak XV (formerly Sequoia Capital India), Venture Highway, Global Founder’s Capital, and esteemed angels Kunal Shah and Amrish Rao.

Join Our Dynamic Team

At Fam, our people-first approach is reflected in our generous leave policies, flexible work schedules, comprehensive health benefits, and free mental health sessions. We don’t mean to brag, but we promise you’ll be surrounded by some of the most fun, talented and passionate people in the startup space.

Want to see what makes life at Fam so awesome? Check out our shenanigans at @lifeatfam 😛

PS - We’re looking for someone with an AI-native mindset, who actively leverages AI in their day-to-day work, as we encourage and embed it across every level at Fam.

About the Company

FamPay

Youth fintech platform for quick UPI payments

Fam (FamPay) runs a fintech platform in India focused on financial inclusion for teens (11+). It lets users pay via UPI in under two seconds, track expenses, and learn money management through teen-focused tools and cards, including a customised UPI/card and a numberless card with Tap & Pay. It also offers FamX by Trio, a membership with cashback, FamCoins, and occasional rewards. Its goal is to teach money skills and provide accessible digital payments for the next generation while earning revenue from transaction fees and membership fees.

Company size: 1,001-5,000
Company stage: Series A
Total funding: $42.8M
Headquarters: Bengaluru, India
Founded: 2019

Recently Posted Jobs

Explore more opportunities at FamPay

See more jobs