A

Alter Domus

Fund administration and corporate services provider

Senior Data Engineer

Data EngineeringUpdated on Nov 14
Full-timeUnited StatesNo salary listedIn-person

About the Job

Requirements

  • At least 7 years of data engineering experience, including substantial experience operating a cloud data platform in production.
  • Demonstrated technical leadership through mentoring engineers, leading design, and owning delivery of complex projects.
  • A Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
  • Strong hands-on Databricks experience with PySpark, Delta Lake, job orchestration, Spark performance tuning at scale, Unity Catalog governance, Asset Bundles or equivalent declarative deployment, and Auto Loader.
  • Advanced proficiency with dbt or a comparable SQL transformation framework, including testing and modular design, and strong dimensional and semi-structured data modeling skills.
  • Expert-level Python and SQL proficiency, with software engineering fundamentals in testing, documentation, and code quality.
  • AWS experience with S3, IAM, Secrets Manager, Lambda, Glue, and CloudWatch, and infrastructure as code using Terraform.
  • Airflow experience, ideally Amazon MWAA, including DAG design, dependency management, retries, and alerting.
  • Experience delivering data to consumers through warehouse shares, file exports, or APIs.
  • Experience with CI/CD for data pipelines using GitHub Actions or equivalent, containerization with Docker, and environment-promoted, version-controlled deployments.
  • Strong problem-solving and analytical ability, including a track record of resolving complex production issues.
  • Clear written and verbal communication, with the ability to influence stakeholders and explain trade-offs.
  • Comfort working in a fast-moving environment with shifting priorities and multiple concurrent client commitments.

Responsibilities

  • Design, build, and operate end-to-end data pipelines on Databricks using Lakeflow jobs, Delta Lake, and Databricks Asset Bundles, deployed through CI/CD across development, simulation, and production environments.
  • Implement pipelines using the medallion architecture, moving data from raw staging through cleansed and conformed layers to business-ready published tables, including quarantine handling for exception records.
  • Build ingestion from JDBC databases, file drops, SaaS APIs, and change data capture feeds using Auto Loader and incremental load patterns.
  • Operate and improve the existing Airflow (Amazon MWAA) environment and help migrate workloads to Databricks-native orchestration.
  • Tune Spark and SQL workloads for performance and cost, including partitioning, file layout, table maintenance, and appropriate use of serverless versus classic compute.
  • Design data models across the lakehouse and build modular, testable transformations in dbt, PySpark, and SQL for BI reporting, outbound client delivery, downstream APIs, and AI-assisted data access.
  • Build reconciliation and validation into pipelines, including control count checks across layers, deduplication, idempotent reprocessing, and self-healing recovery paths.
  • Own production support for pipelines, including monitoring, alerting, and root cause resolution against delivery service-level agreements, some measured in minutes.
  • Implement governance in Unity Catalog, including catalog and schema design, tagging, lineage, and group-based grants synchronized from the identity provider.
  • Work with platform and security teams on fine-grained entitlements so each client and internal team sees only permitted data in the multi-tenant environment.
  • Deliver data to clients and downstream systems through Snowflake and Databricks secure views and shares, file exports, and APIs, and support onboarding new clients onto the platform.
  • Model and publish curated, well-documented datasets for the AI engineering team.
  • Build and maintain Genie spaces that allow AI engineers and their agents to query platform data in natural language, including semantic metadata and metric definitions.
  • Build and operate Model Context Protocol (MCP) services that expose governed platform data to AI agents and applications, enforcing entitlements and audit logging at the access layer.
  • Provide technical leadership and mentorship to engineers, including distributed and offshore delivery teams, through design review, code review, and pairing.
  • Drive and document architectural decisions, set standards for pipeline development and testing, and contribute to the platform roadmap.
  • Communicate technical solutions to non-technical stakeholders and senior leadership, and translate business requirements into scalable technical designs.

Desired Qualifications

  • Exposure to Genie spaces, Databricks Apps, or Lakebase.
  • Working knowledge of Athena and Apache Iceberg.
  • Snowflake experience, including secure views, shares, and schemachange.
  • Understanding of how AI agents consume structured data through MCP or similar tool-based access patterns.
  • Databricks Data Engineer Associate or Professional certification.
  • AWS Solutions Architect or Data Engineer certification.
  • Experience supporting AI or analytics engineering teams as a data provider.
  • Experience in financial services, particularly private equity, private credit, real estate, or fund administration.

About the Company

Alter Domus

Fund administration and corporate services provider

Alter Domus provides fund administration, corporate services, depositary services, transfer pricing, domiciliation and management company services to asset managers, lenders and asset owners, with a focus on private equity, real estate and debt capital markets. It works through a vertically integrated model with dedicated teams and technology across the value chain, supporting both stand-alone funds and large multi-jurisdictional funds via a global network of 35+ offices and 3,300+ employees. The company differentiates itself by combining deep alternative-investment knowledge with end-to-end service coverage, sector-specific expertise, and broad geographic reach tailored to its clients. Its goal is to help clients grow and operate more efficiently by providing comprehensive, hands-on, scalable solutions across jurisdictions and asset classes.

Company size
1-10
Company stage
Not listed
Total funding
Not listed
Headquarters
Luxembourg, Luxembourg
Founded
2003

Recently Posted Jobs

Explore more opportunities at Alter Domus

See more jobs