Senior Data Engineer

Position Summary

The role will design, develop, test, deploy, and support secure, scalable data solutions that consolidate identity and access data from enterprise source systems into a centralized operational data store. The platform supports access visibility, operational reporting, risk analysis, remediation, automation, and decision-making across.

The engineer will contribute across the data-delivery lifecycle, including source-system discovery, data analysis, dimensional and relational modeling, ETL development, pipeline orchestration, data-quality validation, performance tuning, release automation, and production support. This role requires strong recent hands-on Microsoft SQL Server or Azure SQL engineering experience and the ability to deliver independently within an integrated Agile product team.

Key Responsibilities

• Design, develop, test, and maintain robust data pipelines and database solutions supporting the IAM Operational Data Store and related reporting applications.
• Analyze source-system data and translate business, reporting, risk, and control requirements into scalable conceptual, logical, and physical data models.
• Develop and optimize Microsoft SQL Server and Azure SQL objects, including complex queries, stored procedures, views, functions, indexing, partitioning, and transformation logic.
• Build repeatable ETL and ingestion patterns for identity, account, entitlement, credential, inventory, activity, certification, lifecycle, and control-related data.
• Develop and maintain SnapLogic pipelines and supporting scripts for data extraction, transformation, validation, reconciliation, and loading.
• Integrate data from cloud and on-premises sources using databases, APIs, Microsoft Graph, flat files, and other enterprise integration patterns.
• Create prepared-layer tables, source-to-target mappings, reusable transformation components, and reporting-ready datasets.
• Implement data-quality checks, reconciliation routines, health indicators, exception handling, logging, retry logic, and operational monitoring.
• Tune database queries, pipelines, and data models to improve performance, scalability, reliability, and cost effectiveness.
• Protect sensitive identity and access data by applying secure database design, least-privilege access, secrets-management, encryption, and data-handling practices.
• Build and maintain CI/CD pipelines and deployment processes supporting controlled promotion across development, quality-assurance, pre-production, and production environments.
• Perform unit, integration, regression, data-quality, and production-validation testing for ingestion pipelines and database changes.
• Troubleshoot data, application, pipeline, database, API, and deployment issues using logs, query plans, monitoring tools, and reconciliation evidence.
• Collaborate with analysts, product owners, architects, data-source owners, reporting engineers, security teams, and business stakeholders to define and deliver end-to-end data solutions.
• Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, code and design reviews, release readiness, and continuous-improvement activities.
• Create and maintain technical designs, data models, lineage documentation, implementation procedures, test evidence, operational runbooks, and support materials.

Required Qualifications

• Bachelor’s degree in computer science, data engineering, information technology, information systems, or a related field, or equivalent practical experience.
• Approximately 6–9 years of enterprise data-engineering, database-development, or related experience.
• At least five years of strong SQL development experience, including complex queries, stored procedures, performance tuning, indexing, and relational database design.
• Recent hands-on development experience within the last three years using Microsoft SQL Server, Azure SQL Database, or Azure SQL Managed Instance.
• Strong understanding of relational and dimensional data modeling, normalization, data warehousing, operational data stores, fact and dimension structures, and slowly changing dimensions.
• Experience designing, developing, and supporting ETL pipelines and data-ingestion solutions for high-volume, multi-source enterprise data.
• Experience with SnapLogic or a comparable enterprise integration platform.
• Proficiency in one or more supporting languages or tools such as Python, PowerShell, Unix shell scripting, or PL/SQL.
• Experience with Microsoft Azure data services and cloud-based database solutions.
• Experience implementing data-quality checks, source-to-target reconciliation, error handling, logging, monitoring, and operational support processes.
• Experience with Git-based source control, CI/CD pipelines, automated deployment, and tools such as Jenkins and Docker.
• Experience testing database changes, transformations, and end-to-end ingestion flows across multiple environments.
• Familiarity with Agile delivery practices and tools such as Jira and Confluence.
• Strong analytical, problem-solving, documentation, communication, and stakeholder-management skills.
• Ability to work independently, review existing solutions, identify gaps, and deliver production-ready enhancements with limited ramp-up time.

Preferred Qualifications

• Experience delivering data solutions for identity and access management, identity governance, privileged access management, cybersecurity, or technology-risk use cases.
• Familiarity with IAM data domains such as identities, accounts, entitlements, applications, credentials, privileged access, certifications, and lifecycle events.
• Experience building centralized operational data stores that support reporting, risk analysis, remediation, automation, and audit evidence.
• Hands-on experience with SnapLogic, including API, database, file, and cloud integration pipelines.
• Experience integrating Microsoft Graph, REST APIs, LDAP or Active Directory data, and structured or semi-structured file sources.
• Experience with Azure Data Factory, Azure Databricks, PySpark, Informatica, Snowflake, Oracle, PostgreSQL, or comparable data technologies.
• Familiarity with Microsoft SQL Server, PostgreSQL variants such as YugabyteDB or CockroachDB, Oracle, DB2, and cloud-hosted database inventory or audit data.
• Experience creating reporting-ready datasets for Power BI, Tableau, or comparable analytics platforms.
• Experience with graph databases or analytics platforms such as Neo4j.
• Familiarity with data lineage, metadata management, control reporting, and enterprise data-governance practices.
• Experience in a regulated financial-services environment and knowledge of secure software development, change management, and production-readiness controls.
• Relevant Microsoft Azure, database, data-engineering, or cybersecurity certifications.

Technology Environment

• Database and query development: Microsoft SQL Server, Azure SQL Database, Azure SQL Managed Instance, stored procedures, complex SQL, indexing, partitioning, query optimization, and relational data modeling.
• Data integration and engineering: SnapLogic, ETL pipelines, source-to-target mapping, prepared-layer tables, data profiling, transformation, reconciliation, data-quality checks, and lineage management.
• Cloud and source systems: Microsoft Azure, Microsoft Graph, REST APIs, Active Directory, Oracle, PostgreSQL, YugabyteDB, CockroachDB, DB2, Snowflake, structured files, and enterprise application data.
• Development and automation: Python, PowerShell, Unix shell scripting, PL/SQL, Git, Jenkins, Docker, CI/CD pipelines, automated testing, and deployment automation.
• Reporting and analytics: Operational reporting datasets, Power BI, Tableau, dashboard enablement, Neo4j graph analytics, and AI-assisted IAM analysis and remediation use cases.
• IAM ecosystem: Data from identity, account, entitlement, credential, inventory, certification, lifecycle, database, server, privileged access, and access governance systems/sources.

Success Measures

• Reliable, secure, scalable, and maintainable data pipelines delivered against sprint and release commitments.
• Accurate and timely ingestion of IAM data into the Operational Data Store across development, quality-assurance, pre-production, and production environments.
• Improved completeness, quality, traceability, and usability of identity and access data.
• High-performing SQL solutions and data pipelines that meet operational reporting and analytics requirements.
• Clear source-to-target mappings, data lineage, technical documentation, testing evidence, and operational runbooks.
• Successful data reconciliation and resolution of exceptions across integrated source systems.
• Reduced manual effort through reusable ingestion patterns, automated data-quality controls, and deployment automation.
• Effective collaboration with analysts, product owners, architects, data-source owners, reporting engineers, security teams, and business stakeholders.
• Consistent adherence to Fidelity security, data, architecture, engineering, change-management, and production-readiness standards.

What we offer you
At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers.

• The salary range for this job is:
  • New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices – $92,900 to $153,900
  • Bay Area California offices – $96,000 to $160,500
  • All other offices locations in the US, including Sacramento – $77,500 to $140,900
• Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography.  In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.

Are you ready to shape your future with confidence? Apply today.                                          

• To make the most of your application experience, please limit yourself to two applications within a six-month period.
• EY accepts applications for this position on an on-going basis.
• For those living in California, please click herefor additional information.
• At EY, our values set the foundation for how we work and the behaviors we expect of our people.  Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment.

EY  |  Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

All in to shape the future with confidence.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.  

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process,  please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at [email protected].