Lead Data Engineering Platform Architect

Title:

Lead Data Engineering Platform Architect

Company:

Everest Global Services, Inc.

Job Category:

Technology

Job Description:

About Everest:

Everest is a global leader in risk management, rooted in a rich, 50+ year heritage of enabling businesses to survive and thrive, and economies to function and flourish. We are underwriters of risk, growth, progress and opportunity. We are a global team focused on disciplined capital allocation and long-term value creation for all stakeholders, who care deeply about our impact on communities and the wider world.

About the role:

As a Lead Data Engineering Platform Architect at Everest, you’ll take ownership of designing, building, and managing a modern data and analytics platform that powers our global insurance business. You’ll work with cutting-edge technologies like Databricks, Azure Data services, Airflow, and Kafka, and collaborate closely with Data Domain Delivery, Cloud Engineering, DevOps, and Information Security teams to deliver a platform that’s secure, scalable, and built for performance.

You’ll drive automation, observability, and governance across the platform, while mentoring teams and shaping Everest’s data architecture standards. You’ll also partner with data engineering and analytics teams to deliver reusable frameworks, MLOps pipelines, and semantic layers that support enterprise-wide insights.

This hybrid role is based in our Warren, NJ headquarters (3 days onsite / 2 remote).

Key Responsibilities:

• Platform Leadership

  • Architect and manage Everest’s Azure-based data platform using Databricks and cloud-native tools

  • Define and enforce data architecture standards, blueprints, and best practices

  • Lead adoption of emerging technologies through PoCs and pilot implementations

  • Translate business and technical requirements into an architectural blueprints, roadmaps and solution designs adhering to enterprise standards.

  • Provide technology leadership to delivery teams to build and operate data products effectively

• Engineering & Automation

  • Design and develop reusable components including data ingestion for structured and unstructured data, data transformation, logging, and observability

  • Drive MLOps and self-service analytics frameworks for model lifecycle management

  • Design end-to-end observability of all cloud resources and components, including performance, optimization, and FinOps alignment

  • Automate infrastructure and security using IaC, DevOps, RBAC/ABAC

• Collaboration & Governance

  • Partner with cross-functional teams to deliver scalable, resilient data solutions

  • Mentor engineering teams and elevate technical capabilities across the organization

  • Implement enterprise-wide governance, privacy, and FinOps-aligned performance monitoring

  • Stay updated with the latest trends, tools, and technologies in the field of data engineering. Proactively identify opportunities to improve data engineering practices and contribute to the evolution of data infrastructure.

Qualifications:

• A bachelor’s (required) or master’s (preferred) in Computer Science, Information Systems, or related field

• 10+ years in data engineering and architecture, with deep experience in Azure and Databricks

• In-depth experience in Medallion/Delta Lake Architecture, ML/AI, and Azure cloud services, Azure Data technologies such as ADLS, ADF, Fabric, SQL, Synapse, PowerBI etc.

• Strong experience in implementing in IaC automation, DevOps, RBAC/ABAC, MLOPS etc.

• Strong experience with orchestration tools such as Airflow and Event Driven data integration tools such as Kafka etc.

• Strong experience with programming languages and tools such as Python, PySpark, SQL etc.

• Proven success building scalable platforms in complex, global environments

• Experience deploying pipelines via Azure DevOps with code review and branching strategies

• Insurance industry knowledge (especially P&C) is a strong plus

• Strong communication, leadership, and stakeholder engagement skills

• Certifications in Azure and Databricks preferred

The base salary range for this position is $152,000 - $199,100 annually. The offered rate of compensation will be based on individual education, experience, qualifications and work location. All offers include access to a variety of benefits to employees, including health insurance coverage, an employee wellness program, life and disability insurance, 401k match, retirement savings plan, paid holidays and paid time off (PTO).

What if I don’t meet every requirement? At Everest we are dedicated to building an inclusive and authentic workplace. So, if you are excited about this role but your past experience doesn’t align perfectly with every element in the job description, we still encourage you to apply. You may be just the right candidate for this or other roles. Please let us know if you need any accommodations throughout the application or interview process.

Our Culture

At Everest, our purpose is to provide the world with protection. We help clients and businesses thrive, fuel global economies, and create sustainable value for our colleagues, shareholders and the communities that we serve. We also pride ourselves on having a unique and inclusive culture which is driven by a unified set of values and behaviors. Click here to learn more about our culture. 

• Our Values are the guiding principles that inform our decisions, actions and behaviors. They are an expression of our culture and an integral part of how we work: Talent. Thoughtful assumption of risk. Execution. Efficiency. Humility. Leadership. Collaboration. Inclusion and Belonging.
• Our Colleague Behaviors define how we operate and interact with each other no matter our location, level or function: Respect everyone. Pursue better. Lead by example. Own our outcomes. Win together.  

All colleagues are held accountable to upholding and supporting our values and behaviors across the company. This includes day to day interactions with fellow colleagues, and the global communities we serve. 

Type:

Regular

Time Type:

Full time

Primary Location:

Warren, NJ

Additional Locations:

Everest is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex (including pregnancy), sexual orientation, gender identity or expression, national origin or ancestry, citizenship, genetics, physical or mental disability, age, marital status, civil union status, family or parental status, veteran status, or any other characteristic protected by law. As part of this commitment, Everest will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact Everest Benefits at [email protected].

Everest U.S. Privacy Notice | Everest (everestglobal.com)