K

Kroll

Global risk management and investigations consulting

Senior Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • A bachelor's or master's degree in computer science, engineering, or a related field is required.
  • At least 5 years of proven experience in data engineering, delivering business-critical software solutions for large enterprises, with a consistent track record of success.
  • Experience writing ETL/ELT jobs is required.
  • Experience with Azure and the Databricks platform is required.
  • Experience with Python, SQL, and REST APIs is required.
  • Ability to reason about trade-offs is required.
  • Ability to work with an international team is required.

Responsibilities

  • Design and build scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment.
  • Develop robust, fault-tolerant ETL/ELT applications for data ingestion, transformation, and distribution to support analytics, reporting, and AI workloads.
  • Work with stakeholders and teams to assist with data-related technical solutions and support their data infrastructure needs.
  • Explore use cases, frameworks, and tools to enhance AI capabilities while ensuring data integrity, quality, and reliability.
  • Identify and implement infrastructure redesigns to improve scalability, optimize data delivery, and automate manual workflows.
  • Choose tools, services, and resources to build robust data pipelines.
  • Collaborate with cross-functional teams to understand data requirements, create data models, and deliver actionable insights.
  • Monitor, troubleshoot, and optimize jobs for performance, address data pipeline bottlenecks, and ensure cost efficiency.
  • Continuously improve engineering processes while balancing speed, quality, and business impact.
  • Coach, mentor, and provide technical guidance to junior engineers, fostering continuous learning and development.
  • Stay updated on emerging data engineering technologies and trends, and recommend and implement innovative solutions.

Desired Qualifications

  • Knowledge of cloud architecture principles, including compute, storage, networks, security, and cost.
  • Proficiency with open-source tools and frameworks such as FastAPI, Pydantic, Polars, Pandas, Delta Lake, Docker, and Kubernetes.
  • Knowledge of CI/CD, Git, or infrastructure-as-code concepts.
  • Project management skills, including prioritizing tasks and managing multiple projects simultaneously in an Agile environment.
  • Understanding of how data engineering feeds into Business Intelligence and reporting tools such as Power BI and Tableau.

About the Company

Kroll

Global risk management and investigations consulting

Preparing summary

Company size
5,001-10,000
Company stage
Not listed
Total funding
Not listed
Headquarters
New York City, New York
Founded
1932

Recently Posted Jobs

Explore more opportunities at Kroll

See more jobs