Senior Data Engineer

The role

We're looking for a Senior Data Engineer to help the team deliver data science services and streaming data pipelines. Over the course of your time with Quanata, you will have the opportunity to develop data pipelines that bring together data from multiple sources to evaluate insured risk, deliver services that enable data science models, and enable business and partner access to key datasets.

Your day-to-day

1. Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence.
2. Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making.
3. Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries.
4. Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference.
5. Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets.
6. Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments.
7. Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems.
8. Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists.
9. Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value.

About you

• Bachelor's degree or equivalent relevant experience and;
• 6-8 years of industry experience in data engineering or software engineering with a focus on data systems.
• Strong proficiency in Python and SQL for data pipeline development and analysis.
• Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions).
• Familiarity with Snowflake or similar cloud data platforms.
• Familiarity with streaming technologies such as Kafka or Kinesis.
• Experience with workflow orchestration tools (Airflow, Step Functions, or similar).
• Proficiency in infrastructure-as-code tools like Terraform.
• Understanding of data modeling principles.
• Excellent written and verbal communication with a strong collaborative focus.
• Experience with CI/CD tailored for machine learning systems (e.g., automating model training, validation, and deployment)

Bonus points

• Prior experience working within the insurance industry or another highly regulated environment, demonstrating an understanding of pertinent regulatory, security, and data governance challenges.
• Familiarity with ML infrastructure and supporting data science teams in productionizing models.
• Experience designing and building feature stores or real-time feature serving systems.
• Exposure to data governance and cataloging tools (e.g., DataHub, Atlan, or similar).

Salary: $215,000 to $300,000*

*Please note that the final salary offered will be determined based on the selected candidate's skills, and experience, as well as the internal salary structure at Quanata. Our aim is to offer a competitive and equitable compensation package that reflects the candidate's expertise and contributions to our organization.

Additional Details: 

• Benefits: We provide a wide variety of health, wellness and other benefits.These include medical, dental, vision, life insurance and supplemental income plans for you and your dependents, a Headspace app subscription, monthly wellness allowance and a 401(k) Plan with a company match.
• Work from Home Equipment: Given our virtual environment— in order to set you up for success at home, a one-time payment of $2K will be provided to cover the purchase of in-home office equipment and furniture at your discretion. Also, our teams work with MacBook Pros, which we will deliver to you fully provisioned prior to your first day.
• Paid Time Off: All employees accrue four weeks of PTO in their first year of employment.  New parents receive twelve weeks of fully paid parental leave which may be taken within one year after the birth and/or adoption of a child. The twelve weeks is applicable to both birthing and non-birthing parent.
• Personal and Professional Development: We’re committed to investing in and helping our people grow personally and professionally.  All employees receive up to $5000 each year for professional learning, continuing education and career development.  All team members also receive LinkedIn Learning subscriptions and access to multiple different coaching opportunities through BetterUp.
• Location: We are a remote-first company for most positions so you may work from anywhere you like in the U.S, excluding U.S. territories. For most positions, occasional travel may be requested or encouraged but is not required. Some positions might require travel per the job description provided to the employee. Employees based in the San Francisco Bay Area or in Providence, Rhode Island may commute to one of our local offices as desired.  
• Hours: We maintain core meeting hours from 9AM - 2PM Pacific time for collaborating with team members across all time zones.