U

Upstart

Runs an AI lending marketplace for consumers

Senior Data Platform Engineer

Platform EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USA$166.9k - $230.9k

About the Job

Requirements

  • A bachelor's degree in Computer Science or a related field, or equivalent practical experience.
  • At least 5 years of experience in infrastructure engineering, DevOps, or data platform engineering.
  • Hands-on experience operating a lakehouse or big data platform such as Databricks, Snowflake, Apache Spark, Delta Lake, or Apache Iceberg.
  • Hands-on experience with AWS services such as IAM, S3, EC2, and EKS; Python; infrastructure as code using Terraform or CDK; CI/CD; and Kubernetes.

Responsibilities

  • Own the Databricks platform across multiple environments, including a newly launched regulated environment, expanding infrastructure as code for new Lakehouse features, enforcing a no-click-ops policy, establishing disaster recovery, implementing least-privilege and attribute-based access controls, ensuring environment isolation, and resolving known security risks.
  • Close compliance control gaps and automate evidence gathering for OCC, SOX, and SOC audits across access management, change management, and data quality.
  • Reduce Databricks and AWS spend through accurate cost attribution, waste detection, and platform-level optimizations, including compute rightsizing, improving pruning, migrating to Graviton and spot instances, and Delta Lake Archival.
  • Evaluate and adopt new technologies, including open-source lakehouse alternatives, to expand platform capabilities.
  • Improve developer efficiency and infrastructure reliability by working with Data Engineering, Machine Learning, Analytics, Compliance, and Security stakeholders.
  • Improve Lakehouse security, usage efficiency, and observability in collaboration with Data Engineering and Security teams.
  • Promote coding and engineering best practices and mentor junior team members.
  • Break down complex projects and requirements into quarterly commitments and sprints.
  • Own Lakehouse infrastructure components end to end, from technical requirements and design through rollout and production support.

Desired Qualifications

  • Experience implementing security and compliance controls in audited environments such as SOX, SOC 2, GDPR, GLBA, or OCC, including access management, encryption, and change management.
  • Experience reducing cloud or data platform costs through usage analysis, cost attribution, and infrastructure optimization, such as Graviton, spot instances, or storage tiering.
  • Proficiency in DevOps engineering using CI/CD tools such as Kubernetes, Jenkins, CDK, APM, and Terraform, and experience with automation, alerting, monitoring, security, and declarative infrastructure.
  • A solid understanding of cloud networking fundamentals.
  • Experience using AI coding assistants or agents to accelerate infrastructure development and operations.
  • Familiarity with distributed systems, data architecture design, and big data technologies such as Spark, Kafka, Lakehouse, and Databricks.

About the Company

Upstart

Runs an AI lending marketplace for consumers

Upstart runs an online lending marketplace where banks and credit unions use its AI models to decide which consumers get loans and at what rates. In 2017, it received the first no-action letter issued by the Consumer Financial Protection Bureau, a statement that the regulator had no plans to act against its AI lending model. Borrowers apply through Upstart or a partner lender's website for personal loans, auto loans, home equity lines of credit, and Cash Line, a revolving line of credit. Lenders pay Upstart fees for referring and approving borrowers and for collecting payments, while partner lenders and investment funds put up most of the money lent. Upstart was founded in 2012 and is based in Burlingame, California.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Burlingame, CA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Upstart

See more jobs