Having issues with Copilot?Please update to version 1.6.3 by going to Manage Extensions → Update

Sr. Data Engineer
Confirmed live in the last 24 hours
Theorem

51-200 employees

Technology underwriting & lending firm
Company Overview
Theorem’s mission is to bring access to credit to those who need it by connecting datasets to the people they represent. The company builds infrastructure to power their credit underwriting platform and funding network powered by machine learning to help their partners grow lending businesses.
AI & Machine Learning
Data & Analytics
Financial Services

Company Stage

Seed

Total Funding

$2.5M

Founded

2014

Headquarters

San Mateo, California

Growth & Insights
Headcount

6 month growth

2%

1 year growth

18%

2 year growth

133%
Locations
San Mateo, CA, USA • New York, NY, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Hive
Apache Spark
AWS
BigQuery
Apache Kafka
Jupyter
Airflow
Snowflake
SQL
Python
Looker
CategoriesNew
Data & Analytics
Requirements
  • A minimum of 4 years of Data Engineering experience at a technology company
  • An ability to partner with non-technical colleagues to transform business requirements into technical solutions
  • Experience building automated reports, dashboards, and visualizations of curated data, e.g. SQL, Jupyter, Looker
  • Experience assessing, implementing, and monitoring data validation and quality (correctness, completeness, availability, etc)
  • Fluency in SQL and Python
  • Deep expertise in relational data modeling, schema design, and normalization
  • Distributed computation/query frameworks, e.g. Apache Spark, Databricks, Presto
  • Distributed columnar data warehouses, e.g. AWS, Google BigQuery, Snowflake
  • ETL and data cataloging frameworks, e.g. Hive/AWS Glue, Fivetran, dbt
  • DAG/workflow management tools, e.g. Argo, Airflow
  • Streams/queues/event sourcing, e.g. Kafka, AWS MSK
  • Hardworking and gritty
  • Ethical, intellectually honest, and transparent
  • Detail-oriented
  • Proactive with communication
  • Collaborative and team success-oriented
  • Excited to learn and grow from feedback and experience
  • At home on small, high-impact teams
  • Thorough in your end-to-end ownership of outcomes
  • Biased towards action to solve problems
  • Advertised and actual salary ranges may differ by geographic area, work experience, education, and/or skill level
Responsibilities
  • Partner with stakeholders and senior leaders across Theorem to understand needs and set priorities for data-driven workflows
  • Design new capabilities for Theorem's data infrastructure
  • Develop robust software to support new and existing data initiatives across the firm
  • Contribute to the creation of an industry-leading loan modeling platform that will generate data around which the business will coalesce
  • Build complex data pipelines with high demands for correctness, speed, robustness, and availability
  • Grow as an engineer by working with and receiving mentorship from senior engineers at the firm
  • Availability and freshness of data through clear ETL ownership and automated alerting strategies
  • Integration of system operational data sources into the Theorem data warehouse
  • Quantification and tracking of data quality across all pipelines and build technology
  • End-user discovery and accessibility of data used across the firm by normalizing, standardizing, and cataloging all assets
  • Deprecation and removal of legacy data pipelines & reporting systems
Desired Qualifications
  • Experience with containerized environments, e.g. Kubernetes, Docker
  • Experience using Bazel
  • Previous financial experience in ABS (Asset Backed Securities)
  • Expected full-time salary range between $150,000 to $220,000 + + equity + benefits