Simplify Logo

Full-Time

Data Engineer

Posted on 7/23/2024

Proxima

Proxima

Compensation Overview

$160k - $230kAnnually

Senior

New York, NY, USA

Category
Data Engineering
Data & Analytics
Required Skills
Redshift
Python
Airflow
Data Structures & Algorithms
SQL
Postgres
AWS
Requirements
  • 5-8 years of experience in software engineering experience in a production setting writing clean, maintainable, and well-tested code
  • Strong proficiency in object-oriented programming languages like Python, NodeJS or Go, with expertise in SQL languages like Redshift, SparkSQL or Postgres
  • Strong familiarity with PySpark and similar programming APIs
  • Familiarity with modern data file formats (Parquet, Avro) and table formats (Delta Lake, Iceberg, Hudi)
  • Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
  • Experience working with cloud services, Terraform, Airflow, Kubernetes, CI/CD, and working with modern cloud-based infrastructure: AWS RDS, DynamoDb, Redshift, Lambda, API Gateway.
  • Competitive understanding of data structures and types, data transformation, validation, and query performance tuning.
  • Experience debugging and performance tuning APIs and ETL jobs
  • Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context
  • Strong collaborator, ability to work cross functionally
  • Bachelor’s Degree or higher in Computer Science or similar field
Responsibilities
  • Manage AWS + Airflow infrastructure underlying our data platform
  • Build opinionated guardrails to drive improvements in data quality, cost efficiency, and data governance APIs and controllers that support our IAM, compute, and storage patterns
  • Software automation that connects our data services and surfaces metadata to downstream customers for discovery and data contract enforcement
  • Monitor our core systems and the mechanisms built on top
  • Collaborate effectively with a team of proficient software engineers to develop and maintain the fundamental platform that powers the cutting-edge Proxima’s data warehouse infrastructure
  • Engage in the complete data lifecycle, participating in the development of new revenue generating products
  • Design, Build and Deliver end-to-end data solutions to improve the reliability, scalability, latency and efficiency of the data platform
  • Implement automation for key elements of the development process, including data quality, managing alerts and handling critical infrastructure operations
  • Collaborate and Share on-call responsibilities, including incident management, with the larger engineering team
  • Guide and support fellow engineers within the team by serving as a mentor, while actively contributing to the sharing of knowledge through training sessions and comprehensive documentation

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A

INACTIVE