Facebook pixel

Senior Data Engineer
Confirmed live in the last 24 hours
Locations
New York, NY, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
AWS
BigQuery
Development Operations (DevOps)
Docker
Google Cloud Platform
Jenkins
Git
Airflow
Linux/Unix
Ruby on Rails
SQL
Terraform
Kubernetes
Python
Ansible
Requirements
  • Expert-level proficiency with SQL - Ability to read others' complex queries and spot potential issues
  • Advanced proficiency with Python - experience developing and maintaining large codebases and reusable components, and writing Pythonic code
  • Proficiency with software development tools (IDEs, Git, Docker)
  • Experience with one or more data orchestration / workflow management frameworks, including Airflow
  • Significant experience with one or more data warehouse platforms
  • Experience with one or more cloud data ecosystems (AWS/GCP/Microsoft)
  • Proficiency with Linux, including script development and deployment automation (Ansible/Terraform)
  • Strong communication skills, including written and verbal communication
  • Apache Airflow
  • Google BigQuery
  • DevOps - Jenkins/Ansible/Terraform
  • Docker / Kubernetes
  • Informatica PowerCenter (used for legacy data pipelines)
  • Web Application development using Ruby on Rails
Responsibilities
  • Lead medium-scale data integration projects (spanning multiple weeks), breaking up larger objectives into smaller, self-contained tasks
  • Take direct personal responsibility for project goals, ensuring deadlines are met and stakeholders are kept informed of progress
  • Obtain subject matter expertise on data and pipelines for one or more business teams, and act as the go-to resource to resolve issues and answer questions as they arise for that area
  • Build strong relationships with one or more business teams, suggesting ways to leverage data technology capabilities to improve processes and deliver new insights
  • Run code reviews, providing feedback on code style and quality
  • Craft high-quality code that can be deployed to production with minimal guidance and feedback, run without major issues once deployed, and be easily understood by all other team members
  • Maintain and upgrade Airflow and other Data Engineering infrastructure, ensuring code and deployments are clean and reliable
  • Make medium-sized enhancements to DE-owned internal web applications, including Bullseye, Placement Generator, and Social Post Tagging tools. Oversee work of external consultants to make larger enhancements to these tools
  • Evaluate multiple architectural and engineering options to solve business challenges and select appropriate solutions. Proactively identify potential pitfalls and build sustainable solutions
Major League Baseball
Major League Baseball is a professional baseball organization.
Company Overview
Major League Baseball is a professional baseball organization.