Facebook pixel

Sr. Data Engineer
Confirmed live in the last 24 hours
Locations
New York, NY, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Jenkins
Git
SQL
Python
Requirements
  • 5+ years of hands-on experience in Python
  • 5+ years of hands-on experience in using advanced SQL queries and writing/optimizing highly efficient SQL queries
  • 2+ years of experience integrating with 3rd party APIs is required
  • 2+ years of experience of working in AWS environment is required
  • Comfortable working with business customers to collect requirements and gain a deep understanding of varied business domains
  • Experienced in testing and monitoring data for anomalies and rectifying them
  • Knowledge of software coding practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
  • Bachelor's degree or equivalent in an engineering or technical field such as Computer Science, Information Systems, Statistics, Engineering, or similar
  • Python (required)
  • SQL (required)
  • Git (required)
  • Developing solutions using Docker (required)
  • Data modeling for data warehousing (required)
  • Spark (nice to have)
  • Developing microservices (nice to have)
Responsibilities
  • Design, develop and maintain high-capacity and scalable data pipelines
  • Design, develop and maintain API based or file based ETL/ELT processes for raw data collection from multiple sources
  • Collaborate with other data engineers, data scientists and business intelligence engineers to build data solutions
  • Provide thought leadership and collaborate with other team members to continue to scale our architecture to evolve for the needs of tomorrow
  • Develop and support continuous integrations build and deployment processes using Jenkins, Docker, Git, etc
  • Define and implement monitoring and alerting policies for data solutions
Take Two
Game publisher