Facebook pixel

Data Engineer
Posted on 4/5/2022
INACTIVE
Locations
Remote • Overland Park, KS, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Apache Kafka
Data Analysis
Data Science
Docker
Elasticsearch
Git
MongoDB
NumPy
Pandas
Postgres
Redshift
Terraform
Python
NoSQL
Requirements
  • Bachelor's degree in computer science, data science or related technical field, or equivalent practical experience
  • Proven experience with relational and NoSQL databases (e.g. Postgres, Redshift, MongoDB, Elasticsearch)
  • Experience building and maintaining AWS based data pipelines: Technologies currently utilized include AWS Lambda, Docker/ECS, MSK
  • Mid/Senior level development utilizing Python: (Pandas/Numpy, Boto3, SimpleSalesforce)
  • Experience with version control (git) and peer code reviews
  • Enthusiasm for working directly with customer teams (Business units and internal IT)
  • Preferred but not required qualifications include:
  • Experience with data processing and analytics using AWS Glue or Apache Spark
  • Hands-on experience building data-lake style infrastructures using streaming data set technologies (particularly with Apache Kafka)
  • Experience data processing using Parquet and Avro
  • Experience developing, maintaining, and deploying Python packages
  • Experience with Kafka and the Kafka Connect ecosystem
  • Familiarity with data visualization techniques using tools such as Grafana, PowerBI, AWS Quick Sight, and Excel
Responsibilities
  • Work with Data architects to understand current data models and to build pipelines for data ingestion and transformation
  • Design, build, and maintain a framework for pipeline observation and monitoring, focusing on reliability and performance of jobs
  • Surface data integration errors to the proper teams, ensuring timely processing of new data
  • Provide technical consultation for other team members on best practices for automation, monitoring, and deployments
  • Provide technical consultation for the team with infrastructure as code best practices: building deployment processes utilizing technologies such as Terraform or AWS Cloud Formation
  • Medical: Fully-paid healthcare, dental and vision premiums for employees and eligible dependents
  • Financial: Generous company 401(k) contributions and employee stock ownership after one year
  • Wellness: Onsite gym, jogging trail and discounted membership to nearby fitness center
  • Work-Life Balance: Competitive PTO and paid leave options
Shamrock Trading

1,001-5,000 employees

Shamrock Trading is a financial services company.
Company Overview
Shamrock's mission to provide value and success for their customers, their partners and their people.
Benefits
  • Medical and Insurance Benefits
  • 401(k) and ESOP Retirement Plans
  • Work Life Balance Program
  • Wellness Program
  • Employee Assistance Program
  • Flexible Spending Accounts
  • Referral Bonuses
  • Local Discounts
Company Core Values
  • Strong ethics
  • Dedication to our customers
  • Close attention to the marketplace