Full-Time

Data Engineer

Shamrock Trading

Shamrock Trading

501-1,000 employees

Parent company for transportation, finance, and technology brands.

Fintech

Mid, Senior

Overland Park, KS, USA

Required Skills
Power BI
Redshift
Python
Airflow
Data Science
Data Structures & Algorithms
SQL
Postgres
AWS
Data Analysis
Requirements
  • Bachelor's degree in computer science, data science or related technical field, or equivalent practical experience
  • Experience extracting and manipulating data from a variety of sources, primarily cloud-based
  • Experience building and maintaining data pipelines and ETL/ELT jobs: currently utilizing Matillion, Databricks, and Airflow
  • Expertise in optimizing performance when loading into and extracting from relational and other data structures, including SQL tuning, indexing, etc.
  • 5+ years of development experience with the following, and Subject Matter Expert (SME) with at least one: Strong SQL writing and tuning skills, Designing and deploying jobs within Matillion or similar GUI-based ETL/ELT tool, Expertise in designing, developing, deploying and/or supporting data pipelines using Databricks (pySpark, pySQL, DLT), Relational Databases (MS SQL, PostgreSQL, Redshift), Demonstrated analytical and problem-solving skills, Strong communication and listening skills, ability to work directly with customer teams (Business units and internal IT)
  • Understanding the frameworks and principles of traditional data warehousing
  • Experience with data processing and analytics within AWS eco-system
  • Experience data processing using Parquet and Avro files
  • Working with event based / streaming technologies to ingest and process data
  • Development experience delivering analytics processes using Python
  • Experience with front-end BI and data visualization tools (such as Power BI, Grafana, and QuickSight)
Responsibilities
  • Work with Architects to understand current data models, to build pipelines for data ingestion and transformation
  • Design and implement pipelines and/or ETL/ELT jobs in order to centralize data from internal and external sources, focusing on reliability and performance of jobs and ensuring the quality and consistency of data is maintained at all times
  • Follow framework and code patterns established by Architects and Data Engineers for reliable job execution
  • Gather, understand and fulfill technical requirements from other units and provide necessary updates throughout the project lifecycle

Shamrock Trading Corporation, a diversified conglomerate in transportation, finance, and technology, is recognized for its strong company culture, prioritizing employee well-being with fully-paid healthcare, dental, and vision premiums, generous 401(k) contributions, and fitness amenities. Its rapid growth in the Kansas City metro area is testament to its competitive edge and industry leadership. The company's commitment to its employees, demonstrated through its consistent recognition as a "Best Place to Work," positions it as an attractive workplace.

Company Stage

N/A

Total Funding

N/A

Headquarters

Overland Park, Kansas

Founded

1986

Growth & Insights
Headcount

6 month growth

6%

1 year growth

22%

2 year growth

49%

Benefits

Medical and Insurance Benefits

401(k) and ESOP Retirement Plans

Work Life Balance Program

Wellness Program

Employee Assistance Program

Flexible Spending Accounts

Referral Bonuses

Local Discounts