Full-Time

Lead Data Engineer

Confirmed live in the last 24 hours

Truckstop

Truckstop

501-1,000 employees

Freight matching and logistics solutions provider

Automotive & Transportation
Financial Services

Compensation Overview

$139k - $155kAnnually

+ Bonus

Senior, Expert

Remote in USA

Category
Data Engineering
Data & Analytics
Required Skills
Kubernetes
Microsoft Azure
Python
MySQL
NoSQL
Apache Spark
SQL
Apache Kafka
Postgres
Docker
AWS
MongoDB
Linux/Unix
Snowflake
Requirements
  • Bachelor's degree or equivalent professional experience required; Computer Science or Engineering preferred.
  • Strong experience in SQL and Python.
  • Experience with relational SQL and NoSQL Databases; MS SQL, PostgreSQL, Snowflake, MongoDB, MySQL, MariaDB, Elastic stack.
  • Experience building and optimizing reliable, idempotent data pipelines (streaming or batch) using ETL tools such as Matillion, Apache NiFi, Kafka and Spark.
  • A successful history applying software engineering principles to build data infrastructure tools/libraries to automate and scale data pipelines.
  • Understanding of applying logging and metrics to monitor and detect data pipeline performance issues.
  • Solid understanding of Data warehousing theory and concepts.
  • Working knowledge of data modeling and source to target mapping with a demonstrated understanding of data schema design and indexes, when to apply fact-based vs. time-based vs. relational and when to apply NoSQL approaches such as key-value, document, and column data stores.
  • Understanding of Statistical and Machine Learning (ML) terminology with experience deploying and monitoring ML-models in a production environment.
  • Experience working in a modern cloud-based environment a plus; Azure, AWS, Docker, Kubernetes. Data Warehouse
  • Experience with Linux.
  • Familiarity with Kubernetes, Lambda functions, Cloud Watch, SNS, S3, Glacier.
  • Minimum of 8 or more years of experience.
Responsibilities
  • Create, automate, and maintain data pipelines. Assemble complex data sets that meet business requirements.
  • Extract, transform, and load data from a variety of data sources using SQL and big data tools and technologies.
  • Identify, design, and implement internal process improvement including automating manual processes, optimizing data delivery, re-designing infrastructure for greater reliability and performance.
  • Write and optimize queries, write lambda functions, perform source to target mapping and data modeling.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work as a member of the data engineering chapter on a development squad to deliver product features and resolve data related technical issues.
  • Work as a member of the data management center of excellence on data quality projects.
  • Work with information security to keep our data secure.
  • Work with data architects, database administrators, and data engineers to continually improve our data systems.
  • Work with IT operations to resolve data related technical issues and respond to data related major incidents.
  • Create data tools to assist data analysts and data scientists in building and optimizing our product into an innovative industry leader.
  • Troubleshoot operations and database issues for internal and external customers.
  • Perform incident resolution and root cause analysis of critical outages. Implement solutions to systematic failures. Provide on-call support, including after hours.
  • Assist with documentation of the environments that support our products.
  • Other duties as assigned.

Truckstop provides transportation technology and freight matching solutions, operating the first load board on the internet. Its services include load planning, transportation management, real-time rates, and negotiation tools, which help logistics professionals manage their operations efficiently. Truckstop also serves as the largest credit reporting entity in the industry, allowing users to find reliable freight partners. Brokers can post loads while carriers can search for available loads in real-time, streamlining the freight movement process. The goal of Truckstop is to empower carriers and brokers to enhance their business operations and improve freight transportation.

Company Stage

Private

Total Funding

N/A

Headquarters

New Plymouth, Idaho

Founded

1995

Growth & Insights
Headcount

6 month growth

6%

1 year growth

6%

2 year growth

6%
Simplify Jobs

Simplify's Take

What believers are saying

  • The appointment of experienced leaders like Andrea Johnston as Chief Revenue Officer and Joe Pergola as CFO signals strong leadership and potential for strategic growth.
  • Truckstop's continuous innovation in fraud prevention and security measures, such as Fraud Prevention Friday, enhances its reputation and reliability in the industry.
  • Recognition and awards, like the Distinguished Woman in Logistics Award, bolster Truckstop's brand and attract top talent.

What critics are saying

  • The competitive landscape with major players like DAT could pressure Truckstop to continuously innovate to maintain its market position.
  • Frequent leadership changes might lead to strategic misalignments and operational disruptions.

What makes Truckstop unique

  • Truckstop's introduction of pet verification badges and carrier vetting services highlights its commitment to niche, value-added services that enhance trust and security in the logistics industry.
  • The company's focus on innovative broker product offerings, such as identity verification and risk factors analysis using generative AI, sets it apart from traditional freight-matching platforms.
  • Truckstop's strategic partnerships, like the integration with MVMNT and FleetDrive 360, expand its ecosystem and provide comprehensive solutions for brokers and carriers.

Help us improve and share your feedback! Did you find this helpful?