Full-Time

Senior Data Engineer

Posted on 6/5/2024

Auctane

Auctane

1,001-5,000 employees

Provides shipping and logistics technology solutions

Data & Analytics

Senior

London, UK

Required Skills
Microsoft Azure
Python
Airflow
Apache Spark
SQL
AWS
Pandas
Data Analysis
Requirements
  • Software Engineering background
  • Experience developing and supporting data pipelines in Python and SQL
  • Experience with data processing frameworks like Pandas, Polars, dbt, or Spark
  • Experience with streaming data processing
  • AWS, Azure, or Google Cloud experience
  • Continuous integration/delivery environment experience
  • Knowledge of data orchestration solutions like Airflow, Oozie, Luigi, or Prefect
  • Knowledge of relational and non-relational database design
  • Knowledge of designing distributed systems
  • Experience with software engineering best practices
  • Production experience with large datasets
  • Knowledge of business intelligence and analytics tools
  • Understanding of data security issues
  • Experience with big data cloud technologies
  • MLOps knowledge
  • Interest in evaluating and adopting new technologies
Responsibilities
  • Contribute to the design, build, and operational management of data lake and analytics solution
  • Use technologies like Airflow, dbt, and Spark to process data
  • Develop frameworks for acquiring, processing, and monitoring data
  • Support Data Analysts and Data Scientists with automation and tooling
  • Deliver reliable software and data pipelines
  • Define and enforce automated data security and governance best practices
  • Mentor junior colleagues

Auctane provides a suite of technology solutions, including ShipStation, Stamps.com, Packlink, ShipEngine, and Metapack, to address logistic challenges with same-day delivery, intuitive shipping software, and a network of 3PL providers. The technology orchestrates the movement of millions of letters and packages globally, serving over 1,000,000 customers annually and reaching 250 countries and territories.

Company Stage

N/A

Total Funding

N/A

Headquarters

Austin, Texas

Founded

2011

Growth & Insights
Headcount

6 month growth

-1%

1 year growth

5%

2 year growth

18%