Simplify Logo

Full-Time

Data Engineer

Posted on 7/13/2024

Dataiku

Dataiku

1,001-5,000 employees

AI solutions for operationalizing business processes

Data & Analytics
Enterprise Software
AI & Machine Learning

Compensation Overview

$140k - $165kAnnually

+ Stock Options

Mid

Detroit, MI, USA

Must be currently located within the EST or CST regions of the United States. Open for candidates based in the UK, if they have the right skillset.

Category
Data Engineering
Data & Analytics
Required Skills
Microsoft Azure
Python
Git
SQL
Jenkins
Data Analysis
Snowflake
Requirements
  • 3-4 years' of relevant experience in Data Engineering / Data Platform Engineering / Data Architecture
  • Expertise in SQL & Python
  • Prior experience with Snowflake strongly desired
  • Prior experience with DevOps technologies such as Github Actions, Azure DevOps or Jenkins
  • Strong understanding of data architecture & data modeling concepts
Responsibilities
  • Be an expert level engineer within the Dataiku Platform
  • Be an expert level engineer within Snowflake for data engineering and security/governance features
  • Build & maintain python & SQL data replication & data pipelines on large & often complex data sets
  • Build & maintain data quality metrics & observability to help drive data quality standards
  • Design data models for both short term and long term use cases to support data warehouse scalability
  • Build & maintain administration systems and applications for monitoring, alerting, data observability, access management, platform metrics, and end user transparency
  • Identify opportunities for improvements & optimization for greater scalability & delivery velocity
  • Collaborate closely with Analytics Engineers to provide data & data models for analytical deliverables
  • Perform root cause analysis on often complex errors to help ensure data pipeline availability
  • Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data quality frameworks, data access security & governance frameworks, DataOps processes & data consumption models
  • Help test new features in Dataiku and partner tools to both provide feedback internally as well as determine value towards internal analytics & data platform integration
  • Work closely with key stakeholders across the organization including Infra, embedded analytics teams, Product and Engineering to help foster both technical implementations & requirements gathering
  • Promote the Data Platform internally, help train & mentor others within the organization with technical excellence, & provide support on data & platform related inquiries
  • Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform, team or company as a whole
  • Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices

Dataiku creates AI solutions that help businesses integrate artificial intelligence into their daily operations. Their offerings include Generative AI, which generates new content or predictions, and MLOps, which enhances collaboration between data scientists and operations teams. A key achievement is helping a retail client improve its forecasting speed by 900% with high accuracy. Dataiku aims to empower businesses to effectively use AI to enhance their forecasting and data processing.

Company Stage

Series F

Total Funding

$1.2B

Headquarters

New York City, New York

Founded

2013

Growth & Insights
Headcount

6 month growth

3%

1 year growth

2%

2 year growth

5%
Simplify Jobs

Simplify's Take

What believers are saying

  • Dataiku's recognition as a Leader in Gartner's Magic Quadrant for DSML Platforms underscores its industry leadership and credibility.
  • Strategic partnerships with firms like Rower Consulting and Teragonia expand Dataiku's reach into specialized sectors such as pharmaceuticals and private equity, enhancing its market influence.
  • The launch of innovative tools like Dataiku Answers and LLM Cost Guard demonstrates the company's commitment to addressing emerging needs in generative AI and cost monitoring.

What critics are saying

  • The high financial commitment required for generative AI projects may strain budgets and limit adoption among smaller enterprises.
  • Challenges in fully operationalizing AI, as highlighted by the survey, could slow down the implementation and effectiveness of Dataiku's solutions.

What makes Dataiku unique

  • Dataiku's focus on operationalizing AI sets it apart by integrating AI into everyday business operations, unlike competitors who may only offer standalone AI solutions.
  • Their partnership with AWS as a Global ISV AI/ML Partner of the Year enhances their connectivity and scalability, providing a seamless integration with AWS AI services.
  • Dataiku's platform centralizes data science, transformation workflows, and decision models with robust governance, offering a comprehensive solution for AI implementation.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health, life & pension benefits

Equity

Time off for R&R

Public holidays

Work from anywhere policy (unique to team)

12 weeks of paid parental leave

Volunteering opportunities

Career Development opportunities

Technology stipend

Onsite meals & healthy snacks

Office happy hours

Company-wide events

INACTIVE