Simplify Logo

Full-Time

Data Infrastructure Engineer

AI/ML

Posted on 3/19/2024

Twilio

Twilio

5,001-10,000 employees

Cloud-based communication tools for developers

Data & Analytics
Robotics & Automation
Consulting
Hardware
Consumer Software
Enterprise Software
Design
Entertainment

Compensation Overview

$135.9k - $169.9kAnnually

+ Equity

Junior, Mid, Senior

Remote in USA

Category
DevOps & Infrastructure
Database Administration
Platform Engineering
Cloud Engineering
Required Skills
Airflow
Apache Spark
AWS
Natural Language Processing (NLP)
Data Analysis
Requirements
  • Experience using big data technologies (Airflow, Spark, pySpark, Presto, Athena)
  • AWS experience
  • Demonstrated prior experience in creating data pipelines for text data sets NLP/ large language models
  • Experience building and maintaining ETL (managing high-quality reliable ETL pipelines)
  • Previous experience in building data pipelines for conversational AI APIs
Responsibilities
  • Dive into our dataset and design, implement, and scale data pre/post-processing pipelines.
  • Work on applied ML solutions in the areas of query processing, data mining, cleaning, normalizing and modeling.
  • Design and build data platforms & frameworks for processing high volumes of data, in real-time as well as batch, that will be used across engineering teams.
  • Build data processing streams for cleaning and modeling text data for LLMs
  • Shape the decision-making process for data architecture to effectively deliver insights to the business.
  • Research and evaluate new technologies in the big data space to guide our continuous improvement
  • Collaborate with multi-functional teams to help tune the performance of large data applications
  • Partner with Data Engineering, IT, and business units to ensure the creation of high-quality data solutions that are consistent, clean, and integrated.
  • Conduct data exploration and profiling using analysis, design, and presentation tools.
  • Identify and assess business impacts resulting from strategic initiatives.
  • Deliver analytics solutions to support key business decisions and enhance operational efficiency.

Twilio provides a developer-first cloud platform that simplifies customer interactions worldwide. The company's use of cutting-edge technologies to tackle complex communication challenges and a transparent pricing model positions it well in the tech industry. Employees at Twilio benefit from an environment that values transparency and innovation, making it a prime workplace for tech professionals seeking to impact global communication solutions.

Company Stage

IPO

Total Funding

$768.1M

Headquarters

San Francisco, California

Founded

2008

Growth & Insights
Headcount

6 month growth

8%

1 year growth

-4%

2 year growth

-27%

Benefits

Vacation: Twilio offers generous annual time off in all countries for you to enjoy.

Healthcare: We are dedicated to helping our employees live longer and healthier lives through comprehensive health programs.

Retirement: Twilio cares about your retirement! We offer programs to help our employees plan for their retirement needs.

Family leave: At Twilio we recognize the importance of family. We offer generous maternity, paternity, and adoption leaves, as well as family medical care leave.

Earn your stripes: Build and present a Twilio app to earn your Twilio track jacket and receive $30 per month for e‑books for continued learning and education.

Catered meals: We provide a variety of snacks, drinks, and catered meals in each of our locations.

INACTIVE