Full-Time

Data engineer

Updated on 11/15/2024

Writer

Writer

1,001-5,000 employees

AI platform for business process optimization

Enterprise Software
AI & Machine Learning

Senior

New York, NY, USA

Category
Data Engineering
Data & Analytics
Required Skills
Python
Airflow
BigQuery
SQL
Apache Kafka
AWS
Google Cloud Platform
Requirements
  • 5+ years of hands-on experience in a data engineering role, ideally in a SaaS environment
  • Expert in SQL, dbt and Python
  • Advanced knowledge of data engineering tools, frameworks and languages (eg. Airflow, Airbyte, Kafka, github workflows)
  • Experience working with services in cloud environment (eg. AWS or GCP)
  • Care deeply about data quality, integrity and security
  • Thrive in ambiguity and can create paved roads from dirt paths
  • Bonus points if you have experience with product event/attribute tracking design and implementation
  • High intellectual curiosity and a proclivity to lean into a new subject matter
  • A trusted advisor and partner for all levels of the organization
  • Intrinsically motivated: you set the highest possible bar for what you build and ship
  • An eye for spotting an opportunity, intuition for determining which ones to prioritize, and courage to follow through
  • Possesses humility — no work is too trivial if it’s impactful
  • Resilient and open to honest (and kind) feedback; tough skin
  • Self-aware and committed to learning the why for both successes and failures
  • Proactive communication skills, both sync and async
  • Experience managing and building relationships across multiple departments and stakeholder levels
  • A natural affinity to our values of connect, challenge, own
Responsibilities
  • Own, build, and maintain data pipelines, ETL/reverse-ETL processes and BigQuery environment.
  • Implement an orchestration tool. Design a suite of tests and validations to ensure data consistency, accuracy and integrity.
  • Develop reliable and lasting data models, while optimizing for scale.
  • Catalog and document all aspects of our data pipelines. Create the foundation for a data governance program.
  • Partner with product and engineering teams to deliver data solutions that align with downstream use cases.
  • Establish data engineering best practices and serve as a subject matter expert on our data architecture, models and systems.

Writer.com offers a platform that enhances business processes using artificial intelligence, specifically through Large Language Models (LLMs), Natural Language Processing (NLP), and Machine Learning (ML). The platform is built on secure, enterprise-grade LLMs called Palmyra, which ensure client data is never used for training and can be self-hosted for better control. This allows businesses to generate customized outputs like summaries and insights while adhering to legal and brand guidelines. Writer.com stands out by prioritizing security and privacy, aiming to empower businesses to effectively integrate AI into their operations.

Company Stage

Series C

Total Funding

$317.1M

Headquarters

San Francisco, California

Founded

2020

Growth & Insights
Headcount

6 month growth

78%

1 year growth

400%

2 year growth

1214%
Simplify Jobs

Simplify's Take

What believers are saying

  • Writer.com's continuous innovation, such as the launch of Palmyra-Vision, positions it as a leader in enterprise AI solutions.
  • The company's strategic partnerships and high-profile clients, including Vanguard, Intuit, and Accenture, reflect strong market trust and potential for growth.
  • CEO May Habib's recognition as a Young Global Leader by the World Economic Forum highlights the company's leadership and influence in the AI industry.

What critics are saying

  • The rapid pace of AI advancements requires Writer.com to continuously innovate to stay ahead of competitors.
  • The complexity of integrating AI into diverse business processes may pose challenges in scalability and client-specific customization.

What makes Writer unique

  • Writer.com offers a secure, enterprise-grade AI platform with proprietary LLMs, Palmyra, which ensures data privacy and control, unlike many competitors who use client data for training.
  • The company's focus on integrating AI into all business processes, including generating text from images and multimodal AI capabilities, sets it apart from other AI providers.
  • Writer.com's ability to analyze up to 10 million words of company-specific information with advanced RAG technology provides a significant edge in data processing and customization.

Help us improve and share your feedback! Did you find this helpful?