Full-Time
Data Engineer
Confirmed live in the last 24 hours
Prophecy
51-200 employees
Low-code platform for data engineering workflows
Junior, Mid
Remote in USA
Remote with occasional travel to the office in Palo Alto, California.
You match the following Prophecy's candidate preferences
Employers are more likely to interview you if you match these preferences:
- Experience in Apache Spark, and you can write Python or Scala code
- Experience in complex data engineering (ETL) and have solved many performance issues with Spark jobs
- Experience in a technical customer-facing role - preferably solution engineering or wanting to do such a role
- Bachelor in CS (preferred)
- Be a resident expert in data engineering using Prophecy with Spark & Airflow
- Solve complex problems and educate
- Address complex customer issues related to Apache Spark and Data Warehouses
- Build automated tooling to solve repeatable problems
- Demonstrate ownership to drive to solution, be pro-active
- Participate in on-call rotation
- Help our customers (Fortune 500) onboard to the product, answering queries about Prophecy, Spark, and Airflow
- Provide best practices and guidance around pipeline runtime performance, usage of third-party libraries, CI/CD, and scheduling
- Build reusable Spark, SQL, and Airflow packages that solve repeated problems in data engineering (e.g., data quality, auditing, and connectors)
- Write high-performance Spark code
- Customer-facing Experience
- Ability to form relationships with executives and influencers
- Ability to present a convincing point-of-view to important decision-makers that leads them down a path of success
Prophecy provides a low-code platform for data engineering that simplifies the creation of data workflows and schedules. It utilizes technologies like Apache Spark and Apache Airflow to help users develop and manage their data processing tasks with less coding required. The platform includes features for searching metadata and tracking the lineage of data at the column level, which helps users understand the flow and transformation of their data. Unlike many competitors, Prophecy focuses on making data engineering accessible to users with varying levels of coding experience, particularly targeting medium to large enterprises. The goal of Prophecy is to enhance productivity and efficiency in data operations through its subscription-based service, allowing clients to optimize their data management processes.
Company Stage
Series B
Total Funding
$113.3M
Headquarters
San Francisco, California
Founded
2017
6 month growth
↓ -5%1 year growth
↑ 0%2 year growth
↑ 2%
Simplify's Take
What believers are saying
- Recent $47M funding round supports platform enhancement and customer base expansion by 2025.
- Growing demand for low-code platforms boosts Prophecy's market potential in data engineering.
- Cloud-native data platform trends create opportunities for Prophecy's expanded offerings.
What critics are saying
- Competition from Alteryx and Matillion may threaten Prophecy's market share.
- Rapid AI advancements could outpace Prophecy's feature integration, risking obsolescence.
- Reliance on third-party platforms like Databricks poses integration and business model risks.
What makes Prophecy unique
- Prophecy offers a low-code platform for data engineering, reducing development time and costs.
- The integration of generative AI in Prophecy's platform automates complex data processes.
- Prophecy's column-level lineage tracking enhances regulatory compliance and data management.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Health Insurance
Unlimited Paid Time Off
Wellness Program
Professional Development Budget
Company Equity
Life Insurance
FSA/HSA
Long Term Disability