Full-Time

Senior DevOps Engineer

Multiple Teams

Posted on 9/30/2025

Prophecy

Prophecy

51-200 employees

Low-code data engineering for Spark/Airflow

No salary listed

Bengaluru, Karnataka, India

In Person

Category
DevOps & Infrastructure (1)
Required Skills
Datadog
Bash
Microsoft Azure
Python
CloudFormation
AWS
Go
Prometheus
Jenkins
Terraform
DevOps
Google Cloud Platform
Requirements
  • 4-8 years of overall system programming experience, with a few years of relevant engineering experience, specifically working on building infrastructure platform-as-a-service services
  • Proven experience in cloud cost optimisation (FinOps) across AWS, Azure, and GCP.
  • Strong hands-on knowledge of cloud services (compute, storage, networking, databases, containers).
  • Proficiency in scripting and automation (Golang, Python, Bash, Shell, or similar).
  • Experience with Infrastructure-as-Code (Terraform, CloudFormation, Pulumi, etc.).
  • Good understanding of CI/CD systems (Jenkins, GitHub Actions, GitLab CI, etc.).
  • Exposure to monitoring, logging, and observability tools (Datadog, Prometheus, ELK, etc.).
  • Background working in modern tech companies/startups focused on scaling and developer productivity.
  • Strong problem-solving skills, with the ability to balance cost, performance, and developer needs.
  • Strong desire to work in a not well-structured, fast-moving startup environment
  • B Tech or above degree in CS or equivalent.
Responsibilities
  • Lead comprehensive cost optimisation initiatives to optimise cloud spend across AWS, Azure, and GCP environments.
  • Analysis of AWS, Azure and GCP billing data, usage data from asset inventory and monitoring utilization data to assess across department cloud consumption, identify wasteful spend, and provide actionable insights to optimize spend.
  • Analysis of cloud spending across all departments based on the usage/trends.
  • Build and maintain automation for cloud infrastructure provisioning, scaling, and cost control.
  • Develop and maintain cost optimization strategies, roadmaps, and forecasting models.
  • Monitor, analyze, and report on cloud usage patterns to identify cost savings opportunities.
  • Partner with the rest of the engineering teams to design cost-efficient architectures without compromising scalability or reliability.
  • Develop internal tools and automation to improve developer productivity (CI/CD pipelines, observability, local dev environments, etc.).
  • Stay updated with modern DevOps, FinOps, and developer productivity tooling to continuously improve processes.
Desired Qualifications
  • Experience with Go
  • Full-stack infrastructure knowledge
  • Good understanding of computer architecture, networking, and CS fundamentals.
  • Proficiency in Linux.
  • Ability to assess new technologies and make pragmatic choices that help guide us towards a long-term vision.

Prophecy.io is a low-code data engineering platform that helps data teams build and manage Spark workflows and Airflow schedules. It offers a visual interface for designing jobs and schedules, plus metadata search and column-level lineage for governance. It targets medium to large enterprises and uses a subscription-based model for access to its toolkit. Its goal is to speed up development and improve reliability and observability of data pipelines.

Company Size

51-200

Company Stage

Series B

Total Funding

$116.5M

Headquarters

San Francisco, California

Founded

2017

Simplify Jobs

Simplify's Take

What believers are saying

  • Powers tens of thousands of pipelines for Fortune 500 companies across finance, healthcare, retail, technology.
  • Series B1 funding of $47M from Smith Point Capital, HSBC, JPMorgan Chase accelerates product expansion.
  • Claude Code agents democratize data prep for non-technical analysts, expanding addressable market beyond engineers.

What critics are saying

  • Databricks bundles native AI data prep tools, eroding Prophecy's value as standalone subscription add-on.
  • Snowflake Cortex Analyst generates SQL workflows natively, reducing dependency on external low-code platforms.
  • Anthropic enables Claude Code deployment directly via APIs, rendering Prophecy's proprietary wrapper obsolete.

What makes Prophecy unique

  • AI agents generate visual, inspectable workflows from business intent on Databricks, Snowflake, BigQuery.
  • Two-way visual-code editor keeps Git-stored production code synchronized with user refinements.
  • Unified self-service platform eliminates siloed systems, reducing rework and errors across data teams.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Unlimited Paid Time Off

Wellness Program

Professional Development Budget

Company Equity

Life Insurance

FSA/HSA

Long Term Disability

Growth & Insights and Company News

Headcount

6 month growth

0%

1 year growth

1%

2 year growth

3%
PR Newswire
Feb 24th, 2026
Prophecy launches v4 with AI agents for visual data prep on Databricks, Snowflake and BigQuery

Prophecy has launched v4, an AI data preparation and analysis platform that uses AI agents to convert business requirements into visual data workflows. The platform generates inspectable workflows that run natively on Databricks, Snowflake and BigQuery. The system addresses validation challenges in AI-generated data logic by making outputs visual and reviewable, rather than requiring users to check lengthy SQL or Spark code. Workflows are stored as production-grade code in Git and inherit governance policies from underlying data platforms. Prophecy v4 aims to replace legacy desktop tools by combining AI-driven productivity with cloud-native execution. The platform unifies data analysis steps into a single interface where users can iteratively refine results through conversational interactions with agents whilst maintaining synchronisation between visual workflows and code. The platform is available now with free accounts offered.

Taber Communications
Mar 28th, 2025
Prophecy 4.0 Offers Fully Governed Self-Service Data Prep for Databricks SQL

Additionally, Prophecy has introduced built-in automation with a drag-and-drop interface.

Prophecy
Jan 20th, 2025
Prophecy takes in $47M to scale-up and re-imagine data integration with AI

I’m pleased to share that Prophecy today announced a $47M Series B1 round. Smith Point Capital led the round, with HSBC joining as a new investor and participation from existing investors including Berkeley SkyDeck, DallasVC, Insight Partners, JPMorgan Chase and SignalFire.

FinSMEs
Jan 16th, 2025
Prophecy Raises $47M in Series B Extension Funding

Prophecy raises $47M in Series B extension funding.

SiliconANGLE Media
Jan 16th, 2025
Prophecy raises $47M for AI data pipelines

Prophecy Inc., a data copilot startup, raised a $47M Series B extension led by Smith Point Capital, with participation from HSBC and others. The company uses generative AI to automate data pipeline development, making data accessible across systems. Prophecy's copilot, integrated with Databricks, accelerates AI initiatives by simplifying data preparation. The funding will enhance its platform and expand its customer base by 2025.

INACTIVE