C

Cognite

Industrial data platform with AI

Senior Software Engineer

Backend EngineeringPosted on Nov 12
Full-timeBengaluru, Karnataka, IndiaIn-person

About the Job

Requirements

  • Six to twelve years of experience in distributed data systems, backend engineering, or platform engineering.
  • Strong programming skills in Scala, Java, or Python.
  • Experience with cloud platforms such as AWS, GCP, or Azure and data lake/object storage.
  • Deep expertise in Spark internals, including the Catalyst optimizer, partitioning, and performance tuning.
  • Hands-on experience with Flink and Kafka for streaming and batch workloads.
  • Ability to scale systems to 10K+ QPS, with foundations in JVM performance, garbage collection tuning, and memory management.
  • Experience building high-throughput REST/gRPC services and advanced caching with Redis/in-memory data structures.
  • Understanding of monitoring and observability tools including Prometheus, Grafana, and OpenTelemetry.
  • Ability to design distributed, secure, and resilient platforms.

Responsibilities

  • Build high-performance data pipelines using Spark, Flink, and Kafka to process terabyte-scale industrial datasets.
  • Develop low-latency APIs and services supporting thousands of concurrent users with sub-second response times.
  • Optimize time-series, sensor, and operational data storage and retrieval for massive scale.
  • Engineer distributed processing solutions, including real-time streaming that handles millions of events per second.
  • Design and evolve cost-efficient data lake architectures using S3/GCS and formats such as Parquet/ORC.
  • Optimize OLAP query performance across systems such as ClickHouse, Pinot, or Druid.
  • Build fault-tolerant, highly available systems with circuit breakers, retries, and distributed tracing.
  • Drive technical innovation through research, prototyping, and contributions to open source.
  • Collaborate with product and architecture teams to translate industrial data problems into scalable, production-grade solutions.

Desired Qualifications

  • Prior experience with large-scale data, OLAP systems, or industrial/IoT data.
  • Contributions to open source or experience in industrial data/AI platforms.

About the Company

Cognite

Industrial data platform with AI

Cognite provides cloud-based data and AI platforms for industrial companies to digitize and optimize operations. Its flagship Cognite Data Fusion connects OT, IT, and engineering data, unifying sensor data, maintenance logs, and 3D models into a real-time view of assets to improve performance and safety. Cognite Atlas AI is a low-code platform that lets engineers build AI agents for predictive maintenance, anomaly detection, and production optimization without deep coding. The company differentiates itself through deep cross-domain data integration for asset-heavy industries and a scalable cloud environment to accelerate industrial digitalization and deliver measurable value.

Company size
501-1,000
Company stage
Acquired
Total funding
$225.3M
Headquarters
Tempe, AZ
Founded
2016

Recently Posted Jobs

Explore more opportunities at Cognite

See more jobs