A

Arcana

Web3 data analytics for institutions

Staff Software Engineer - Data Platform

Data Management +1Confirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedHybrid

About the Job

Requirements

  • A Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.
  • At least 8 years of professional experience in data engineering, backend systems, or distributed systems.
  • Proven experience building scalable data platforms and large-scale data systems.
  • Strong experience with extract, transform, and load pipelines, data integration, and workflow orchestration systems such as Airflow or Temporal.
  • Hands-on experience in Python and SQL, with a strong understanding of data warehouse concepts.
  • Experience working with distributed online transaction processing and online analytical processing databases such as ClickHouse, PostgreSQL, Cassandra, or Elasticsearch.
  • Knowledge of messaging and streaming systems such as Kafka.
  • Experience with cloud platforms such as AWS or Google Cloud Platform and big data tools such as Spark.
  • A strong understanding of columnar storage systems and query optimization techniques.
  • A solid understanding of distributed systems fundamentals and associated tradeoffs.
  • Experience working with containers and orchestration tools such as Docker and Kubernetes.
  • Strong Linux fundamentals and system-level debugging skills.

Responsibilities

  • Design and build scalable data platform components for batch and real-time data processing.
  • Architect, develop, and operationalize large-scale data systems across ingestion, transformation, and serving layers.
  • Build and manage robust data pipelines ensuring high reliability, scalability, and cost efficiency.
  • Develop reusable frameworks and tooling to accelerate productivity for data engineers and data scientists.
  • Leverage Python, Airflow, SQL, and cloud platforms to build production-grade data solutions.
  • Optimize query performance and data models using columnar online analytical processing systems such as ClickHouse, Doris, and StarRocks.
  • Implement streaming and near real-time data processing systems.
  • Translate complex business requirements into scalable and efficient data platform solutions.
  • Work collaboratively with cross-functional teams and provide technical leadership and mentorship.
  • Drive architectural decisions by evaluating tradeoffs and selecting the right tools for the problem.

Desired Qualifications

  • Familiarity with modern data architectures such as Lakehouse, including Iceberg, Hudi, and Delta.

About the Company

Arcana

Web3 data analytics for institutions

Arcana provides specialized data analytics for the Web3 ecosystem. It offers proprietary datasets and advanced analysis tools to institutional investors, and operates on a subscription model that gives clients ongoing access to data and analytics for digital asset strategies and allocations. The product works by delivering high-quality, precise data and analytics through a subscription, helping clients make informed decisions and manage risk. Arcana differentiates itself through rigorous data integrity and accuracy, focusing on institutional customers such as hedge funds and large financial firms rather than consumer markets. The company's goal is to help clients mitigate risks and seize opportunities in the digital asset space by providing reliable, actionable insights that guide investment decisions.

Company size
1-10
Company stage
Seed
Total funding
$5.3M
Headquarters
Pasadena, CA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Arcana

See more jobs