A

Atlassian

Builds software for team planning and knowledge

Principal Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listed

About the Job

Requirements

  • You have 12+ years of experience in a Data Engineer role as an individual contributor.
  • You have at least 2 years of experience as a tech lead for a Data Engineering team.
  • You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts.
  • Experience with building streaming pipelines with a micro-services architecture for low-latency analytics.
  • Experience working with varied forms of data infrastructure, including relational databases such as SQL, Spark, and column stores such as Redshift.
  • Experience building scalable data pipelines using Spark and an Airflow scheduler/executor framework or similar scheduling tools.
  • Experience working in a technical environment with technologies such as AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
  • Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a Streaming First mindset.

Responsibilities

  • Own the technical evolution of the data engineering capabilities and ensure solutions are delivered incrementally, meet outcomes, and promptly escalate risks and issues.
  • Establish a deep understanding of data engineering, use it to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across teams.
  • Maintain a high bar for operational data quality and proactively address performance, scale, complexity, and security considerations.
  • Drive complex decisions that can impact data engineering; set the technical direction and balance customer and business needs with long-term maintainability and scale.
  • Understand and define the problem space, architect solutions, and coordinate a team of engineers toward implementation, unblocking them as needed.
  • Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help the manager grow the team.
  • Work with close counterparts in other departments as part of a multi-functional team, and build this culture in the team.
  • Develop backend systems and data models to serve the needs of insights and contribute to building Atlassian's data-driven culture.

Desired Qualifications

  • Built and designed Kappa or Lambda architecture data platforms and services.
  • Experience implementing Master Data Management (MDM) solutions.
  • Built pipelines using Databricks and is well-versed with its APIs.

About the Company

Atlassian

Builds software for team planning and knowledge

Atlassian builds software that helps businesses and other organizations coordinate projects, document knowledge and manage technology services. Its Jira and Confluence applications give teams shared spaces for tracking tasks and keeping decisions, plans and reference material connected to work. Software developers also use its tools to manage code, while business and IT teams organize requests and automate routine workflows. Customers pay recurring subscriptions for hosted software or self-managed licenses, with pricing linked to users and selected service levels. Atlassian was founded in 2002 and has its headquarters in Sydney, New South Wales, Australia.

Company size
10,001+
Company stage
IPO
Headquarters
Sydney NSW, Australia
Founded
2002

Recently Posted Jobs

Explore more opportunities at Atlassian

See more jobs