Oracle

Builds databases, business apps and cloud services

Senior Principal Consultant - Multiple Teams

Data EngineeringConfirmed live in the last 24 hours

Full-timeSão Paulo, State of São Paulo, BrazilNo salary listedIn-person

About the Job

Requirements

Practical experience with PySpark for large-scale data processing.
Proven experience with Apache Airflow, including DAG development, operator use, scheduling, monitoring, and troubleshooting.
Strong knowledge of SQL.
Strong orientation toward coding best practices and use of Git.
Experience with Databricks, Cloudera, AWS Athena, and Google BigQuery.
Experience with Oracle Cloud Infrastructure services, including Object Storage and familiarity with the OCI command-line interface for storage resources; Data Flow or Oracle Big Data Service; Oracle Database 19c or Autonomous Database (ADW, ATP, or similar); and familiarity with OCI Streaming.
Experience with data formats including Parquet, ORC, Avro, and JSON.

Responsibilities

Design, develop, and maintain scalable data pipelines using PySpark in OCI environments.
Build, orchestrate, and monitor workflows using Apache Airflow.
Integrate multiple data sources into the OCI ecosystem, including Object Storage, ADW, Streaming, OKE, and Compute.
Convert and migrate existing ingestion, transformation, and delivery processes to OCI for analytical consumption.
Optimize Spark jobs and ETL/ELT processes as needed to ensure performance and reliability.
Monitor pipeline executions, identify and resolve failures, and ensure operational stability.
Apply DataOps best practices, including automation, observability, and version control.
Collaborate effectively in a diverse environment with onshore specialists, architects, analysts, and project managers in English.

Engenheiro(a) de Dados (PySpark & Airflow)

Estamos em busca de um(a) Engenheiro(a) de Dados experiente, com sólida expertise em PySpark e Apache Airflow, para atuar em um projeto estratégico baseado em Oracle Cloud Infrastructure (OCI).

Principais Responsabilidades:

Projetar, desenvolver e manter pipelines de dados escaláveis utilizando PySpark em ambientes OCI.
Construir, orquestrar e monitorar workflows utilizando Apache Airflow.
Integrar múltiplas fontes de dados ao ecossistema OCI (Object Storage, ADW, Streaming, OKE, Compute).
Converter e migrar processos existentes de ingestão, transformação e entrega de dados para OCI, visando consumo analítico.
Otimizar jobs em Spark e processos de ETL/ELT para garantir performance e confiabilidade, conforme necessário.
Monitorar execuções de pipelines, identificar e resolver falhas, garantindo estabilidade operacional.
Aplicar boas práticas de DataOps, incluindo automação, observabilidade e controle de versão.
Colaborar de forma eficaz em um ambiente diverso com especialistas onshore, arquitetos, analistas e gerentes de projeto (em inglês).

Career Level - IC3

Requisitos Técnicos:

Experiência prática com PySpark para processamento de dados em larga escala.
Experiência comprovada com Apache Airflow (desenvolvimento de DAGs, uso de operadores, agendamento, monitoramento e troubleshooting).
Sólidos conhecimentos em SQL.
Forte orientação a boas práticas de código e uso de Git.
Experiência com Databricks, Cloudera, AWS Athena e Google BigQuery.
Experiência com serviços da Oracle Cloud Infrastructure (OCI), tais como:
- Object Storage e familiaridade com o uso do ocicli para recursos de armazenamento na OCI
- Data Flow / Oracle Big Data Service
- Oracle Database 19c ou Autonomous Database (ADW, ATP ou similares)
- Familiaridade com OCI Streaming
Experiência com formatos de dados como Parquet, ORC, Avro e JSON.

Requirements at a Glance

Experience Level: Expert

Benefits

401(k) Savings and Investment Plan with company match
Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
11 paid holidays
Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
Paid parental leave
Adoption assistance
Employee Stock Purchase Plan
Financial planning and group legal
Voluntary benefits including auto, homeowner and pet insurance

About the Company

Oracle

Builds databases, business apps and cloud services

Oracle builds databases, business applications, and cloud infrastructure for companies and public-sector organizations. Oracle Database stores and processes business data, while Oracle Cloud Infrastructure provides computing, storage, and networking for applications and AI workloads. Fusion Cloud Applications support finance, human resources, supply chains, and customer service, helping businesses manage everyday operations and reporting. Customers pay for cloud subscriptions and usage, software licenses, support, hardware, and consulting, with deployment options in Oracle's cloud or their own data centers. Oracle was founded in 1977 and is headquartered in Austin, Texas.

Company size: 10,001+
Company stage: IPO
Headquarters: Austin, TX
Founded: 1977

Recently Posted Jobs

Explore more opportunities at Oracle

See more jobs