C

CI&T

AI-driven digital solutions and nearshore development

Senior Data Developer - Databricks

Data EngineeringConfirmed live in the last 24 hours
Full-timeRemote in BrazilNo salary listed

About the Job

Requirements

  • Strong experience with Databricks, including notebooks, jobs, workflows, clusters, and best practices for building scalable data solutions.
  • Proficiency in data processing using PySpark, Python, and SQL, with practical experience transforming raw data into reliable, well-organized datasets.
  • Experience with Delta Lake and Lakehouse architecture, including Delta tables, incremental processing, data optimization, and structured data layers.
  • Knowledge of the Azure data ecosystem, especially Azure Data Lake Storage, data integration patterns, and cloud data processing.
  • Experience supporting financial data pipelines, preferably involving reconciliation, P&L, financial close, or other business-critical processes.
  • Practical experience maintaining and improving existing pipelines, including troubleshooting, performance optimization, documentation, and production support.
  • Ability to work with structured and semi-structured data while ensuring quality, traceability, and readiness for analysis and strategic business use.
  • Problem-solving ability to investigate complex data, understand root causes, and propose practical solutions in challenging data environments.
  • Interest or experience with AI models and advanced data capabilities, supporting the integration of AI-based solutions into data workflows.
  • Spanish proficiency for interaction with global teams, technical discussions, and documentation.

Responsibilities

  • Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable, organized datasets.
  • Integrate new data sources into the existing ecosystem to expand platform capabilities and improve business visibility.
  • Support financial data reconciliation, P&L routines, and global close processes, ensuring data consistency, accuracy, and traceability across sources.
  • Process large volumes of structured and semi-structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices.
  • Monitor, troubleshoot, and support existing pipelines by identifying failures, investigating discrepancies, and ensuring reliable daily and monthly processing.
  • Contribute approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem.
  • Collaborate with data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high-quality data solutions.
  • Support data governance, validation rules, auditability, documentation, and controls to ensure financial data is reliable and well managed.
  • Support initiatives involving AI models and advanced data capabilities, helping integrate AI-based insights and automation into data workflows.

Desired Qualifications

  • Familiarity with AI frameworks and methodologies.
  • Experience with advanced capabilities such as Delta Lake optimization, Databricks Workflows, and Databricks Apps or Streamlit.
  • Experience with data quality and observability practices, including validation rules, reconciliation checks, monitoring, logs, alerts, and pipeline execution metrics.

About the Company

CI&T

AI-driven digital solutions and nearshore development

CI&T provides digital solutions to help brands transform their businesses through technology. It focuses on digital strategy and software engineering, offering services such as AI-powered solutions, customer-centric design, and nearshore software development. Products and engagements work by delivering tailored digital initiatives through long-term partnerships, project-based work, and ongoing maintenance; its MRVP approach helps navigate compliance in regulated industries while still enabling innovation. CI&T differentiates itself through a global delivery model, a focus on diversity and inclusion, and an emphasis on combining strategy, engineering, and design to drive business transformation. The company targets a wide range of clients, including regulated sectors and quick-service restaurants, and aims to help clients maximize resources, scale rapidly, and thrive in a post-digital transformation landscape.

Company size
5,001-10,000
Company stage
IPO
Headquarters
São Paulo, Brazil
Founded
1995

Recently Posted Jobs

Explore more opportunities at CI&T

See more jobs