V

Visa

Runs a global network for digital payments

Staff Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listed

About the Job

Requirements

  • A bachelor's or master's degree in Computer Science, Data Engineering, or a related field.
  • At least 8 years of hands-on data engineering experience, including enterprise-scale data warehousing and pipeline design.
  • Proven success supporting and modernizing SQL Server-based data warehouses in high-SLA environments.
  • Production-level experience architecting Hadoop, Spark, and Databricks data pipelines.
  • Expertise in ETL/ELT frameworks, data modeling, and schema design for analytical and operational use cases.
  • Strong programming proficiency in Python, Java, or Scala.
  • Hands-on experience with AWS or Azure, including Glue, Synapse, Redshift, Delta Lake, or S3.
  • Familiarity with Kafka, Airflow, Kubernetes, and containerized data services.
  • Understanding of RAG pipelines, vector databases, and AI data flows.
  • Experience designing data pipelines and APIs compatible with Model Context Protocol-based agent frameworks, enabling integration between AI agents, data services, and enterprise APIs.
  • Strong SQL optimization, debugging, and production troubleshooting experience.

Responsibilities

  • Implement the transition from a SQL Server data warehouse to a Hadoop/Databricks platform while maintaining performance, reliability, and minimal business disruption.
  • Develop hybrid data pipelines connecting legacy and modern ecosystems for near-real-time analytics and AI data access.
  • Optimize SQL Server models, including facts, dimensions, indexes, and stored procedures, and design modern equivalents in Hadoop and Spark environments.
  • Define migration strategy, data partitioning, and retention policies aligned with data governance standards.
  • Implement scalable distributed data pipelines using Spark, Kafka, Airflow, and Delta Lake.
  • Build ETL/ELT frameworks to process transactional, behavioral, and unstructured data at scale.
  • Partner with the Agentic AI team to support RAG pipelines, vector database integrations, and LLM data provisioning.
  • Lead proof-of-concept initiatives to evaluate and integrate data engineering technologies.
  • Guide junior engineers in maintaining SQL Server data warehouses, including performance tuning, replication, encryption, and high-availability solutions.
  • Implement T-SQL development, schema design, and stored-procedure optimization best practices.
  • Analyze performance proactively and troubleshoot and resolve production issues in SQL Server and Hadoop clusters.
  • Collaborate with DBA and application teams to meet uptime SLAs and comply with data policies.
  • Enforce data quality, lineage, and governance standards across legacy and modern platforms.
  • Ensure compliance with data privacy, encryption, and access-control frameworks, partnering with InfoSec on data security throughout the data lifecycle.
  • Mentor and coach junior data engineers.
  • Collaborate with product, ML, and platform engineering teams on architecture decisions and roadmap execution.
  • Connect legacy enterprise data teams with next-generation AI platform engineers to support knowledge continuity and execution.

Desired Qualifications

  • Experience developing data warehouse migrations or modernizations from SQL Server to Hadoop/Spark ecosystems.
  • Deep understanding of data lineage, metadata management, and governance frameworks such as Atlas and Great Expectations.
  • Familiarity with LangChain, LangGraph, and MCP for integrating AI agents with data systems.
  • Ability to balance innovation and stability across legacy and modern data architectures.
  • Track record of mentoring engineers and collaborating across global teams.

About the Company

Visa

Runs a global network for digital payments

Visa runs a global payment network that connects banks, merchants and consumers so card purchases and money transfers move between financial institutions. Its VisaNet system handles authorization, clearing and settlement, linking the bank behind a buyer's card with the bank that accepts a merchant's payment. The company earns fees from payment activity, transaction processing and international transactions, and sells fraud prevention tools, payment software and consulting services to businesses. Banks and other partners issue Visa branded cards and use its technology to build their own payment products. Visa traces its roots to a Bank of America card program launched in 1958 and is headquartered in San Francisco.

Company size
10,001+
Company stage
N/A
Total funding
$24.2M
Headquarters
San Francisco, CA
Founded
1958

Recently Posted Jobs

Explore more opportunities at Visa

See more jobs