Associate Data Engineer

Job Description

• Develop a deep understanding of Visa’s data assets and how they can be used to support Data Science activities across the company
• Execute data engineering projects ranging from small to large either individually or as part of a project team.
• Build and maintain ETL pipelines in Spark, Python or HIVE that process transaction and account level data and standardize data fields across various data sources
• Troubleshoot
• Design, develop, and maintain reusable data assets
• Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency
• Collaborate with Data Engineering teams in North America and other Global regions to production and maintenance of key data assets.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Required qualifications:

• Bachelor’s Degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
• Entry level experience of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, MLlib, GraphX, iPython, sci-kit,Pandas etc.)
• Working knowledge in writing and optimizing efficient SQL queries with Python, Hive, Scala handling Large Data Sets in Big-Data Environments.
• Experience managing large-scale datasets using Big Data and distributed processing platforms such as Hadoop, Hive and Spark
• Experience with Visualization Tools like Tableau, Power BI, D3
• Experience with modern DevOps practices (including Git and CI/CD)
• Experience with Unix/Shell and exposure to Scheduling tools such as Airflow.
• Strong problem-solving skills

Preferred qualifications:

• Functional knowledge of cloud computing platforms such as AWS, Azure or GCP
• Background in payments or banking