Databricks Architect

databricks ARCHITECT

12-15 YRS 

PUNE/BANGALORE/HYDERABAD

What's this role about?

As Databricks Architect, you will be responsible for providing advisory and thought leadership on the provision of analytics environments leveraging Cloud based platforms, big data technologies, including integration with existing data and analytics platforms and tools. You will contribute in pre-sales and design, implement scalable data architectures, and information solutions covering data security, data privacy, data governance, metadata management, multi-tenancy and mixed workload management, and provide delivery oversight.

The Databricks Architect at Zensar participates in end to end cycle from opportunity identification to its closure and takes up complete ownerships of project execution and provide valuable expertise in the project. You will do this by:

• Responding to client RFI, RFP documents with proper solution design including cost estimates 
• Understanding customer requirements and create technical proposition
• Contributing to SoWs, technical project roadmaps, etc required for successful execution of projects leveraging Technical Scoping & Solutioning approach 
• Managing and owning all aspects of technical development and delivery
• Understanding requirements and writing technical documents
• Ensuring code review and developing best practises
• Planning end to end technical scope of the project and customer engagement area including planning sprint and delivery 
• Estimating effort, identifying risk and providing technical support whenever needed
• Demonstrating the ability to multitask and re-prioritizing responsibility based on dynamic requirements
• Leading and mentoring teams as needed

Skills required to contribute:

12-15 Years of Data and Analytics experience with minimum 6+ Years in Big Data technologies and minimum 3 years in Azure / AWS / GCP Data Cloud native services including experience in Databricks

1. Excellent communication and presentation skills.
2. Hands-on experience with the Big Data stack (HDFS, SPARK, MapReduce, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka) as well as with the No-SQL (e.g. MongoDB, HBase, Cassandra)
3. Experience in job scheduling using Oozie or Airflow or any other ETL scheduler 
4. Experience working on cloud platforms (AWS/Azure/Google Cloud) to analyze, re-architect and re-platform on-premise data warehouses to cloud using native or 3rd party services.
5. Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala and good understanding of Delta lake.
6. Good experience in designing & delivering data analytics solutions using Azure, AWS or GCP Cloud native services.
7. Good experience in Requirements Analysis and Solution Architecture Design, Data modelling, ETL, data integration and data migration design
8. Well versed with Waterfall, Agile, Scrum and similar project delivery methodologies.
9. Experienced in internal as well as external stakeholder management
10. Experience in MDM / DQM / Data Governance technologies like Collibra, Atacama, Alation, Reltio will be added advantage.
11. Databricks / SPARK or Cloud Data certification will be added advantage.
12. Nice to have skills: Working experience with Snowflake, Reporting tools like Power BI/Tableau, Unix etc.

Take part in and host regular knowledge sharing sessions, mentor more junior members of the team and support the continuous development of our practice. 

We also want you to:  

• Share project stories with the wider business. 
• Provide recommendations and best practices for application development, platform development, and developer tools
• Actively stay abreast on industry best practices, share learnings, and experiment and apply cutting edge technologies
• Provide technical leadership and be a role model/coach to software engineers pursuing technical career path in engineering
• Provide/inspire innovations that fuel the growth of Intuit as a whole and generate creative ideas for emerging business needs
• Create content to promote your personal brand and Zensar to the world.
• Live Zensar's values, both, internally and externally