Full-Time

Manager – Data Integration

Technology Focus, Streaming

Confirmed live in the last 24 hours

MSD

MSD

No salary listed

Mid, Senior

Hyderabad, Telangana, India

Category
Data Engineering
Data & Analytics
Required Skills
Bash
Kubernetes
Agile
Python
Git
Node.js
Apache Spark
SQL
CloudFormation
JIRA
Jenkins
Terraform
Confluence
Linux/Unix
Requirements
  • Bachelor’s degree in information technology, Computer Science, or equivalent experience
  • Minimum of 3+ years of developing data pipelines & data infrastructure, ideally within a drug development or life sciences context with a focus on data streaming from technology and capability perspective
  • Strong proficiency in data streaming technologies like spark structured streaming with hands-on experience in means for change data capture as the primary skill
  • Strong working knowledge of at least one large-scale data processing technology (e.g., High-performance computing, distributed computing), databases, and underlying technology (cloud or on-prem environments, containerization, distributed storage & databases)
  • Experienced in software/data engineering practices (including versioning, release management, deployment, agile & related software tools - GitHub Actions, Jenkins, Cloudbees CD, Terraform, Cloudformation, Kubernetes etc)
  • Cloud-native, ideally AWS certified
  • Programming experience (Python, PySpark, SQL, Bash, Node.js, Linux and, Unix Shell, etc)
  • Familiarity with agile methodologies, user-centric design principles, and product lifecycle management is crucial
  • You must also ensure substantial documentation using collaborative tools such as Confluence, JIRA, and Digital SDLC
  • Basic QA and testing knowledge
  • Good interpersonal and communication skills (verbal and written)
  • Product and customer-centric approach
  • Innovative thinking, experimental mindset
Responsibilities
  • Work with platform engineering team for the build and maintenance of the infrastructure required to host our data engineering ecosystem, including managing cloud resources, containerization, and orchestration
  • Drive the technical implementation and manage the adoption
  • Understand customer needs and product relations within the wider Data Integration and Central Data and Analytics ecosystem
  • Design and implement data streaming solutions using spark structured streaming for real-time data processing and analytics
  • Participate in setting the team goals and defining product roadmaps
  • Participate in the product development and be responsible for product enhancements
  • Be part of the product team, participate in the backlog prioritization, provide estimation, and ensure seamless delivery
  • Work in a cross-functional set up to ensure the platform's operation, seek optimization and help manage its overall cost
  • Support the platform adoption by constantly and proactively collecting feedback
Desired Qualifications
  • Innovative thinking
  • Experimental mindset

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A