H

Hewlett Packard Enterprise

Builds servers, networking and private cloud

AI/ML Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listed

About the Job

Requirements

  • At least 5 years of data analysis and engineering experience.
  • A bachelor's degree in computer science, Statistics, Informatics, Information Systems, or another quantitative field.
  • Working knowledge of API- or stream-based data extraction processes, such as the Salesforce API and Bulk API, and hands-on experience in web crawling.
  • Advanced web-crawling and scraping methods and tools.
  • Experience building end-to-end data engineering pipelines for semi-structured and unstructured data, including text, simple and complex table structures, images, video, and audio.
  • Python, PySpark, SQL, and relational database management systems.
  • Data transformation activities using ETL/ELT.
  • Working knowledge of SQL data warehouses such as Snowflake; administration experience is preferred.
  • Ability to collaborate cross-functionally and build working relationships across organizational levels.
  • Ability to handle sensitive information with attention to detail and accuracy, and a commitment to data-handling ethics.
  • Effective time management and ability to solve complex technical problems while anticipating stakeholder needs.
  • Comfort working with ambiguity and change when assessing stakeholder needs.
  • Ability to work independently and contribute as a team member.

Responsibilities

  • Develop, maintain, and optimize data pipelines, workflows, and a feature store to support seamless data ingestion and transformation in a scalable data solution.
  • Design, develop, implement, and architect data engineering pipelines with attention to performance and scalability, including data storage and processing.
  • Implement advanced data transformations and quality checks to ensure data accuracy, completeness, security, and consistency.
  • Integrate data from diverse sources for ingestion, transformation, and storage, leveraging AWS S3 and potentially Snowflake as a SQL data warehouse.
  • Create and implement advanced data models and schemas, and apply data governance and data management best practices.

Desired Qualifications

  • Snowflake data warehouse administration experience.
  • Experience with Databricks.
  • Familiarity with AWS services including S3, Glue, EMR, EC2, RDS, monitoring, and IAM.
  • Experience with Kafka, Spark, and Kafka streaming.
  • Workflow automation experience, such as using GitHub Actions.
  • Experience performing root cause analysis.

About the Company

Hewlett Packard Enterprise

Builds servers, networking and private cloud

Hewlett Packard Enterprise sells servers, storage, networking and hybrid cloud software to large companies, governments and service providers. Its GreenLake platform lets customers run on-premises hardware as a metered cloud service, and its Cray supercomputers run national lab and AI training workloads. The networking business, built on Aruba and Juniper Networks, supplies campus, data-center and routing equipment. Revenue comes from hardware sales, multiyear support contracts, financing and subscriptions. The company traces its roots to Hewlett-Packard, founded in 1939, became a separate public company in 2015 and is headquartered in Houston, Texas.

Company size
10,001+
Company stage
IPO
Headquarters
Houston, TX
Founded
1939

Recently Posted Jobs

Explore more opportunities at Hewlett Packard Enterprise

See more jobs