C

Caterpillar

Makes heavy machinery, engines and gas turbines

IT Analyst Applications Data Engineer AI & Analytics

Data EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, India

About the Job

Requirements

  • A bachelor's or master's degree in computer science, Data Engineering, Industrial Engineering, or a related field.
  • At least 7 years of overall experience in data engineering.
  • Strong proficiency in Snowflake, SQL, Python, and ETL tools such as SnapLogic.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP, and data warehousing solutions such as Snowflake or Redshift.
  • Experience building feature pipelines and packaging and deploying models in batch or real time.
  • Familiarity with model serving tools such as Databricks Model Serving, MLflow, or Azure ML, as well as model registries and experiment tracking.
  • Familiarity with vector databases and retrieval-augmented generation (RAG) patterns.
  • Working knowledge of core application systems, including investigating application-related issues, recommending enhancements, and supporting contingency planning.
  • Working knowledge of problem-solving methods, including documenting problems and alternatives, evaluating risks and benefits, and using fact-finding and diagnostic tools.
  • Extensive experience with application design and architecture, including design reviews, technical alternatives, API integration, technical design documents, and designs spanning multiple technologies.
  • Working knowledge of application implementation, including tracking software quality issues, researching application software, drafting usage guidance, supporting end users, and implementing software under supervision.
  • Working knowledge of requirements analysis, including eliciting and documenting business requirements and following organizational standards and methods.
  • Working knowledge of system and technology integration across applications, databases, and platforms.
  • Working knowledge of system testing, including executing test cases, analyzing results, and testing against functional requirements.
  • Must work onsite in the office five days per week and work the 1:00 PM–10:00 PM IST shift.

Responsibilities

  • Design, build, and maintain scalable batch and streaming data pipelines for sources such as telematics and IoT, SAP, PLM, MES, service and warranty systems, and dealer systems.
  • Implement change data capture, schema evolution, and data quality checks using Great Expectations, Deequ, or custom approaches.
  • Develop feature pipelines for machine learning and analytics, including feature stores and time-series transformations.
  • Model data for lakes, lakehouses, and warehouses using formats such as Delta, Parquet, and Iceberg, following medallion or similar architectures.
  • Optimize partitioning, compaction, and performance for large datasets.
  • Partner with data scientists to productionize batch and real-time models, build inference pipelines and APIs, and manage feature stores.
  • Contribute to MLOps, including CI/CD for models and data, model versioning, monitoring, and drift detection.
  • Support generative AI use cases, including RAG pipelines, vector indexing, prompt orchestration, and governance.
  • Implement infrastructure as code, CI/CD, and observability capabilities such as lineage, cataloging, and logging and metrics.
  • Enforce security, privacy, and compliance practices, including personally identifiable information handling, role-based access, and data contracts.
  • Help create contingency plans to mitigate disruption to core applications and identify key players, criticalities, roles, and responsibilities.
  • Investigate application-related issues with business and IT professionals and recommend enhancements for major application systems or related subsystems.
  • Identify and document problems and resolution alternatives, assess information accuracy and relevance, and help analyze risks and benefits to support resolution decisions.
  • Facilitate application design reviews and walkthroughs, create and evaluate technical alternatives for complex applications, interpret and integrate application services such as APIs, and prepare technical designs and blueprints.
  • Track application software quality and effectiveness issues, research software benefits and drawbacks, draft application software usage for department needs, support end users, and implement designated software under supervision.
  • Confirm requirements-analysis deliverables, communicate with customers and users to elicit requirements, and participate in detailed requirements documentation.
  • Assist with integration initiatives, explore integration considerations, work with applications, data, technology bridges, and platforms, and participate in local integration efforts.
  • Support test planning and execution, evaluate system documentation and user manuals, execute test cases, analyze and report results, test components against functional requirements, and participate in recovery testing.

Desired Qualifications

  • Knowledge of core application systems used to deliver services to internal and external clients and the ability to use them in diverse situations.
  • Ownership, bias for action, and the ability to thrive in a product operating model.
  • Ability to bridge business and engineering through clear communication.
  • A pragmatic, security-first, automation-oriented mindset.
  • Ability to collaborate across global, cross-functional teams.

About the Company

Caterpillar

Makes heavy machinery, engines and gas turbines

Caterpillar makes construction and mining machines, diesel and natural gas engines, industrial gas turbines and locomotives for contractors, mines, energy companies and data center builders. It is the world's largest maker of construction and mining equipment, and its yellow Cat bulldozers and excavators work in nearly every country. Customers buy or rent machines through independent Cat dealers, while its engines and turbines generate electricity and push natural gas through pipelines. Caterpillar earns money from equipment sales and from the parts and repairs that dealers supply over a machine's working life. It was formed in 1925 when California's Holt and Best tractor companies merged, and it is based in Irving, Texas.

Company size
10,001+
Company stage
IPO
Headquarters
Irving, TX
Founded
1925

Recently Posted Jobs

Explore more opportunities at Caterpillar

See more jobs