B

BMC Software

IT management software for mainframes

Lead AI Engineer

AI Application EngineeringPosted on Nov 11
Full-timeIndia

About the Job

Requirements

  • Eight to thirteen years of relevant experience.
  • A Bachelor's or Master's degree in Computer Science, AI, ML, or a related field, or equivalent experience.
  • Hands-on experience with large language models such as OpenAI, Anthropic, Gemini, Llama, or equivalent.
  • Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar, and agentic software development kits as appropriate to the level.
  • Understanding of prompt engineering, tool and function calling, planning, reasoning, and workflow orchestration.
  • Experience with Python, REST APIs, microservices, cloud platforms, containers, CI/CD, and testing.
  • Experience with evaluations for large language model, retrieval-augmented generation, and agent use cases; observability tools such as Langfuse, OpenSearch, and OpenTelemetry as appropriate to the level.
  • Multi-team adoption of patterns or practices the candidate led.
  • Ability to set technical direction for an AI area, beyond delivering features.
  • Ability to balance innovation speed with enterprise quality, safety, and cost.
  • Strong communication and ownership mindset.

Responsibilities

  • Design, develop, and maintain enterprise-grade agentic AI applications using modern large language models and AI frameworks.
  • Build autonomous and semi-autonomous AI agents capable of planning, reasoning, decision-making, and task execution.
  • Develop multi-agent systems and orchestrate interactions between agents, tools, APIs, and enterprise applications.
  • Integrate AI agents with internal and external services through APIs, databases, messaging systems, and workflow engines.
  • Build and deploy retrieval-augmented generation solutions using vector databases and enterprise knowledge sources.
  • Optimize AI workflows for performance, scalability, reliability, and cost efficiency.
  • Implement observability, monitoring, guardrails, and governance mechanisms for production AI systems.
  • Build and run agent evaluations by defining evaluation sets, testing behavior, and iterating on prompts, tools, and workflows.
  • Package and deploy solutions in production and apply diagnostics across the AI stack.
  • Collaborate with product teams, architects, and stakeholders, and contribute to reviews, documentation, and best practices.
  • Define shared agentic patterns, evaluation practices, and production standards across teams.
  • Lead architecture for cross-cutting AI capabilities used by multiple products and squads.
  • Coach AI engineers and raise standards for quality, safety, and cost discipline.
  • Partner with AI Quality, site reliability engineering, and Security on release gates and operations practices.

Desired Qualifications

  • Experience with frontier or foundation models beyond API usage, including evaluation, adaptation, and fine-tuning.
  • Experience with open-weight models and local inference tools such as vLLM, Ollama, and Hugging Face.
  • Data exploration techniques and tools.
  • Experience with Agile or Atlassian tools, and advanced integrated development environments such as Cursor, IntelliJ, and VSCode.

About the Company

BMC Software

IT management software for mainframes

What BMC Software does: It provides software to manage and optimize large enterprise IT environments, from IBM mainframes to modern cloud systems. How its product works: Its tools monitor, manage, and automate IT infrastructure across mainframes, distributed servers, and cloud platforms, helping teams keep systems running, secure, and efficient. How it stands out from competitors: It has a long track record starting with mainframe software and has grown through targeted acquisitions to offer a broad suite for end-to-end IT operations, spanning on‑premises and cloud, with strategic ownership changes that gave it room to adapt. What its goal is: to help enterprises operate complex IT environments more reliably and efficiently by providing integrated software for mainframes, distributed systems, and cloud management.

Company size
5,001-10,000
Company stage
IPO
Headquarters
Houston, TX
Founded
1980

Recently Posted Jobs

Explore more opportunities at BMC Software

See more jobs