B

BMC Software

IT management software for mainframes

Lead AI Engineer

AI Application EngineeringPosted on Nov 11
Full-timeIndia

About the Job

Requirements

  • 8–13 years of relevant experience.
  • Bachelor's or Master's degree in Computer Science, AI, ML, or a related field, or equivalent experience.
  • Hands-on experience with LLMs such as OpenAI, Anthropic, Gemini, or Llama.
  • Familiarity with agentic frameworks such as LangGraph, LangChain, or CrewAI, and agentic SDKs at the level required.
  • Understanding of prompt engineering, tool/function calling, planning, reasoning, and workflow orchestration.
  • Experience with Python, REST APIs, microservices, cloud, containers, CI/CD, and testing, with depth appropriate to the level.
  • Experience with evaluations for LLM, RAG, or agent use cases; observability tools such as Langfuse, OpenSearch, or OpenTelemetry as required by the level.
  • Experience leading patterns or practices adopted across multiple teams.
  • Ability to set technical direction for an AI area, not only deliver features.
  • Ability to balance innovation speed with enterprise quality, safety, and cost.

Responsibilities

  • Design, develop, and maintain enterprise-grade agentic AI applications using modern LLMs and AI frameworks.
  • Build autonomous and semi-autonomous AI agents capable of planning, reasoning, decision-making, and task execution.
  • Develop multi-agent systems and orchestrate interactions between agents, tools, APIs, and enterprise applications.
  • Integrate AI agents with internal and external services through APIs, databases, messaging systems, and workflow engines.
  • Build and deploy RAG solutions using vector databases and enterprise knowledge sources.
  • Optimize AI workflows for performance, scalability, reliability, and cost efficiency.
  • Implement observability, monitoring, guardrails, and governance mechanisms for production AI systems.
  • Build and run agent evaluations by defining evaluation sets, testing behavior, and iterating on prompts, tools, and workflows.
  • Package and deploy solutions in production, and apply diagnostics across the AI stack.
  • Collaborate with product teams, architects, and stakeholders, and contribute to reviews, documentation, and best practices.
  • Define shared agentic patterns, evaluation practices, and production standards across teams.
  • Lead architecture for cross-cutting AI capabilities used by multiple products and squads.
  • Coach AI engineers and raise standards for quality, safety, and cost discipline.
  • Partner with AI Quality, SRE, and Security on release gates and operations practices.

Desired Qualifications

  • Experience with frontier or foundation models beyond API usage, including evaluation, adaptation, or fine-tuning.
  • Experience with open-weight models and local inference tools such as vLLM, Ollama, or Hugging Face.
  • Experience with data exploration techniques and tools.
  • Experience with Agile or Atlassian tools, and advanced IDEs such as Cursor, IntelliJ, or VSCode.

About the Company

BMC Software

IT management software for mainframes

What BMC Software does: It provides software to manage and optimize large enterprise IT environments, from IBM mainframes to modern cloud systems. How its product works: Its tools monitor, manage, and automate IT infrastructure across mainframes, distributed servers, and cloud platforms, helping teams keep systems running, secure, and efficient. How it stands out from competitors: It has a long track record starting with mainframe software and has grown through targeted acquisitions to offer a broad suite for end-to-end IT operations, spanning on‑premises and cloud, with strategic ownership changes that gave it room to adapt. What its goal is: to help enterprises operate complex IT environments more reliably and efficiently by providing integrated software for mainframes, distributed systems, and cloud management.

Company size
5,001-10,000
Company stage
IPO
Headquarters
Houston, TX
Founded
1980

Recently Posted Jobs

Explore more opportunities at BMC Software

See more jobs