B

BMC Software

IT management software for mainframes

Lead AI Engineer

AI Application EngineeringPosted on Nov 11
Full-timeIndia

About the Job

Requirements

  • 8–13 years of relevant experience.
  • Bachelor's or Master's in Computer Science, AI, ML, or a related field, or equivalent experience.
  • Hands-on experience with large language models such as OpenAI, Anthropic, Gemini, Llama, or equivalent.
  • Familiarity with agentic frameworks such as LangGraph, LangChain, or CrewAI, and agentic software development kits as appropriate to the level.
  • Understanding of prompt engineering, tool/function calling, planning, reasoning, and workflow orchestration.
  • Experience with Python, REST APIs, microservices, cloud, containers, CI/CD, and testing, with depth scaling by level.
  • Experience with evaluations for LLM, RAG, or agent use cases, and observability tools such as Langfuse, OpenSearch, or OpenTelemetry as appropriate to the level.
  • Experience leading adoption of patterns or practices across multiple teams.
  • Ability to set technical direction for an AI area, beyond delivering features.
  • Ability to balance innovation speed with enterprise quality, safety, and cost.

Responsibilities

  • Design, develop, and maintain enterprise-grade agentic AI applications using modern large language models and AI frameworks.
  • Build autonomous and semi-autonomous AI agents capable of planning, reasoning, decision-making, and task execution.
  • Develop multi-agent systems and orchestrate interactions between agents, tools, APIs, and enterprise applications.
  • Integrate AI agents with internal and external services through APIs, databases, messaging systems, and workflow engines.
  • Build and deploy retrieval-augmented generation solutions using vector databases and enterprise knowledge sources.
  • Optimize AI workflows for performance, scalability, reliability, and cost efficiency.
  • Implement observability, monitoring, guardrails, and governance mechanisms for production AI systems.
  • Build and run agent evaluations by defining evaluation sets, testing behavior, and iterating on prompts, tools, and workflows.
  • Package and deploy solutions in production and apply diagnostics across the AI stack.
  • Collaborate with product teams, architects, and stakeholders, and contribute to reviews, documentation, and best practices.
  • Define shared agentic patterns, evaluation practices, and production standards across teams.
  • Lead architecture for cross-cutting AI capabilities used by multiple products and squads.
  • Coach AI engineers and raise standards for quality, safety, and cost discipline.
  • Partner with AI Quality, site reliability engineering, and Security on release gates and operations practices.

Desired Qualifications

  • Experience with frontier or foundation models beyond API usage, including evaluation, adaptation, or fine-tuning.
  • Experience with open-weight models and local inference using tools such as vLLM, Ollama, or Hugging Face.
  • Data exploration techniques and tools.
  • Experience with Agile or Atlassian tools, and advanced IDEs such as Cursor, IntelliJ, or VSCode.

About the Company

BMC Software

IT management software for mainframes

What BMC Software does: It provides software to manage and optimize large enterprise IT environments, from IBM mainframes to modern cloud systems. How its product works: Its tools monitor, manage, and automate IT infrastructure across mainframes, distributed servers, and cloud platforms, helping teams keep systems running, secure, and efficient. How it stands out from competitors: It has a long track record starting with mainframe software and has grown through targeted acquisitions to offer a broad suite for end-to-end IT operations, spanning on‑premises and cloud, with strategic ownership changes that gave it room to adapt. What its goal is: to help enterprises operate complex IT environments more reliably and efficiently by providing integrated software for mainframes, distributed systems, and cloud management.

Company size
5,001-10,000
Company stage
IPO
Headquarters
Houston, TX
Founded
1980

Recently Posted Jobs

Explore more opportunities at BMC Software

See more jobs