B

Banyan Software

Private equity acquiring and stewarding software

AI Agent Operations Consultant

Customer SuccessConfirmed live in the last 24 hours
Full-timeRemote in USA$85k - $110k

About the Job

Requirements

  • At least 5 years of experience in enterprise software, including real ERP experience.
  • A Customer Success, support, or consulting background in an ERP environment.
  • Proven experience running customer-facing AI agents; use of AI tools for internal productivity alone does not meet this requirement.
  • Hands-on experience with agentic AI workflows, such as agent-to-agent hand-offs or AI built into business workflows.
  • Working knowledge of APIs and integrations, including the ability to support and troubleshoot them without being a developer.
  • Ability to communicate clearly and turn technical findings into action for customers and internal teams.

Responsibilities

  • Run Luna's operating rhythm by monitoring agent quality, task completion, and escalations, and keep Luna performing as usage grows.
  • Run the ongoing AI training process that keeps Luna accurate, including maintaining the knowledge, documentation, and skills Luna relies on.
  • Influence how Luna behaves, responds, escalates, and hands off to people, within leadership's standards, with consistent tone and clarity across interactions.
  • Use telemetry from Application Insights and Power Platform to identify weak answers, likely bugs, enhancement requests, and documentation gaps.
  • Turn findings into clear, prioritized tasks for Product and Development, and automate that loop where possible.
  • Track and report adoption, experience quality, and task-completion metrics.
  • Grow Luna adoption across the customer base, from getting answers with Luna 1.0 to completing tasks with Luna 2.0.
  • Support the move to Luna as the first stop for customer support cases.
  • Help customers configure and train Luna for their company and users, including customer- and user-level instructions, through webinars, guides, and one-on-one help.
  • Identify high-impact use cases where Luna can reduce friction and save customers time.
  • Help the Customer Success team move from reactive support to acting on AI-flagged escalations and improvement opportunities.
  • Keep Luna's knowledge customer-friendly, current, and structured for retrieval and action, and partner with internal teams to close gaps.
  • Understand how Luna works with customers' other AI tools and systems, including how prompts and context pass between agents, and ensure the experience works for customers.
  • Link Customer Success, Product, Development, and Implementation so customer learnings become product improvements.
  • Bring a customer-first lens to technical decisions and translate technical possibilities into clear customer value.

Desired Qualifications

  • Experience with Dynamics 365 Business Central; Finance & Operations or NAV experience also counts.
  • A background as a Business Central or NAV functional-technical consultant.
  • Accounting or finance process knowledge.
  • Experience in mortgage, financial services, or another regulated environment.
  • Working knowledge of Copilot Studio, Power Platform, and Application Insights or similar telemetry tools.
  • Familiarity with AI design patterns, including retrieval-augmented generation (RAG), tool calling, structured outputs, and multi-step orchestration; MCP; and the wider Microsoft AI stack, including Azure AI Search, Logic Apps, and Entra ID.

About the Company

Banyan Software

Private equity acquiring and stewarding software

Banyan Software is a private investment firm that buys profitable, niche B2B software providers and keeps them under long-term ownership. It focuses on enterprise software with recurring revenue and strong market positions, often from founders seeking stable ownership. The firm does not resell its acquisitions; instead it preserves each company’s legacy, autonomy, brand, and leadership, while offering operational support as needed. Banyan’s portfolio spans industries such as healthcare, education, legal, and public safety, all centered on essential software infrastructure. The company operates with a permanence mindset and aims to create long-term value, positioning itself as a trusted, mission-aligned partner for founders and families who want continuity rather than an exit.

Company size
51-200
Company stage
Debt Financing
Total funding
$20K
Headquarters
Atlanta, GA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Banyan Software

See more jobs