U

UserTesting

On-demand usability testing and insights platform

AI Systems Administrator

System AdministrationConfirmed live in the last 24 hours
Full-timeRemote in USANo salary listed

About the Job

Requirements

  • Able to work Monday through Friday in the US Eastern or Central time zones.
  • Have 5 or more years of experience with enterprise IT systems in a system administrator capacity.
  • Have hands-on experience with MCP server setup and management, AI agent deployment, and AI feature configuration within enterprise SaaS tools.
  • Be familiar with scripting and automation technologies in Python and/or Bash, Git for version control, and JSON/YAML for configuration and API work.
  • Be familiar with containerization using Docker, including running and troubleshooting containerized services.
  • Be familiar with API-based integrations, including managing keys, scoping permissions, reading documentation, and troubleshooting connectivity issues.
  • Be able to work in a Kanban-style environment, managing due dates, new tasks, and technical debt effectively.
  • Be able to train and mentor IT Support staff on ITSM practices as they apply to this role and function.
  • Be familiar with identity provider tools such as Okta, and with OAuth and single sign-on from an IT perspective.
  • Be able to learn in a constantly shifting environment where change is unavoidable.

Responsibilities

  • Set up, configure, and maintain MCP servers that connect AI systems to internal tools and data sources, including scoping access, managing credentials, and troubleshooting integrations.
  • Enable and manage AI features within existing SaaS platforms, including Atlassian Rovo, Slack AI, Okta AI, ChatGPT, and Google Gemini, working with vendors and internal stakeholders to configure, roll out, and govern usage.
  • Provision and support AI agent infrastructure, including service accounts, API key management, permission scoping, rate-limit monitoring, and access auditing for agents operating across internal systems.
  • Support the deployment and lifecycle management of AI solutions.
  • Manage project processes and communication for scoping calls, stakeholder meetings, and demonstration-style calls.
  • Maintain documentation for AI integrations, including architecture diagrams, access maps, runbooks, and troubleshooting guides.
  • Stay current on the AI tooling ecosystem and identify tools or integrations that could benefit the IT team or the broader organization.
  • Support the administration of company IT systems and SaaS tools across the organization.
  • Become a subject matter expert for AI-enabled platforms, integrations, and supporting infrastructure.
  • Maintain assigned platforms through onboarding, offboarding, access management, feature rollouts, system cleanups, and lifecycle reviews.
  • Identify, prioritize, and address technical debt across IT systems, workflows, and integrations.
  • Partner with other IT System Administrators to improve reliability, automation, documentation, and supportability.
  • Act as an escalation point for complex ITSM issues for the IT support team.
  • Collaborate with Security, People Ops, Engineering, and other cross-functional teams to improve onboarding/offboarding, lifecycle processes, and AI tool adoption.
  • Document procedures, system changes, and troubleshooting workflows.
  • Read API documentation, manage credentials and service accounts, troubleshoot connectivity between systems, write scripts to automate routine work, and assess how AI tools interact with the company's technology stack.

Desired Qualifications

  • Familiarity with Docker containerization; experience with MCP servers or similar tooling is a plus.
  • Certifications in AI platforms such as AWS, Google Cloud, or Anthropic are a plus; demonstrated hands-on experience is valued more highly.

About the Company

UserTesting

On-demand usability testing and insights platform

UserTesting provides an on-demand experience research platform that helps teams collect feedback from real people on websites, apps, prototypes, and marketing content. Its SaaS product supports usability testing, interviews, and surveys, plus AI-assisted analysis, drawing on a large contributor network to deliver video recordings and written responses. The platform is used by thousands of subscription customers, including many Fortune 100 companies. Unlike some competitors, UserTesting combines a broad global pool of participants with multiple research methods and analytics in one integrated platform, enabling rapid, structured insights for product, design, research, and marketing teams. The company aims to turn customer feedback into actionable product and design decisions that improve user experiences and business outcomes.

Company size
1,001-5,000
Company stage
IPO
Headquarters
San Francisco, CA
Founded
2007

Recently Posted Jobs

Explore more opportunities at UserTesting

See more jobs