F

Fanatics

China-based licensed sports merchandise retailer

Senior Analyst - Operations Automation

Data Analysis +1Updated on Nov 14
Full-timeDenver, CO, USA$86k - $115k

About the Job

Requirements

  • At least 2 years of experience in business analytics, data analysis, business operations, customer experience analytics, or a closely related role.
  • Strong SQL skills, including independently pulling, joining, and validating data across large datasets.
  • Experience owning recurring reporting and analysis behind a metric and being accountable for its quality.
  • Experience building BI views and dashboards in Tableau, Looker, Power BI, Sigma, or similar tools for decision-making.
  • Ability to diagnose the root cause of metric changes, estimate their value, and recommend fixes; diagnostic skill is more important than modeling sophistication.
  • Comfort working directly with unstructured conversation data, reading transcripts at volume, identifying patterns, and quantitatively validating them.
  • Experience documenting findings and recommendations for partners outside the reporting line and seeing some recommendations acted upon.
  • Conceptual understanding of LLM-powered systems, including prompting, retrieval-augmented generation, knowledge grounding, and evaluation, sufficient to distinguish grounding problems from prompt problems and tool gaps.
  • Clear written and verbal communication, including the ability to write a concise one-page explanation that readers can understand.
  • High intellectual curiosity and an AI-first approach to work.

Responsibilities

  • Maintain and report customer-facing AI agent metrics, including containment, resolution, deflection, escalation rate, repeat contact, and customer satisfaction, at case and subtype level.
  • Help establish measurement for each new AI surface at launch, including success definitions and instrumentation.
  • Build and maintain BI views and dashboards for the team and Product partners, keeping them accurate as products, policies, and promotions change.
  • Write data requirements, including event definitions, tagging, table structures, and data quality checks, and partner with Data to implement them.
  • Identify early when reported data is no longer trustworthy.
  • Conduct deep dives at the case type and subtype level to identify where customers stall in AI interactions, including rephrasing, looping, going silent, abandoning, or requesting a human, and determine what preceded the behavior.
  • Quantify stall points by frequency, affected subtypes and markets, and cost in escalations, repeat contacts, and resolution loss.
  • Combine conversation data, interaction quality scores, customer and associate feedback, behavioral data, and operational metrics to identify what is driving performance.
  • Distinguish actionable issues from noise and communicate that distinction candidly.
  • Compare how live agents resolve contact types with how the AI handles the same contacts, identifying agent lookups, tools, and actions that the AI cannot yet perform.
  • Document each AI capability gap, what would close it, and its potential containment or resolution impact.
  • Assess whether escalations and handoffs were necessary.
  • Classify root causes and route them to the appropriate owner and intervention, including grounding and knowledge content, prompt and instruction design, tone, tool access, handoff timing, and policy ambiguity.
  • Specify changes when the AI behaves correctly in principle but poorly in execution, including grounding content, tone, and instructions causing incorrect behavior.
  • Work with content, grounding, and engineering partners to specify findings clearly enough to build and test.
  • Conduct recurring performance reviews for owned case types and maintain a ranked, evidence-backed opportunity list.
  • Develop clear, evidence-backed narratives from conversations and queries, including patterns, representative examples, problem scale, and a specific request.
  • Quantify proposed-fix impact in contacts avoided, resolution lift, handle time, cost, and customer experience, with explainable assumptions.
  • Prepare business cases and recommendations Product partners can act on and bring them to intake with the manager.
  • Track handed-off work through delivery and measure whether changes achieved the stated outcomes.
  • Report what shipped and what changed or did not change so future prioritization is evidence-based.
  • Work closely with Data, Product, Quality, and CX partners and build relationships that help findings drive action.
  • Translate analysis into clear language for technical and non-technical audiences.
  • Document findings and recommendations and contribute to leadership-facing materials.
  • Share learnings in writing so the team can use them.

Desired Qualifications

  • Experience analyzing production conversational data from chatbots, voice systems, or agent-assist tools.
  • Familiarity with Snowflake, Databricks, or a comparable cloud data platform, and dbt or similar transformation tools.
  • Python or R skills for analyses that SQL does not handle cleanly.
  • Background in customer experience, contact center, or support operations analytics, particularly analysis of how human agents resolve contacts.
  • Hands-on experience writing or editing knowledge content, groundings, or prompts for an AI system.
  • Experience in sports betting, gaming, fintech, payments, or another high-growth, regulated consumer industry.
  • Experience partnering with Machine Learning or Data Science teams on evaluation frameworks, A/B testing, or experiment design.
  • Familiarity with knowledge base architecture and how content quality affects AI answer quality.

About the Company

Fanatics

China-based licensed sports merchandise retailer

Fanatics China is a joint venture between Fanatics Inc. and Hillhouse Capital that localizes and scales licensed sports merchandise for China. It designs, manufactures, and markets fan gear for Chinese consumers, operating a multi-channel model that includes building and running e-commerce sites for global leagues and teams, exploring online marketplaces, and developing physical retail concepts. Its product workflow combines technology, data, and on-demand manufacturing to manage the entire supply chain, enabling fast response to demand. The company differentiates itself through a China-focused approach backed by Hillhouse’s network and investments, its end-to-end vertical commerce model, and partnerships with hundreds of sports organizations, which together help it navigate China’s complex retail landscape. The goal is to satisfy a previously underserved Chinese market for licensed sports merchandise by creating localized products and channels that connect fans with official gear.

Company size
10,001+
Company stage
Growth Equity (Venture Capital)
Total funding
$5.2B
Headquarters
Huangpu, China
Founded
1995

Recently Posted Jobs

Explore more opportunities at Fanatics

See more jobs