Q

Qualcomm

Designs mobile chips and licenses wireless patents

Senior Program Analyst - Generative AI, Prompt Engineering & Validation

Manual & Functional QAConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • An Associate's degree in Business Administration, Management, Computer Science, Engineering, or a related field, or a high school diploma or equivalent plus 2 or more years of relevant work experience.
  • 2–6 years of experience in program analysis, project coordination, validation, quality assurance, data analysis, or technical operations.
  • Hands-on exposure to Generative AI tools, large language model applications, prompt engineering, or AI-assisted workflows.
  • Ability to create structured test cases, validation reports, action trackers, and executive summaries.
  • Understanding of prompt-response behavior, hallucinations, context limitations, and output evaluation methods.
  • Working knowledge of search, summarization, retrieval-augmented generation concepts, information retrieval, or knowledge-base validation.
  • Strong Excel skills.
  • Written and verbal communication skills and attention to detail.

Responsibilities

  • Track GenAI feature validation plans, deliverables, owners, dependencies, and closure status across teams.
  • Maintain dashboards, trackers, action item logs, risk registers, and validation status reports.
  • Coordinate with engineering, product, platform, and domain expert teams to drive timely completion of testing and feedback cycles.
  • Consolidate weekly progress updates, blockers, risks, and recommendations for program reviews.
  • Ensure validation documentation, prompt libraries, and issue logs are accurate, current, and accessible.
  • Create, refine, and maintain prompts for GenAI features, search workflows, summarization use cases, and analytical agents.
  • Develop zero-shot, few-shot, role-based, multi-turn, edge-case, and negative test prompts.
  • Build reusable prompt templates and feature-wise prompt libraries.
  • Compare prompt variants and document their impact on accuracy, relevance, completeness, consistency, and latency.
  • Translate domain expert feedback into improved prompts and updated test scenarios.
  • Design and execute structured test cases for GenAI features, including functional, sanity, regression, negative, and exploratory testing.
  • Validate end-to-end behavior from user prompt to retrieved context, generated response, and final output format.
  • Map feature requirements to prompts, expected outputs, acceptance criteria, and validation evidence.
  • Identify defects, usability gaps, hallucinations, incomplete answers, inconsistent responses, and low-confidence outputs.
  • Support release readiness assessment using status indicators such as Go, Watch, or Risk.
  • Validate AI outputs against structured, semi-structured, and unstructured data sources such as SharePoint, Confluence, Jira, documents, JSON/XML, and internal knowledge bases.
  • Check search relevance, context quality, source completeness, and data freshness before summarization.
  • Support validation of retrieval-augmented generation workflows, semantic search, keyword search, global filters, and domain filters.
  • Identify data gaps, indexing issues, retrieval failures, and source-quality problems impacting AI response accuracy.
  • Maintain golden datasets, expected-answer sets, and benchmark queries for repeatable validation.
  • Evaluate GenAI responses for factual correctness, relevance, completeness, clarity, format quality, and consistency across repeated runs.
  • Log defects with reproduction steps, the prompt used, expected and actual outputs, severity, and owner.
  • Perform first-level root cause analysis to distinguish prompt issues, data issues, retrieval issues, model limitations, and product defects.
  • Work with subject-matter experts to validate technical correctness and define acceptance thresholds for complex responses.
  • Track quality improvements over time and report trends in accuracy, hallucination reduction, and feature readiness.
  • Prepare weekly validation summaries, risk updates, action item trackers, and executive-ready status reports.
  • Document prompt libraries, test suites, validation evidence, known issues, and improvement logs.
  • Facilitate review meetings, capture meeting minutes, document decisions, and follow up on action items.
  • Communicate with cross-functional stakeholders across engineering, platform, product, and program management teams.
  • Support leadership reviews with concise summaries, dashboards, and recommendations.
  • Use Excel, Power BI, Jira, Confluence, SharePoint, or similar tools to maintain trackers, dashboards, and reporting views.
  • Support basic scripting or automation for batch prompt execution, response capture, comparison, and reporting where applicable.
  • Improve validation efficiency through reusable templates, structured checklists, and repeatable test processes.
  • Track productivity metrics such as test coverage, closure rate, defect aging, prompt reuse, and feature readiness.

Desired Qualifications

  • Power BI, Jira, Confluence, SharePoint, or dashboarding experience.
  • Basic Python, SQL, or scripting knowledge.
  • A Bachelor's degree in Engineering, Computer Science, Electronics, Data Science, Information Systems, or a related discipline.
  • Prior experience in semiconductor, system-on-chip, embedded systems, platform engineering, enterprise AI, or technical program management.
  • Experience supporting validation of internal tools, AI platforms, search systems, summarization tools, or workflow automation platforms.
  • Exposure to responsible AI, data privacy, model evaluation, or enterprise GenAI governance.

About the Company

Qualcomm

Designs mobile chips and licenses wireless patents

Qualcomm designs the Snapdragon processors and modems inside many Android phones, and it licenses its wireless patents to device makers around the world. It helped commercialize CDMA, the cellular technology behind 3G networks, and its patents cover core parts of the 4G and 5G standards that phones use to connect. The company does not run its own chip factories; contract foundries make its chips, which it sells to makers of phones, PCs, cars, and connected devices. Device makers also pay Qualcomm royalties for using its patented technology, which forms a second business alongside chip sales. Qualcomm was founded in 1985 and is based in San Diego, California.

Company size
10,001+
Company stage
IPO
Headquarters
San Diego, CA
Founded
1985

Recently Posted Jobs

Explore more opportunities at Qualcomm

See more jobs