Weekday AI

Proactive software engineer recruitment via referrals

Business Analyst: US Raters

Applied Machine LearningConfirmed live in the last 24 hours

Full-timeRemote in USA$30 /hr

About the Job

Requirements

A bachelor's degree in Business Administration, Finance, Computer Science, or a related field is required.
At least 3 years of experience as a Business Analyst or in a similar analytical role is required.
Strong analytical thinking, problem-solving, and decision-making skills are required.
Excellent written and verbal communication skills are required.
Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools is required.
Experience with requirement gathering, process mapping, and business documentation is required.
Ability to work effectively with cross-functional teams and manage multiple priorities is required.
Strong attention to detail and the ability to make consistent, objective assessments are required.
Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment is required.
Candidates must be based in the United States and comply with applicable country-specific eligibility guidelines.
Candidates must be available for 8 hours per day, five days per week, with at least four hours of overlap with U.S. Pacific Time; the schedule may include weekend work, with two weekdays off each week.

Responsibilities

Review, analyze, and compare responses generated by multiple AI chatbots.
Evaluate chatbot responses against predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
Conduct structured assessments and provide objective, evidence-based judgments.
Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
Track task progress, quality metrics, and deliverables to ensure timely completion.
Identify recurring issues in chatbot responses and share actionable observations.
Maintain accuracy, consistency, confidentiality, and documentation standards throughout the project.
Compare responses from multiple chatbots and submit a final assessment based on defined criteria.

Desired Qualifications

Familiarity with Agile or Scrum methodologies is an advantage.

Business Analyst: US Raters

Weekday AI · United States (Remote) · Contract · Posted 2026-10-19

Workplace: remote

Department: AI Training

Description

This role is for one of our clients

We are looking for detail-oriented and analytical Business Analysts – US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments.

The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule.

Job Details

Role: Business Analyst – US Raters
Experience: 3+ years
Location: United States only
Employment Type: Short-term contract
Contract Duration: 16 weeks
Compensation: USD 30 per hour
Start Date: Immediate
Work Mode: Fully remote
Availability: Full-time commitment of 8 hours per day
Time Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)
Work Schedule: Five working days per week, including weekends as required, with two weekdays off

Requirements

Key Responsibilities

Review, analyze, and compare responses generated by multiple AI chatbots.
Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
Conduct structured assessments and provide objective, evidence-based judgments.
Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
Track task progress, quality metrics, and deliverables to ensure timely completion.
Identify recurring issues in chatbot responses and share actionable observations.
Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.

Required Qualifications and Skills

Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
At least 3 years of experience as a Business Analyst or in a similar analytical role.
Strong analytical thinking, problem-solving, and decision-making skills.
Excellent written and verbal communication skills.
Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
Experience with requirement gathering, process mapping, and business documentation.
Ability to work effectively with cross-functional teams and manage multiple priorities.
Strong attention to detail and the ability to make consistent, objective assessments.
Familiarity with Agile or Scrum methodologies is an advantage.
Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.

Engagement Benefits

Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.
Fully remote work arrangement.
Exposure to structured AI assessment and quality assurance processes.
Opportunity to work on projects with broader business and technological applications.
Clearly defined contract duration, hourly compensation, and project expectations.

Important Engagement Details

This is a project-based contract with a duration of 16 weeks.
Assigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteria.
Candidates must be available for 8 hours per day, five days per week.
A minimum of four hours of overlap with US Pacific Time is required.
The schedule may include weekend work, with two weekdays off each week.
Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines.
Consistent evaluation quality, adherence to project instructions, and timely task completion are essential.

Apply

Apply at Weekday AI

About the Company

Weekday AI

Proactive software engineer recruitment via referrals

Weekday.works helps companies hire software engineers through proactive outreach and peer-recommended candidates. Its platform automates tracking, pipeline management, and provides weekly updates, while it actively identifies engineers via peer networks, reaches out, shortlists, checks references, and schedules interviews. Differentiators include peer-backed vetting instead of traditional job boards, proactive outreach, and a passive-income reference feature that monetizes referrals. The goal is to reduce the time and effort of hiring by connecting companies with pre-vetted engineers who are open to new opportunities through a network-driven approach.

Company size: 201-500
Company stage: Seed
Total funding: $2.3M
Headquarters: Bengaluru, India
Founded: 2021

Recently Posted Jobs

Explore more opportunities at Weekday AI

See more jobs