B

Brightstar.AI

Develops AI-based products in stealth mode

Applied AI Engineer Intern - Advancing Agent Quality

Applied Machine LearningConfirmed live in the last 24 hours
Internship · Winter 2026Miami, FL, USANo salary listed

About the Job

Requirements

  • Currently enrolled in a Master's or PhD program, or serving as a postdoctoral or early-career academic researcher, in Artificial Intelligence, Machine Learning, Computer Science, Computational Linguistics, or a related field.
  • At least 1 year of research, project, or professional experience with large language models or agents.
  • At least 2 years of experience with machine learning and deep learning.
  • Experience in software engineering and cloud-based development.
  • Experience with agent builders such as OpenSDK or OpenAI Agent Builder.
  • Ability to communicate complex technical concepts clearly to non-technical executive audiences.

Responsibilities

  • Design, build, and scale realistic agent environments and task suites for board-level deliberation, research synthesis, diligence workflows, and multi-step tool use.
  • Develop agentic large language model judges, calibrate them against human expert evaluation, and benchmark Brightstar agents against leading frontier models.
  • Build trajectory-analysis frameworks and diagnostic tooling to identify agent failure modes and feed fixes back into agent prompts, harnesses, and architecture.
  • Enable agents to generate and iterate on their own verifiers, including automated test cases, checklists, and ground-truth sets, to support exploration and iterative problem-solving.
  • Harvest multi-turn interaction trajectories into high-quality datasets and reward signals for fine-tuning and post-training.
  • Contribute to the AI Twin Board build-out and extend the evaluation approach to other AI initiatives.
  • Contribute frontier AI research perspectives to weekly Think Tank review sessions and selected strategic discussions.
  • Review relevant research papers, conference findings, and publications from leading AI institutions and labs for the Think Tank knowledge base and evaluation methodology.
  • Interpret academic and technical developments for business and investment audiences, including implications for industry transformation and applied AI opportunities.

Desired Qualifications

  • In-depth knowledge of machine learning algorithms, including supervised learning and reinforcement learning.
  • Hands-on experience building large language model or agent evaluation systems, including autoraters, human-evaluation pipelines, benchmark design, or evaluation infrastructure.
  • Experience with multi-agent orchestration, retrieval-augmented generation, and tool-use or function-calling reliability.
  • Active research or publications in large language models, reasoning systems, model behavior, AI safety, or the societal impact of advanced AI systems.
  • Affiliation with a South Florida university and work under the supervision of a faculty member or professor, or recent graduate.

About the Company

Brightstar.AI

Develops AI-based products in stealth mode

BrightStar.AI has pivoted to a new identity under RaiLTech.ai and is currently in stealth mode with no public site or product information available. The BrightStar.ai domain is for sale. Public details about the company’s product lines or technology have not been disclosed, so how its offerings work cannot be described. There is not enough information to compare with competitors, given the lack of public data. The apparent goal is to develop AI-related technology under the RaiLTech.ai banner while keeping development private until a public launch.

Company size
1-10
Company stage
Not listed
Total funding
Not listed
Headquarters
Philadelphia, PA
Founded
2020

Recently Posted Jobs

Explore more opportunities at Brightstar.AI

See more jobs