Software Development Engineer in Test 3
Bidgely
Software Development Engineer in Test 3
Bidgely
Energy data analytics with disaggregation insights
Bidgely is a Silicon Valley AI company transforming how utilities and their customers understand and manage energy. The UtilityAI platform turns smart-meter data into appliance-level insights, and Agentic CX brings GenAI assistants to utility chat, voice IVR and customer service. Leading utilities across North America, Europe and Asia rely on Bidgely, and the Bengaluru engineering center is a certified Great Place to Work.
We are hiring a senior SDET to own quality across customer-facing products: web dashboards, APIs, notifications, and GenAI products such as chatbots, voice IVR and AI agents. You will define how AI agents are tested, build automated evals, and set the quality criteria for release. You will also own test strategy for your area, and build and improve UI, API and end-to-end automation and regression coverage. This is a hands-on engineering role working closely with GenAI engineering, CX engineering and product teams.
Own test strategy and release quality criteria for your product area.
Build and maintain UI automation (Selenium or Playwright), API automation and end-to-end regression suites.
Design evaluation strategy for AI agents using LLM-as-judge, rubrics and other eval techniques.
Build eval datasets and automated evaluation suites in Python, integrated with CI/CD.
Test AI agents for accuracy, consistency, tool usage, safety and data handling.
Debug agent failures using LangSmith and similar AI observability tools.
Analyse release-over-release quality and identify regressions.
Review product requirements and identify gaps in requirements and test coverage.
Review test code, set testing standards and mentor SDETs.
Communicate findings and recommendations to engineering, product and leadership.
6–9 years in software testing, including hands-on SDET experience.
Good working knowledge of both Python and Java.
Experience owning test strategy and improving automation and release quality.
Experience with UI automation using Selenium or Playwright.
Experience building API automation and end-to-end frameworks with CI/CD.
Ability to analyse product requirements and identify testing gaps.
Prior experience testing chatbots, IVRs and GenAI agents.
Experience designing evals, rubrics and LLM-as-judge evaluations.
Working knowledge of LangChain, LangGraph and LangSmith or similar tools.
Experience building eval harnesses or tooling for AI agents.
Strong analytical and communication skills.
Python, Java, Selenium, Playwright, REST API testing, Postman, TestNG, PyTest, LangChain, LangGraph, LangSmith, LLM evaluation (evals), LLM-as-judge, RAG testing, AI agent testing, end-to-end testing, regression testing, CI/CD, GitHub Actions, Jenkins, AWS.
Bidgely provides energy analytics that break down a building’s total energy use into appliance-level usage for utilities, SMBs, and consumers. It collects energy data and uses AI to identify how much power each appliance consumes, with tools like Home Energy Reports, Enterprise Analytics, and EV Analytics, plus services such as virtual energy assessments and smart alerts. Its edge comes from appliance-level disaggregation paired with a full analytics suite and services that cover gas, electrification, and decarbonization, enabling personalized insights and scalable demand management beyond basic usage data. The goal is to help utilities and end users save energy and reduce costs while advancing decarbonization and electrification of the energy system.
Explore more opportunities at Bidgely