E

ECFX

Automated enterprise court notice management

QA Engineer: AI-Assisted Testing

Manual & Functional QAConfirmed live in the last 24 hours
Full-timeRemote in USA

About the Job

Requirements

  • Have 3 to 7 years of software quality assurance experience for web or SaaS applications, including deep experience in exploratory and manual testing of complex, data-heavy systems.
  • Use AI assistants in testing, with concrete examples such as generating test ideas and edge cases, building test data, writing SQL or log queries, summarizing logs or code diffs, reproducing bugs, and drafting reports.
  • Prompt AI tools with relevant context, such as tickets, code diffs, and acceptance criteria, to obtain useful testing output.
  • Verify AI-generated output, recognize errors, and apply independent judgment about risk.
  • Understand how to test nondeterministic systems such as AI features using repeated trials, sample sets, and correctness checks rather than exact matches.
  • Use synthetic or masked data with AI tools and avoid putting customer or court data into unapproved services.
  • Use the command line, Git, and logs; some Docker or Kubernetes experience is a plus.
  • Use Jira for defect tracking and test management.
  • Write or maintain automated tests, such as Playwright, Selenium, or API test scripts, including building them with AI and reviewing and fixing generated tests.
  • Test AI or LLM features, including classification accuracy, hallucinations, and prompt injection.
  • Use SQL to check data in PostgreSQL.
  • Test APIs directly with tools such as Postman, curl, or Bruno, and understand HTTP, REST, and JSON.
  • Conduct web security testing involving authentication and sessions, roles and permissions, OAuth2/SAML, CSRF, and XSS.
  • Use AI browser tools, such as Playwright MCP or browser agents, to support exploratory testing.
  • Test integrations with third-party systems, email-driven workflows, or browser automation against external sites.
  • Conduct accessibility testing against WCAG 2.2 AA.
  • Have knowledge of the legal domain, especially court e-filing, docketing, or legal document management.
  • Hold an ISTQB or similar QA certification.
  • Understand or have experience with the Lean Startup approach.

Responsibilities

  • Use AI tools such as Claude, Claude Code, Cursor, or ChatGPT to review tickets, merge requests, and code diffs; identify risks and edge cases; draft test charters and checklists; and prioritize testing.
  • Perform risk-based exploratory, functional, and regression testing across the Vue dashboard, admin tools, email notifications, and integrations.
  • Verify that documents are correctly retrieved, parsed, categorized, stored, and delivered across external sources, including court portals, 2FA/OTP logins, and integrations such as Clio, Filevine, iManage, and NetDocuments; identify silent failures.
  • Manually verify backend and platform changes using API calls, SQL queries, logs, and dashboards such as Grafana/Loki and Sentry, with AI assistance as appropriate.
  • Use AI to generate test data, sample court notice emails, and edge-case documents, and use simulators and test environments to reproduce difficult scenarios.
  • Evaluate AI document categorization and LLM-facing tools, including an MCP server used by AI assistants; create sample sets, assess accuracy and consistency, probe unusual or hostile inputs, and flag regressions after model or prompt changes.
  • Test logins using passwords, SAML SSO, and OAuth; verify user roles, permissions, and tenant data isolation; and validate security fixes without breaking existing functionality.
  • Investigate customer-reported and production issues, reproduce them reliably, and write actionable bug reports for engineers or AI agents.
  • Use AI to create focused automated checks, such as Playwright scripts or API checks, for high-risk flows that require repeated testing, if automation is in the employee's toolkit.
  • Work with engineers and product managers in sprint planning, backlog refinement, and retrospectives; help write testable acceptance criteria and raise quality risks early.

Desired Qualifications

  • Some experience with Docker or Kubernetes, such as port-forwarding or checking pod logs.

About the Company

ECFX

Automated enterprise court notice management

ECFX provides an Enterprise Notice Management System called ECFX Notice that automates the handling of electronic court notices for law firms and corporate legal departments. The system uses Intelligent Automation to manage the entire workflow—receiving, processing, routing, and tracking court notices—reducing the time and manual effort required by attorneys, paralegals, and staff. Clients access the product through a subscription model, receiving continuous updates and support as part of the service. ECFX differentiates itself with its deep legal-technology experience (over 100 years combined) and recognition from the ABA TECHSHOW for innovative approaches, along with a proven ability to cut costs by more than 90% and minimize risks associated with manual processing. The company’s goal is to improve operational efficiency in legal workflows, lower operating costs, and allow legal professionals to focus more on substantive work rather than administrative tasks.

Company size
11-50
Company stage
Growth Equity (Non-Venture Capital)
Total funding
$10.5M
Headquarters
Los Angeles, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at ECFX

See more jobs