Adobe Sign is a market-leading, global digital signature service for individuals, small businesses, and enterprises. We run a large-scale, high-volume, transactional system in seven geographically dispersed shards. Adobe Sign is one of the most secure services at Adobe, complying with SOC 2, PCI-DSS, GDPR, and even HIPAA controls for security, privacy, and availability. We have a globally distributed team both building and supporting Sign. 

What you’ll do:

• Work as part of product and infrastructure team to assist with construction and testing Sign Application foundation using state-of-art cloud technologies, including AWS and Azure.

• Support and Develop customer driven features on a variety of platforms, including mobile and web, within agile development cycles.

• Work closely with feature developers to identify test cases and develop efficient and scalable testing processes.

• Create and maintain unit tests for every feature.  Draft test plan, complete functional testing and fix problems before delivering features for final testing.

• Define product performance metrics and conduct system performance and load testing as part of infrastructure delivery requirement.

• Help the team to oversee quality of the Sign Application and assist the release process.

• Contribute to QA automation testing framework and manage QA Continuous Integration environments.

• Identify, propose, and implement process improvements to continuously increase the team’s productivity and efficiency.

• Design, develop, and implement automated test frameworks and test suites for evaluating generative AI models and systems

• Develop and execute test plans, test cases, and test scripts for functional, performance, and stress testing of AI models and systems.

• Implement continuous integration and continuous deployment (CI/CD) pipelines to ensure the efficient and reliable delivery of AI models and systems

• Conduct code reviews and provide feedback to ensure the quality and maintainability of the test codebase.

• Stay updated with the latest advancements in AI, machine learning, and testing methodologies to continuously improve the evaluation framework.

Qualifications:

• Bachelor’swith 10 years or Master’s degree with 7years  in Computer Science, Engineering, or a related field.

• Proven experience as an SDET, software engineer, or similar role, with a focus on testing and quality assurance.

• Strong programming skills in languages such as Python and Java.

• Experience with test automation frameworks and tools (e.g., Selenium, JUnit, TestNG).

• Working knowledgeof AI and machine learning concepts, particularly generative models.

• Knowledge of CI/CD tools and practices (e.g., Jenkins, GitLab CI).

• Familiarity with databases in general, VectorBD experience is a plus.

• Experience in testing AI agents, is a plus

• Excellent problem-solving skills and attention to detail.

Preferred Qualifications:

• Experience with cloud platforms and services (e.g., AWS, Azure).

• Knowledge of LLM models(Azure OpenAI, OpenAIetc)