AI Tester Midlevel

AI Tester Midlevel needs 7 years' experience, 4-7 years of experience in Spring Boot.

Skills and Abilities
-6+ years of experience in Software Functional testing with Automation (Selenium) knowledge
-Dallas / Tampa / Jersey City.
-Experience with Jira and ALM
-Experience in writing, and executing application tests using industry standard automated testing tools like Selenium
-Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.
-Strong knowledge of Python and experience with AI testing tools and libraries (e.g, LangChain, Pytest, Pytorch).
-Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.
-Experience in writing, and executing application tests using industry standard automated testing tools like Selenium
-

Responsibilities:
-Implement automated testing frameworks for gen AI applications such as Deep eval, RAGAs etc for evaluating and testing LLMs
-Develop custom validation scripts for Gen AI model output evaluation including accuracy, relevancy, faithfulness and performance benchmarks
-Test prompt engineering techniques to optimize responses
-Familiarity with Snowflake and executing SQL queries to validate database integrity and application responses
-Responsible for system integration testing of newly developed or enhanced applications
-Requires in-depth knowledge of the software implementation lifecycle
-Possesses good Testing Process knowledge and a detailed understanding on AGILE methodology
-Works with project teams during early stages to establish plans, standards, and procedures that will add value to the testing effort and satisfy the constraints of the project
Employment Type: Full-Time
Salary: $ 45.00 Per Hour