Software Development Engineer in Test- AI

SET.Python, Python, Machine Learning, LangChain, Generative AI, AI in Test Automation

Hyderabad, Bangalore, Pune, Chennai, Gurgaon

We are seeking a highly experienced Software Development Engineer in Test for AI Testing to join our team.

In this role, you will develop and test AI-based applications using open-source tools and frameworks. You will utilize your strong Python development skills and expertise in machine learning libraries such as scikit-learn, Pandas, and Numpy, to build and test retrieval augmentation generation (RAG) based applications.

Responsibilities

Design and develop test plans and test cases for AI-based applications
Collaborate with cross-functional teams to ensure the quality and accuracy of the AI-based applications
Develop and maintain test automation frameworks for AI-based applications
Conduct performance and scalability testing of AI-based applications
Provide technical guidance and mentorship to junior team members
Stay up-to-date with emerging trends and technologies in AI testing

Requirements

Minimum of 5 years of experience in Software, System, and Test Engineering with mandatory working project experience in testing AI-based applications
Expertise in Python development and machine learning libraries such as scikit-learn, Pandas, and Numpy
Experience in building and testing retrieval augmentation generation (RAG) based applications using open-source tools and frameworks
Strong knowledge of Langchain components and Langsmith, vector databases, and prompt engineering skills
Ability to evaluate and test LLMs using tools and open-source libraries
Excellent verbal and written communication skills in English at a B2 level

Nice to have

AI Developer certification from any of the cloud providers (AWS, Azure, GCP)
Exposure to tools and open-source libraries for the evaluation and testing of LLMs