AI/ML

Virtusa Lifespaces India Pvt Ltd
₹8,86,988 - ₹11,23,125 एक वर्ष
आन्ध्र प्रदेश
पूर्णकालिक
3 दिन पहले
Job Overview
We are seeking a Senior AI Test Automation Engineer to lead the quality assurance efforts for AI/ML-powered applications and systems. This role will be critical in designing and implementing test strategies that ensure the accuracy, robustness, fairness, and reliability of AI models and ML pipelines. The ideal candidate will combine deep experience in test automation frameworks with a strong understanding of AI/ML workflows and data science practices.

Key Responsibilities
Design, develop, and maintain automated test frameworks and test suites for AI/ML systems, APIs, and data pipelines.
Validate the integrity, performance, and accuracy of machine learning models in both development and production environments.
Implement test coverage for edge cases, fairness, bias, explainability, and model drift in ML workflows.
Collaborate with data scientists and ML engineers to review model assumptions, inputs, and outputs.
Create synthetic and real-world test data to evaluate AI/ML model behavior under various conditions.
Monitor CI/CD pipelines to ensure models and services are thoroughly tested before deployment.
Apply data validation and statistical testing to verify training data quality and results consistency.
Drive root cause analysis of model failures and identify opportunities to improve test effectiveness.
Lead performance benchmarking and regression testing for ML services at scale.

Primary Skills (Must-Have)
Test Automation Expertise in tools like PyTest, Robot Framework, Selenium, Postman, or REST Assured.
Python Programming Strong experience with Python, particularly in writing test scripts for ML/AI services.
ML/AI Knowledge Understanding of machine learning lifecycle, supervised/unsupervised models, and common ML frameworks (e.g., scikit-learn, TensorFlow, PyTorch).
Data Validation Experience with tools/libraries like Great Expectations, Pandera, or custom Python-based validation.
CI/CD Integration Proficiency with Jenkins, GitLab CI, or similar tools for integrating automated tests in pipelines.
API Testing Proven ability to test RESTful APIs and ML endpoints.
Model Evaluation Metrics Familiarity with metrics like precision, recall, F1 score, confusion matrix, AUC-ROC.

Secondary Skills (Nice-to-Have)
Cloud Platforms Familiarity with AWS, Azure, or GCP for testing AI services deployed on cloud infrastructure.
ML Monitoring Tools Exposure to tools like Evidently AI, MLflow, or Weights & Biases.
Bias/Fairness Testing Knowledge of ethical AI practices and tools like Fairlearn or Aequitas.
Containerization Experience with Docker/Kubernetes to manage test environments.
Performance Testing Tools like JMeter, Locust, or k6.
Version Control Git/GitHub for codebase management.
SQL and Data Engineering Basics For testing data pipelines and verifying large datasets.

Qualifications
Bachelor or Master degree in Computer Science, Data Science, Engineering, or related field.
5+ years of experience in test automation with at least 2+ years working in AI/ML environments.
Demonstrated ability to work in cross-functional agile teams with ML engineers and data scientists.
Strong analytical, problem-solving, and communication skills


About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

आवेदन करें
अन्य नौकरी सुझाव:

Ai/ml executive

Wellorgs Infotech Pvt. Ltd.
Remote
₹10,000 - ₹15,000 एक माह
  • Design, build, and optimize custom machine learning models...
  • Implement AI-driven solutions to support data analysis,...
1 सप्ताह पहले

AI/ML Scientist

MAERSK
भारत
₹9,10,998 - ₹11,53,526 एक वर्ष
  • A team player having 4-7 years of experience in the field...
  • An individual with strong work experience in areas of text...
1 सप्ताह पहले

ML Engineer

Cerebras Systems
Bengaluru, कर्नाटक
  • Design, build, and maintain scalable data curation and...
  • Ensure data quality, reproducibility, and security across...
3 दिन पहले

AB-ML Data Associate II, Amazon Business - ML Data Ops

Amazon.com
तेलंगाना
₹4,53,687 - ₹5,74,468 एक वर्ष
As an ML Data Ops II, you will play a crucial role in managing and improving machine learning data annotation processes Your...
2 सप्ताह पहले

AI Tutor

Go ask now technology pvt ltd
तमिलनाडु
Key Responsibilities: Conduct online training sessions for Computer Science, Python, and AI Teach and mentor students through...
2 सप्ताह पहले

AI & DATA Science Trainer

DreamKatcher
केरल
₹2,44,900 - ₹3,10,098 एक वर्ष
Key Responsibilities Conduct structured and interactive training sessions on core AI concepts including Machine Learning, Deep...
1 सप्ताह पहले

ML Data Scientist

Technology Next
Remote
₹80,000 - ₹90,000 एक माह
  • Build and deploy AI/GenAI solutions using Python and SQL.
  • Develop applications with LLMs like GPT-4o, Claude, Gemini,...
1 सप्ताह पहले

Ai Based Video Editor Intern

6th Street Artist
महाराष्ट्र
  • Use AI-powered tools to edit and enhance videos
  • Assist in creating short-form and long-form content...
1 सप्ताह पहले

AI/ML

Saaki Argus And Averil Consulting
कर्नाटक
₹10,45,253 - ₹13,23,524 एक वर्ष
Fine-tune and deploy large language models (LLMs) and integrate them with LLM orchestration platforms (LangChain, LlamaIndex,...
1 सप्ताह पहले

AI / ML Trainer

UniSoft Technologies
महाराष्ट्र
₹2,84,810 - ₹3,60,634 एक वर्ष
  • Design and deliver engaging training sessions (live or...
  • Supervised and unsupervised learning
  • Deep learning (CNNs, RNNs, transformers)...
3 दिन पहले