Senior AI Evals Engineer
RubrikBellandur, BangalorePosted 18 days agoA free account shows the apply link for every role and matches you to the ones that fit your resume.
About the role
Rubrik provides cyber resilience, data protection, and tools for enterprise AI agent deployments. This engineer will build automated evaluation frameworks and test AI agents for quality, safety, and production readiness.
What you'll do
- Build evaluation frameworks for AI agents
- Create synthetic test environments and golden datasets
- Automate regression and drift detection in CI/CD pipelines
- Monitor production agent quality and analyze evaluation results
- Develop test plans and automated suites for agent features
- Mentor engineers and review technical designs and code
Skills
Must have
- LLM evaluation
- AI agent testing
- QA automation
- Python
- Pytest
- CI/CD
- RAG
- Prompt engineering
- Prompt injection
- Statistical analysis
Nice to have
- AI ethics
- Responsible AI
- Data analysis
- Data visualization
- Red-teaming
- Adversarial testing
- Data poisoning
- Human-in-the-loop evaluation
Who it's for
- Education
- Engineering degree
- Degree
- computer science, information systems, engineering
- Experience
- 8+ years
- Domain
- cybersecurity and data protection
About Rubrik
Rubrik has 22 open roles in Bangalore, at Embassy TechVillage. See every Rubrik role.
More at Rubrik
Lead or staff · 8+ years
Lead or staff · 8+ years
Entry level · 0.5 to 1 years
Lead or staff · 9+ years
Internship · 0 to 1 years · Fresher friendly
Director and above · 10 to 15 years
Senior · 6+ years
Manager · 12+ years
Similar roles
All qa and testing jobs
Beckman Coulter (Danaher) · Mid level · On-site · 3+ years
FIRY · Lead or staff · Hybrid · 10+ years
Skillz · Lead or staff · Hybrid · 10+ years
Hewlett Packard Enterprise · Lead or staff · On-site · 8+ years