Research Engineer, AI Evaluations
KaryaIndiranagar, BangalorePosted 11 days agoA free account shows the apply link for every role and matches you to the ones that fit your resume.
About the role
Karya builds a digital work platform and evaluates AI models for underrepresented languages and communities. This engineer will design and run evaluations, deploy models, analyze results, and build benchmark and leaderboard infrastructure.
What you'll do
- Design benchmarks, rubrics, and evaluation metrics
- Deploy models through APIs and self-hosted GPU inference
- Analyze evaluation data using statistical methods
- Build evaluation pipelines and leaderboard infrastructure
- Prototype evaluation methods and prepare technical reports
Skills
Must have
- Machine learning engineering
- Applied machine learning
- Python
- Machine learning pipelines
- Model inference
- Probability
- Statistics
Nice to have
- Benchmark design
- Human evaluation
- Speech processing
- Multilingual NLP
- Indian languages
- AI research publications
- Open-source development
Who it's for
- Experience
- 4+ years
- Domain
- ai evaluation
About Karya
Karya has 10 open roles in Bangalore, at DAIA Tech Pvt. Ltd. 60/1, 9th Main, 14th Cross, Off CMH Road, Bengaluru, Karnataka 560038. See every Karya role.
More at Karya
Senior · 5+ years
Entry level · Hybrid · Fresher friendly
Internship · 0 to 1 years · Fresher friendly
Mid level · 3 to 5 years
Entry level · Hybrid · 1 to 3 years
Entry level · Hybrid · 1+ years
Entry level · Hybrid · 1 to 2 years
Mid level · Hybrid · 3 to 6 years
Similar roles
All ml and ai engineering jobsEli Lilly and Company · Manager · 10+ years
