Karya
Research Engineering Intern, AI Evaluations
- Location
- Bengaluru
- Work mode
- See listing
- Experience
- Students & freshers
- Pay
- ₹25K–40K/mo (Est.)
- Type
- Internship, AI & ML
- Added
- 2 November 2026
About this role
Karya runs a smartphone-based work platform that lets low-income communities earn by building language datasets and evaluating AI models. Its AI Evaluations team builds benchmarks and reports that show how well models perform in languages and contexts that global benchmarks miss. The intern, based in Bengaluru, works with research engineers to set up, run and analyse these evaluations. Work covers dataset preparation, model inference, annotation tasks, quality checks and tooling. It suits a computer science or ML student with strong Python and statistics skills who likes debugging messy data pipelines.
Karya is hiring for Research Engineering Intern, AI Evaluations, an internship based in Bengaluru.
Who can apply: Students & freshers. Skills: Python, pandas, LLMs, Statistics, NLP.
Hirastra checked that this opening is live. Apply directly through the official posting; applying is always free.
What you'll do
- Prepare datasets, run model inference via APIs and self-hosted setups, and launch annotation tasks on the Karya platform
- Monitor live evaluations, reproduce annotation app issues and coordinate fixes with platform and operations teams
- Run automated checks on annotation data and flag anomalies
- Compute agreement, scores and breakdowns, and support studies such as validating automated judges against human ratings
- Build and maintain tested, documented tooling for data processing, QC and analysis
What you need
- Currently pursuing or recently completed a Bachelor's or Master's in Computer Science, Machine Learning, NLP or a related field
- Strong Python and comfort working with data (pandas or similar)
- Working knowledge of LLMs and modern ML, including calling models via APIs
- Solid foundation in probability and statistics
- Methodical debugging skills and willingness to dig into unfamiliar systems
Skills
- Python
- pandas
- LLMs
- Statistics
- NLP
"Est." = Hirastra's estimate based on market data, not an official figure.
All Karya jobs and internships
More like this: IT jobs in Bengaluru, Python developer jobs for freshers, Internships for 1st year students (2030 batch), Internships for 2nd year students (2029 batch), Internships for 3rd year students (2028 batch), Jobs and internships for final year students (2027 batch), Jobs for B.Tech and BE freshers, IT jobs for MCA freshers, IT internships in India, AI and machine learning jobs
Similar openings
See all jobsOrigin
AI Research Apprentice
- PyTorch
- Diffusion models
- Vision-language models
- Computer vision
- Python
Location: Bengaluru, Onsite
Experience: Freshers welcomeStudents & freshers
Est. ₹25K–40K/mo
Added
AtkinsRéalis
Data Engineering Intern
- Python
- SQL
- Pandas
- ETL/ELT
- Git
- Data Warehousing
Location: Bengaluru, Onsite
Experience: Freshers welcomeStudents & freshers
Est. ₹15K–25K/mo
Added
Pramana
Intern - Data
- SQL
- Python
- pandas
- NumPy
- scikit-learn
- Data Visualization
Location: Bengaluru
Experience: Freshers welcomeStudents
Est. ₹15–25K / month
Added
- React
- Node.js
- Python
- TypeScript
- AI coding tools
Location: Pune
Experience: Freshers welcomeStudents & freshers
Est. ₹15K–30K/mo
Added
- Java
- JavaScript
- React
- Python
- SQL
- AWS
Location: Bengaluru
Experience: Freshers welcomeFinal-year students6 months (Jan–Jun 2027)
Est. ₹30K–45K/mo
Added
MarvellCloses in 3 days
Software Intern
- C
- C++
- Python
- MATLAB
- Perl
- Operating Systems
Location: Bengaluru
Experience: Freshers welcomeStudents
Est. ₹40K–60K/mo
Added