AI Data Researcher
- Accepting Applications Closed
- US Company | Medium (51-250 employees)
- LATAM (100% remote)
- 4+ years
- Long-term · 40h/week
- Productivity Software
- Full Remote
Required skills
- Python
- LLM
- RAG
- Prompting and Retrieval Systems
Requirements
Must-haves
- 4+ years of data research, applied analytics, or evaluation experience
- Experience with LLMs, prompting, RAG, and retrieval concepts
- Proficiency with Python
- Proficiency with SQL
- Experience in maintaining high-quality datasets or evaluation programs
- Ability to navigate ambiguous problems independently
- Strong communication skills in both spoken and written English
What makes you stand out
Fully own and drive the quality of the evaluation system
Nice-to-haves
- Startup experience
- Experience with LLM-as-a-judge evaluation
- Familiarity with (LangSmith, Ragas, DeepEval, Braintrust, Evidently, etc.)
- Knowledge of embeddings, search, reranking, or hybrid retrieval
- Experience creating evaluation rubrics, dashboards, or lightweight automation
- Bachelor's Degree in Computer Engineering, Computer Science, or equivalent
What you will work on
- Own the quality of the LLM and Retrieval-Augmented Generation (RAG) evaluation system
- Run structured LLM and RAG evaluations and perform root-cause analysis
- Distinguish between retrieval, ranking, source, prompt, model, and citation failures
- Maintain evaluation datasets, including quality reviews, versioning, coverage, and new production cases
- Refine prompts, judge rubrics, and LLM-as-a-judge workflows
- Design controlled experiments with clear baselines, metrics, and success criteria
- Investigate practical solutions to recurring RAG challenges
- Automate repetitive analysis (e.g., Python, SQL, notebooks, APIs)
- Communicate findings and recommended actions to Product, Engineering, and leadership
Interested in this job?
We're still accepting applications for this position
Apply nowRefer a friend
AI Data Researcher
LATAM · 100% Remote Long-term · 40h/week 4+ years
- Python
- LLM
- RAG
- Prompting and Retrieval Systems
Your referral link
or share via
Link copied to clipboard
Get matched with the best remote opportunities from today's top US companies
Find great opportunities
Earn more compensation for your hard work
Access exclusive benefits like healthcare, English classes, and more
1-1 individualized training to succeed in the international job market