Research Collaborator

---

Job description

Overview:

We are seeking highly skilled and experienced professionals to join our team as Subject Matter Experts (SMEs), in various domains such as coding, biology, chemistry, physics and math, and in one or more of several languages, including Russian, German, Mandarin, Japanese, Spanish, among others (full list below). As an integral part of our quality control process, you will contribute your expertise to ensure the accuracy and effectiveness of our AI systems. Your expertise will be invaluable in creating guidelines, prompt engineering and directly annotating data to help our AI models excel in their respective domains

Responsibilities:

Quality Assurance: Evaluate and grade the quality of annotations produced by vendors for SFT (Supervised Fine Tuning) and RLHF (Reinforcement Learning from Human Feedback) annotations. Identify areas of improvement and provide feedback to optimize the quality of annotations.

Guideline Development: Create, edit, and maintain high-quality annotation guidelines tailored to your area of expertise. Ensure that these guidelines are up-to-date, clear, and concise to enable vendors to deliver accurate annotations.

Trend Analysis: Stress-test our models and document problematic trends observed across various examples. Collaborate with the team to address these trends and improve the models' performance.

Domain Expertise: Offer guidance and mentorship within your domain to bridge any gaps in understanding and support the development of more accurate AI models.

Data Annotation: Directly annotate data for key tasks when necessary, including writing SFT responses and judging output quality for RLHF.

Prompt engineering: Write and evaluate system prompts to steer our models, generate synthetic data and improve specific product outcomes (e.g. search triggering).

Requirements:

Education: A Master's or Ph.D. degree in a relevant field related to the domain of expertise (coding, biology, chemistry, physics, mathematics)

Experience: A minimum of 5 years of professional experience in the respective domain.

Deep Knowledge: Demonstrated deep understanding and expertise in the designated domain.

Communication Skills: Strong written and verbal communication skills to effectively convey complex ideas and guidance to internal teams and external vendors.

Analytical Skills: Exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.

Collaboration: Proven ability to work collaboratively with cross-functional teams and external partners to achieve shared goals.

Adaptability: Flexibility and willingness to learn and adapt to new technologies and processes in a rapidly evolving environment.

Language Expertise:

Must be fluent in at least one language other than English, specifically: French, German, Portuguese, Spanish, Vietnamese, Hindi, Italian, Thai, Indonesian, Arabic, Tagalog, Russian, Cantonese, Mandarin, Japanese, Punjabi, Korean and Bengali.

What We Offer:

Opportunity to work on cutting-edge AI technology and make a significant impact on the development of advanced AI models.

Competitive salary and benefits package.

A dynamic and inclusive work environment that values diversity and innovation.

Growth opportunities to expand your skill set and career progression within the organization.

If you are passionate about contributing your expertise to revolutionize the world of AI, we encourage you to apply for this exciting opportunity.

Number of prompts on a daily/weekly?

Can depend on complexity/projects. No high-volume work. Goal is to be setting up new processes, improvision, identifying gaps.

Nice-to-have Skills:

AI experience

Years of Experience:

A minimum of 5 years of professional experience in the respective domain.

Degrees/Certifications Required:

A Master's or Ph.D. degree in a relevant field related to the domain of expertise (coding, biology, chemistry, physics, mathematics)

Interview Process:

Language assessment - to be conducted in the anticipated language

Second Round with Management/SME

Test to be conducted just after or right before the final interview (successful completion of this will determine qualification of round two interview)

Block style interviews - specific days/times - Chanelle to share the spreadsheet with the supplier

45 minute interview each

• Only those lawfully authorized to work in the designated country associated with the position will be considered.

• Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.

Benefits:

For information and details on employment benefits offered with this position, please visit here . Should you have any questions/concerns, please contact our HR Department via our secure website .

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here .

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department .

Rose International has an official agreement (ID ), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

<!– job description page –>