Role: Python Engineer (Remote)
Location:
Remote (Work from Anywhere)
Role Overview:
We are hiring for one of our clients, seeking a Senior Python Developer to assist a foundational LLM company in enhancing their large language models. The goal is to provide high-quality proprietary data for fine-tuning and benchmarking model performance.
Key Responsibilities:
La información a continuación detalla los requisitos del puesto, la experiencia esperada del candidato y las cualificaciones correspondientes.
-
Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
-
Conduct evaluations to benchmark model performance and analyze results for continuous improvement.
-
Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
-
Lead efforts in supervised fine-tuning, including creating and maintaining high-quality, task-specific datasets.
-
Collaborate with researchers and annotators to execute reinforcement learning with human feedback and refine reward models.
Required
Skills & Qualifications:
-
Proficiency in Python and related frameworks/libraries for AI/ML tasks.
-
Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
-
Strong understanding of evaluation strategies and benchmarking processes for AI models.
-
Ability to design and implement Python code for data generation and model optimization.
-
Familiarity with AI model response evaluation and ranking methodologies. More About the Opportunity: This role offers a unique opportunity to work with a general leader in artificial intelligence, contributing to the advancement of large language models. Candidates will collaborate with top researchers and engineers in the field. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely o