Job Description
What this opportunity involves
- Create structured test cases that simulate complex human workflows
- Define gold-standard behavior and scoring logic to evaluate agent actions
- Analyze agent logs, failure modes, and decision paths
- Work with code repositories and test frameworks to validate your scenarios
- Iterate on prompts, instructions, and test cases to improve clarity and difficulty
- Ensure that scenarios are production-ready, easy to run, and reusable
What we look for
- 3+ of software development experience with strong Python focus
- Experience with Git and code repositories
- Comfortable with structured formats like JSON/YAML for scenario description
- Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design
- Familiarity with Docker
- English proficiency - B2
How it works
- Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Project time expectations
Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Payment
Paid contributions, with rates up to $40/hour*
Fixed project rate or individual rates, depending on the project
Some projects include incentive payments
*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
Get notified of similar jobs
We'll send you an email when jobs similar to "Freelance Agent Evaluation Engineer" are posted.
Related Jobs You Might Like
View all jobs →
F&B Attendant
IHG
About the Role We are looking for a friendly, attentive, and professional Food & Beverage Attendant to ensure high-quality service in our dining outlets. The ideal candidate will deliver exceptional guest experiences by providing efficient service, anticipating needs, and maintaining the highest standards of hospitality. Day-to-Day Responsibilities Guest Service: Welcoming guests, taking their orders, and ensuring they have a memorable dining experience. Order Management: Accurately relaying orders to the kitchen and bar, and delivering food and beverages promptly. Table Setup and Maintenance: Arranging table settings, maintaining cleanliness, and ensuring tables are ready for the next guests. Food and Beverage Preparation: Assisting in the preparation of beverages like coffee and cocktails, and sometimes helping with basic food prep. Inventory Control: Managing and restocking food and beverage supplies as needed. Payment Handling: Processing guest payments accurately and ensuring all transactions are handled properly. Health and Safety Compliance: Following all health and safety regulations to ensure a safe dining environment. Problem Resolution: Addressing any guest complaints or issues in a professional and courteous manner. What We Need From You Previous experience in food & beverage service in hotels, restaurants, or serviced residences is preferred. Excellent communication and interpersonal skills. Professional appearance and friendly demeanor. Ability to work in a fast-paced environment and flexible shifts, including weekends and public holidays. International luxury hotel chain background GCC exposure English Fluency is required Arabic Fluency is preferred Knowledge of food and beverage standards, hygiene, and safety practices. Benefits We give our people everything they need to succeed. From a competitive salary that rewards all your hard work to a wide range of benefits designed to help you live your best work life – impressive room discounts and some of the best training in the business.
Store Associate -MOM.Lifestyle.
LANDMARK GROUP
About Landmark Group Our journey started in 1973 with a single store in Bahrain. Since then, we have grown into a global retail and hospitality group. The proud creator of 25 plus value led, own-built brands across retail, hospitality, food, and leisure. Over the years, our UAE - based group has evolved into a comprehensive retail and hospitality entity, with over 2200 retail stores, leisure, and hospitality outlets, panning the GCC, Middle East, India, Southeast Asia, and Africa. Today, Landmark Group is one of GCC's largest omnichannel retailers and India's top home and fashion retailer. We take immense pride in the organic growth of our retail brands, which have blossomed into household names. From Max, Splash, Babyshop, Centrepoint, Shoemart, Homecentre, Emax, Fitness First, to Funcity, to name a few, our brands span across a multitude of categories, enriching the lives of countless families over the past decade. About Lifestyle Lifestyle is a leading retail destination, specialising in Beauty, Fashion, and Home products. Established in 1998, Lifestyle has consistently delivered a distinctive shopping experience, and an extensive selection of brands and products across colour cosmetics, perfumes, personal care, fashion accessories, home essentials, home fragrance and youth. With its chain of more than 160 retail stores spread across the GCC, coupled with a rapidly growing E-commerce platform, Lifestyle has established itself as an omnichannel destination-of-choice for Beauty and Fashion serving more than 4 million customers every year. Responsibilities Maximize sales through exceptional customer service. Maintain desired retail operations standards. Maintain customer service standards. Ensure proper replenishment. Maintain recovery standards in the store.
Assistant Operations Manger - testing and inspection in industrial services
SGS
Company Description We are SGS – the world's leading testing, inspection and certification company. We are recognized as the global benchmark for sustainability, quality and integrity. Our 99,600 employees operate a network of 2,600 offices and laboratories, working together to enable a better, safer and more interconnected world. Job Description We are seeking an experienced Operations Manager to oversee QA/QC and TPI service contracts, ensuring efficient operations, compliance, and high-quality service delivery. Lead and manage day-to-day operations of QA/QC & TPI contracts Ensure compliance with HSE standards and company policies Plan and coordinate logistics, resources, and operational activities Monitor performance, drive efficiency, and manage departmental P&L Develop and implement operational strategies, procedures, and quality controls Coordinate with clients, internal teams, and external stakeholders Manage budgets, procurement, and reporting processes Lead, mentor, and develop team members Support client relations, quotations, and issue resolution Qualifications Bachelor’s or Diploma in Business Administration, Operations Management, or related field Minimum 8 years of experience in operations management or similar role Strong knowledge of operations, supply chain, and quality control processes Proven experience in budget and resource management Excellent leadership, communication, and problem-solving skills Ability to work in a fast-paced environment and manage multiple priorities Knowledge of HSE regulations and compliance requirements Proficiency in operations management tools/software