Job Description
What this opportunity involves
- You’ll create challenging coding test cases that push AI coding systems to their limits:
- Review and refine realistic coding tasks based on provided production codebases with realistic scope, requirements and information sources
- Write comprehensive functional tests that validate actual end-to-end behavior and edge-cases, not just superficial checks
- Craft “fair but hard” challenges where the AI has all the context it needs, but has to work for it (information scattered across files and external sources, complex reasoning required)
- Analyze AI failures to understand what the model struggles with vs. what it masters
- Iterate based on feedback from expert QA reviewers who score your work on 7 quality criteria
What we look for
- Degree in Computer Science, Software Engineering or related fields
- 5+ years in software development, primarily Python (pytest, async/await, subprocess, file operations)
- Background in Full-Stack development, with an equal focus on building React-based interfaces and robust Back-end systems
- Experience writing tests (functional, integration – not just running them)
- Docker containers (running evaluations locally in containers)
- CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
- English proficiency - B2
How it works
- Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Effort estimate
Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution.
Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
Get notified of similar jobs
We'll send you an email when jobs similar to "Senior Software Engineer in Test (Full-Stack/Python)" are posted.
Related Jobs You Might Like
View all jobs →
Mathematics & Python Expert - Freelance AI Trainer
Mindrift
What this opportunity involves Design original computational mathematics problems that simulate real mathematical research workflows; Create problems requiring Python programming to solve (using Numpy, SciPy, Sympy); Ensure problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks); Develop problems requiring non-trivial reasoning chains in areas like number theory, combinatorics, graph theory, and numerical analysis; Base problems on real research challenges or practical applications from mathematical practice; Verify solutions using Python with standard mathematical libraries; Document problem statements clearly and provide verified correct answers. What we look for Degree in Mathematics (Pure or Applied) or related fields; Python proficiency for numerical validation. MATLAB, R, C, SQL, Numpy, Pandas, SciPy, domain-specific libraries, Stata or knowledge of any programming language can be equivalent; 2+ years of professional experience: applied, research, or teaching experience is applicable; Experience with numerical methods and symbolic computation; Ability to design problems that mirror real mathematical research workflows; Familiarity with computational complexity theory; Strong written English (C1+). How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid Project time expectations For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Compensation On this project, contributors can earn up to $35 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
Chemistry & Python Expert - Freelance AI Trainer
Mindrift
What this opportunity involves Design original computational chemistry problems that simulate real chemistry research workflows Create problems requiring Python programming to solve (using numpy, scipy, chemical libraries) Ensure problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks) Develop problems requiring non-trivial reasoning chains in physical chemistry, quantum chemistry, and molecular modeling Base problems on real research challenges or practical applications from chemistry practice Verify solutions using Python with standard computational chemistry approaches Document problem statements clearly and provide verified correct answers What we look for Degree in Chemistry or related fields Python proficiency for numerical validation. MATLAB, R, C, SQL, Numpy, Pandas, SciPy, domain-specific libraries, Stata or knowledge of any programming language can be equivalent 2+ years of professional experience: applied, research, or teaching experience is applicable Experience with numerical methods in chemistry Familiarity with computational chemistry concepts and methods Strong written English (C1+) How it works Apply Pass qualification(s) Join a project Complete tasks Get paid Project time expectations For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Compensation On this project, contributors can earn up to $35 per hour equivalent, depending on their level and pace of contribution.
Senior Investment Analyst
Parrot Analytics
About Parrot Analytics Parrot Analytics is the global authority on media and entertainment intelligence, providing the strategic decision support that the world’s leading studios, producers, streamers, investors, and government bodies rely on to de-risk content investment and maximize returns. Trusted across the full media economy — from studios and streaming platforms to film funds, sports leagues, and government bodies — Parrot Analytics informs capital allocation, acquisitions, programming strategy, and IP valuation at the highest levels of the industry. By measuring the demand and preferences of more than 2 billion audiences worldwide, Parrot Analytics’ AI platform quantifies the value of content, talent, franchises, and sports rights — enabling partners to forecast revenue, assess risk, optimize portfolio strategy, and drive more predictable success. About the Role The global entertainment industry invests hundreds of billions of dollars into film and television content every year. Yet investment decisions are still largely made using fragmented market signals, limited financial modelling, and incomplete audience insight. Parrot Analytics is building a new analytical layer for the industry — combining the world’s largest dataset on global audience demand with structured financial modelling to help studios, investors, and funds make more disciplined content investment decisions. We are seeking a Senior Investment Analyst to lead the development of financial models used to evaluate film and television projects. This role sits at the intersection of entertainment economics, investment analysis, and data science, translating audience demand signals, project budgets, and distribution assumptions into structured financial forecasts and investment insights. The successful candidate will play a key role in helping investors understand the risk and return profile of content investments before capital is committed. Build Investment Models for Film & Television Projects Develop sophisticated financial models that evaluate the commercial performance of film and television projects across multiple distribution windows. Models will incorporate production budgets and cost structures, financing structures and investor positions, distribution revenue streams across global markets and investor return scenarios and capital recovery timelines. Revenue modelling will consider multiple distribution pathways including theatrical, SVOD, AVOD, FAST, Pay TV, and international licensing. Leverage Parrot Analytics’ global dataset on audience demand and content valuation to inform revenue assumptions within financial models. Develop structured approaches to translating audience demand signals and valuation into realistic commercial scenarios, benchmarking projects against comparable titles across genres, markets, and platforms. Quantify Investment Risk Evaluate projects through structured scenario modelling that assesses downside risk and capital exposure, break-even performance thresholds and investor return scenarios under different market conditions Conduct sensitivity analysis across key variables including budget changes, distribution outcomes, and shifts in audience demand. Support Investment Decision-Making Produce financial analyses used by funds, studios, and investors evaluating content opportunities. Translate complex financial models into clear insights that help decision-makers understand the economic implications of project budgets, distribution strategies, and market positioning. Develop Industry-Leading Modelling Frameworks Help design the financial modelling frameworks used to evaluate film and television investments using Parrot Analytics’ data. The goal is to build repeatable analytical tools that allow projects to be evaluated with institutional investment discipline, enabling more structured decision-making across the industry.