AI Agent Trajectory Annotator and Reviewer

Type: Contract, hourly Location: Remote Hours: 20–30 per week Pay: $20–30/hour, based on experience and language coverage Start: Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision. You will do two jobs, and you should expect either on any…