1001 Freelance Projects -- LLM Reasoning Benchmark Questions + Python Evaluation Script

Latest Projects from
Freelance Marketplaces

View this project in detail (Note: you will be redirected to external marketplace)
Project title:
LLM Reasoning Benchmark Questions + Python Evaluation Script
Posted by:
External project from PeoplePerHour
Started:
21-Apr-2025 09:32 GMT
Description:
I need a freelancer to prepare benchmark questions and answers for testing a custom LLM’s reasoning ability. Scope: Question Set: Collect 500–600 LLM benchmark questions with correct answers. Focus areas: logical, mathematical, commonsense, analytical, and multi-step reasoning. Deliver as JSON or CSV. Python Script: Load questions and send them to an LLM (I'll handle API integration). Compare model answers to correct ones. Output a simple accuracy report. Requirements: Knowledge of LLMs, reasoning datasets, or NLP is preferred. Clean, documented code. Use only open or original questions.
Project ID:
3430175
Project category:

Project budget:

View this project in detail (Note: you will be redirected to external marketplace)

Project	Started
IoS and Andoid UX Designer required	21 Apr 2025 09:32 GMT
Filming Food for Social Media	21 Apr 2025 09:32 GMT
SEO both on page and off page	21 Apr 2025 09:32 GMT
I need a logo vectorising into a .SVG	21 Apr 2025 09:32 GMT
Freelance Lead Generation Specialist – Ongoing Work Available	21 Apr 2025 09:32 GMT
LLM Reasoning Benchmark Questions + Python Evaluation Script	21 Apr 2025 09:32 GMT
TikTok Video Creator for ADHD Productivity App (Growth Focus)	21 Apr 2025 09:32 GMT
Настройка агента в Microsoft Copilot Studio	21 Apr 2025 08:33 GMT
Build Reddit + Forum Bot to Grow ADHD App (GPT + Automation)	21 Apr 2025 08:23 GMT
Property dispute help	21 Apr 2025 08:23 GMT
Logo design for a new website	21 Apr 2025 08:23 GMT
Rush Hour Animation	21 Apr 2025 08:22 GMT
Looking to capture 20-30 public reactions. London	21 Apr 2025 08:21 GMT
Seeking: Finance & Compliance Specialist (Freelance/Advisory)	21 Apr 2025 07:33 GMT
Experienced Café Designer Needed for Coffee Shop Visualizations	21 Apr 2025 07:21 GMT

Browse All Projects

New!
Проекты на русском (Projects in Russian)