aitoolcompass.

Find your next AI tool

Search by product name or task. Press Escape to close.

LLMEval

● Identity checked

Research · Vendor site 2026-10-04

LLMEval is a Fudan NLP Lab research series building comprehensive LLM evaluation frameworks across academic disciplines, medical AI, and large generative question sets. It publishes papers, leaderboards, and open-source datasets such as LLMEval-Logic with solver-verified answers.

Updated 2026-10-04View sources
Official website
Category
Research
Free access
Research site and open-source GitHub repositories are published without commercial plan pricing.
API access
Not confirmed

Is LLMEval right for you?

A good fit for

NLP researchers benchmarking LLMs for fairness, robustness, and domain-specific reasoning tasks.

Before you choose

Offerings are academic benchmarks and papers rather than a hosted paid evaluation SaaS.

Comprehensive Evaluation for Large Language Models

LLMEval aggregates rigorous evaluation frameworks, leaderboards, and open datasets spanning disciplines, medical AI, and logic reasoning benchmarks.

What it can do

Features & capabilities

Unknown is different from unavailable. Each fact carries its own evidence.

CapabilityValueEvidenceChecked
Benchmark scaleHomepage cites 59 LLMs benchmarked and 220K questions in LLMEval-Fair alongside multiple peer-reviewed papers.Facts sourced2026-10-04
LLMEval-Logic releaseFeatured research announces open-source LLMEval-Logic with Z3-verified answers and adversarial hardening.Facts sourced2026-10-04

Understand the total cost

LLMEval pricing & plans

Free

Free

Research site and open-source GitHub repositories are published without commercial plan pricing.

Access
Research site and open-source GitHub repositories are published without commercial plan pricing.
LLMEval pricing, plans and price history

Alternatives to LLMEval

View all ↗

The practical questions

Frequently asked questions

What is LLMEval used for?

LLMEval is a Fudan NLP Lab research series building comprehensive LLM evaluation frameworks across academic disciplines, medical AI, and large generative question sets. It publishes papers, leaderboards, and open-source datasets such as LLMEval-Logic with solver-verified answers.

Does LLMEval have a free plan?

Research site and open-source GitHub repositories are published without commercial plan pricing.. This record lists ongoing free access; check the plan limits before starting.

How much does LLMEval cost?

No paid monthly price is listed; this record treats the product as free to start. See the plan cards for entitlements, billing commitments and seat minimums.

Can I use LLMEval through an API?

Not confirmed. API access and subscription access may have different terms; consult the linked sources.

What should I check before choosing it?

Offerings are academic benchmarks and papers rather than a hosted paid evaluation SaaS.

Price history

No retained pricing changes yet. A current price alone does not establish a historical trend.

How this profile is supported

Facts apply to the named version and check date. Send a sourced correction if something changed.