Understanding Evidence Ratings: How We Evaluate Supplements

When you see an "evidence rating" for a supplement, what does it actually mean? Understanding how evidence is rated helps you make informed decisions about what to take.

Why evidence ratings matter

The supplement industry makes countless claims. Without evidence ratings:

• Marketing hype and research findings look similar
• You can't distinguish proven from speculative
• Decisions are based on testimonials and hope
• You might waste money or take risks

Evidence ratings cut through the noise.

The Optimize evidence rating system

We rate supplement evidence on a four-level scale:

Strong evidence

What it means:

Multiple well-designed randomized controlled trials in humans showing consistent, meaningful effects. Meta-analyses or systematic reviews support the conclusion.

Confidence level: High. The supplement likely does what research suggests.

Examples:

• Creatine for strength and performance
• Vitamin D for correcting deficiency
• Fiber for digestive regularity

What you can expect: Effects demonstrated in research are likely to occur for most people when used appropriately.

Moderate evidence

What it means:

Some human RCTs show positive results, but evidence has limitations:

• Fewer studies
• Smaller sample sizes
• Some inconsistency between studies
• Short durations
• Questions about generalizability

Confidence level: Reasonable. Probably works for many people, but less certain.

Examples:

• Ashwagandha for stress reduction
• Curcumin for joint inflammation
• Magnesium for sleep quality

What you can expect: Good chance of benefit, but effects may vary more between individuals.

Weak evidence

What it means:

Limited human evidence. May include:

• Single small human trials
• Primarily animal studies
• Mixed or inconsistent results
• Mechanistic plausibility but limited clinical data

Confidence level: Low. Might work, but we don't really know.

Examples:

• Many nootropics
• Emerging longevity compounds
• Traditional herbs with limited modern research

What you can expect: Uncertain. You're taking a bet based on preliminary data.

Anecdotal

What it means:

No controlled human trials. Evidence consists of:

• User reports and testimonials
• Forum discussions
• Theoretical mechanisms
• Marketing claims

Confidence level: Very low. No scientific basis for expecting benefits.

Examples:

• Many "bro science" recommendations
• Trendy compounds without research
• Claims based on animal studies extrapolated to humans

What you can expect: Unknown. You're essentially experimenting with no guidance.

How we determine ratings

What we look for

Study quality:

• Randomized controlled trials (highest value)
• Appropriate blinding
• Adequate sample sizes
• Meaningful duration
• Relevant populations

Consistency:

• Do multiple studies find similar results?
• Are there contradictory findings?
• What do meta-analyses conclude?

Effect size:

• Are effects large enough to matter?
• Statistical significance alone isn't enough
• Clinical meaningfulness matters

Applicability:

• Were healthy people or sick people studied?
• Does the population match typical supplement users?
• Are study doses similar to supplement doses?

What we're skeptical of

Industry-funded studies: Not disqualifying, but should be viewed with appropriate skepticism

Single studies: One positive study doesn't establish evidence

Small samples: Under 30 participants provides weak evidence

Surrogate endpoints: Changes in blood markers don't always mean health benefits

Animal and cell studies: Interesting but not applicable to human use claims

Using evidence ratings in decisions

Strong evidence supplements

These are reasonable for most people with relevant goals. Effects are likely.

Approach: If your goal matches the evidence, consider these first. Standard doses work.

Moderate evidence supplements

Worth considering, especially if strong-evidence options are insufficient.

Approach: Try with reasonable expectations. Track your response. Not everyone benefits equally.

Weak evidence supplements

Only for those comfortable with uncertainty and experimentation.

Approach: If you try them, track carefully. Expect that many weak-evidence supplements won't deliver. Be willing to stop if no benefit appears.

Anecdotal supplements

Generally not recommended unless you're a deliberate self-experimenter.

Approach: If you choose to try, treat it as an experiment. Don't expect it to work. Track rigorously. Prioritize safety.

Common misunderstandings

"No evidence" doesn't mean "doesn't work"

Absence of evidence isn't evidence of absence. A supplement with no research might work, but we just don't know. Many traditional remedies lack research but may have value.

However, claims require evidence. Without it, we can't recommend something.

"Natural" doesn't mean "proven"

Being natural doesn't provide evidence of efficacy. Poison ivy is natural.

"It worked for me" isn't evidence

Personal testimonials are anecdotes, not data. Placebo effects, confirmation bias, and confounding factors make testimonials unreliable.

Mechanistic plausibility isn't proof

"The mechanism makes sense" doesn't mean it works in humans. Many plausible mechanisms fail in practice.

Animal studies are preliminary

Mouse studies are the beginning of research, not the end. Most treatments that work in mice fail in humans.

When to go against ratings

Personal experimentation with weak evidence

If you're a careful self-experimenter who:

• Tracks metrics rigorously
• Accepts uncertainty
• Has safety information
• Can afford the experiment

Then trying weak-evidence supplements as n-of-1 experiments is reasonable.

Traditional use considerations

Some traditional remedies have centuries of use without modern research. Traditional use isn't scientific evidence, but it's not nothing either.

For low-risk compounds with traditional backing, some people reasonably choose to try them despite weak modern evidence.

Individual variation

Population-level evidence doesn't guarantee individual response. A strong-evidence supplement might not work for you; a moderate-evidence one might.

Your personal data matters alongside population evidence.

The honest picture

For most supplements, evidence is moderate or weak. The field has:

• Too few high-quality human trials
• Too much industry-driven research
• Too much marketing outrunning evidence
• Too many claims without support

This isn't pessimism. It's honesty. Some supplements have strong evidence and genuine value. Many don't.

Knowing the difference helps you spend your money and attention wisely.

What we're building

Optimize provides evidence ratings for supplements so you can make informed decisions about what's worth trying and what's not.

We believe you deserve honesty about what research supports. We won't hype weak-evidence supplements or pretend uncertainty doesn't exist.

Know what you're taking and why.

Sign up free for evidence-based supplement intelligence.