Clinical Study Design Flaws
Review clinical studies through a sensible lens
A randomized, double-blind, placebo-controlled study is an important starting point for substantiation, but this National Advertising Division (NAD) case is a reminder that the underlying data still needs to support the claim. It’s worth giving studies a gut check: Does the design make sense, do the results add up, and do they support what the marketing actually says? Let’s see what we can learn.
A teeth-whitening company advertised “30 minutes to whiter teeth.” In an earlier competitor challenge, NAD found that consumers may think this means noticeably whiter teeth after one 30-minute application, and the company was advised to discontinue or modify the claim.
Interestingly, the company later submitted three new studies to reopen the case. NAD found that two of the studies lacked a negative control, making it difficult to determine whether the product caused the whitening or if another variable was responsible.
The third study did have a placebo group and was randomized and double-blinded, but NAD identified tooth-color measurements it considered impossible and unusually high standard deviations, calling the study’s reliability into question.
The public NAD summary doesn’t provide actual readings or explain why they were impossible, so I suggest caution when drawing conclusions about what went really wrong. To be fair, NAD had previously found support for the separate on-pack claim, “whitens without the sensitivity,” which is an important distinction because support for one benefit does not automatically support a specific promise about how quickly consumers will see results.
For brands reviewing substantiation, I’d want the scientific reviewer to explain whether the comparison was appropriate, whether the measurements and analysis were reliable, and whether the results support the exact benefit and timeframe being advertised.
Read the NAD case summary.
