I didn't expect to come back into this conversation, but I'm obviously hooked (no pun intended?), so I did some further digging. I'm still not fully understanding how the literature supports the benefits of omega 3s to the extent that William Harris is claiming. I realize medical statistics is not my specialty, so I'm just going to post my thoughts out into the void and
hope it nerd-snipes someone into correcting me (@black_son_of_gray, your thoughts would be very appreciated if you were willing to chime in again!).
--
As a starting question to your previous post: I can see how the Omega 3 Index would be useful to picking apart the mechanism of action. However, I still don't understand why I (as a layperson) would ever prefer it over just seeing the effects of people taking omega 3s in a randomized, double-blind, placebo-controlled study.
Let's say I see great evidence that omega 3s raise the Omega 3 Index. Then I see great evidence that the Omega 3 Index predicts outcomes I care about (ex. all-cause mortality, cardiovascular events, etc.). However, all of the studies that look at whether omega 3s predict those outcomes turns out to be ~null. Why would I privilege the longer chain of studies (going through a new index) over the direct effects of giving people omega 3s?
Studies going through the index (does supplementation raise the index? then, separately, does the index predict events?) seem way more susceptible to statistical / data manipulation than just looking at whether supplements get a particular outcome. Plus while it lets you take apart some factors (compariong omega 3 status instead of supplement effects), you get others (what if a person's baseline omega 3 status is all that matters, and people that take supplements increase their omega 3 index but don't have any better outcomes (because they still have the negative effects of whatever caused their low baseline)?).
As someone looking at
whether to take supplements, the primary concern seems to just be
effects of supplements on outcomes, not the intermediate steps.
I understand people have different starting & ending levels over the course of supplementation. However, that's the point of randomized experimental/control groups & a large study size; a sufficiently powered study should have a low enough chance of being due to random variations in group members (hence <0.05 p-value, for <5% chance of the outcome being due to random chance, correct?)
--
In trying to figure out the state of the evidence, I came across
a meta-review of the effects of omega 3s (EPA & DHA) supplementation co-authored by William Harris. In it, we're walked through the list of intervention trials since the 80s, including the methodology and outcomes. Below I'll give a quick summary of every included trial as I understand it, then my overall thoughts. Again, I'm aware I could go wrong at any step of the chain here, so anyone stepping in to correct me would be appreciated.
--
The trials:
1980s
DART Trial - just being advised to consume >=2 servings of fatty fish weekly caused a 29% dip in all-cause mortality; subgroup given fish oil capsules got same result
1990s
GISSI-Prevention - one fish oil capsule per day = 41% reduction of risk in all-cause mortality at 3 months
2000s
DART-2 - same as DART in advising people to eat oily fish, but this
increased the risk of cardiac death compared to nonspecific advice; turns out the increased deaths came from the subgroup given fish oil (study dismissed for methodological issues)
JELIS - first (& only?) study to be primarily female; risk of sudden cardiac death ~same between control and treatment (study dismissed for lack of power to detect significance)
GISSI-HF - "first large, randomized, double-blind, placebo-controlled trial" and found 9% reduction in all-cause mortality, 8% reduction in cardiovascular hospitalizations
2010s
Alpha Omega - "double-blind, placebo-controlled, randomized, secondary prevention study" with daily EPA & DHA consumption for 40 months; no reduction in cardiovascular events, all secondary outcomes null (dismissed for reasons I don't fully understand?)
OMEGA - randomized, double blind, compared daily omega 3 capsules to olive oil controls; no difference in cardiac death or all-cause mortality (dismissed for low power, because the study authors over easimated the effects of omega 3s & had less total health events than expected)
SU.FOL.OM3 - "double-blind, randomized, placebo-controlled, 2 × 2 factorial trial" checking for positive health effects of B vitamins and omega 3s. Null results for omega 3s. (dismissed for being underpowered due to lower than expected event rate, and omega 3 supplementation being too long-term(?))
ORIGIN - looked for effects of omega 3s in those with both cardiovascular disease & diseases causing irregular blood sugar; double-blind, randomized, compared omega 3s against olive oil controls; no statistically significant decrease in death/disease (dose may be too low?)
Risk and Prevention - compared omega 3s vs olive oil control for those at high cardivascular risk who've not yet had a heart attack; randomized, double-blind; no significant decrease in measureable endpoints for the main groups; a couple of subgroup analyses showed mild beneficial effects, including specifically for women (lower than expected rates of hard cardiovascular endpoints; olive oil could an inappropriate control)
--
Some thoughts:
- There is one study showing a negative effect of omega 3s, six ~null effects, and three positive effects.
- Of the null/negative effects, the authors had reasons to dismiss almost all of them on grounds of methodological issues. But somehow there was not much discussion of methodological issues in the positive effect studies, despite them being some of the oldest? It's certainly possible that only the null studies had methodological issues, but I'd need to look into each study deeper; for now I'm just vaguely suspicious
- Some of the arguments given for why null studies were dismissed seems at odds with Harris's ongoing hypothesis
- The OMEGA study has a methodological issue of the authors overestimating the effect of omega 3s, leading to underpowered research... but that seems very odd, given the large effect Harris seems to be claiming that Omega 3s have?
- The Alpha-Omega placebo might be invalid because the placebo contains ALA (vs the EPA/DHA omega 3s that were the treatment being tested). This seems like a valid concern scientifically, but as a random layperson, if ALA is doing just as well that seems like a totally valid strike against strong claims in favor of supplementing EPA/DHA?
- Olive oil as a placebo was also put under suspicion because it could have its own heart benefits. But again, as a layperson, if olive oil helps the heart as much as EPA/DHA, I feel like the correct update is toward "EPA/DHA only helps insofar as all unsaturated fats help", which again points away from the usefulness of supplementation
- The only study called out specifically for enrolling at least 50% women found null effect in the Omega 3s group. This is could easily be a statistical aberration, but given that women process & convert Omega 3s differently (and have different cardiovascular disease symptoms), the studies seem mostly limited to the effects of omega 3s on men
- One of the biggest positive effects for omega 3s was in the DART trial where they got a 29% dip in all-cause mortality just by suggesting people eat fatty fish(!!!). That seems like a huge effect for basically zero treatment. Again, it's possible, it just seems unlikely. If the effects are this large from small interventions, I'm surprised the majority of trials ended up seeing ~no effect?
- Without knowing the number of subgroups they looked at in Risk and Prevention it could just be the jellybean effect, but it's on me to dig deeper into the original study before dismissing the outcomes.
Given the reproducibility issues in medicine -
here's a study talking about how 51-89% of medical studies fail to replicate... (the irony) - I'm just baffled by how massive of an effect Harris seems to claim for EPA/DHA. My best guess is that it has a real positive effect, but probably something more like a <= 5% reduction in all-cause mortality.
Again, apologies if this seems too one-sided in my suspicion. I genuinely don't understand the large effects claimed for EPA/DHA and am hoping to learn a lot from this thread!