Something like this is useful for the types of data points patients would have no reason to self-deceive over, however I worry that the general tendency for people to make their 'data' fit the stories they've written about themselves in their minds will promote superstitions. For example, a friend of mine is convinced that the aspartame in diet soda caused her rosacea/lupus. She's sent me links to chat-rooms that have blamed aspartame for everything from diabetes to alzheimer's, and it's disturbing to see the kind of positive feed-back loops that are created from anecdotes in which chat members state a clear link exists between symptoms and usage. One says, "I got symptom X after drinking diet soda," and another says, "I have symptom X, it must be from drinking diet soda!" and another says, "Thanks, after reading your comments, I stopped drinking diet soda and symptom X went away!" In spite of chat rooms dedicated to blaming diet soda for every conceivable health problem and the fall of American values, no scientific study to date has shown ANY negative side effect of aspartame even at the upper bounds of current human consumption.

Another example of hysterical positive-feedback would be the proliferation of insane allegations that the MMR vaccine causes autism. I would guess angry parents who wanted to believe MMR caused their child's autism would plot their 'data points' for the onset of their child's symptoms right after vaccination.

A site like this one may allow certain trends to rise out of the noise, but we must not forget the tendency people have to lie to themselves for a convenient story.

You don't want to rely on studies in medical journals because their conclusion-drawing methodologies are haphazard.

I dispute none of this, but so far as I can tell or guess, the main thing powering the superior statistical strength of PatientsLikeMe is the fact that medical researchers have learned to game the system and use complicated ad-hoc frequentist statistics to get whatever answer they want or think they ought to get, and PatientsLikeMe has some standard statistical techniques that they use every time.

Also, I presume, PatientsLikeMe is Bayesian or Bayes-like in that they take all available evidence into account and update incrementally, while every medical experiment is a whole new tiny little frequentist universe.

This is not really an article about PatientsLikeMe being strong, it is an article about the standard statistical methods of academic science being weak and stupid.

I fear this might suffer from Google's problem: once it becomes relied on, the persistent factor which was relied upon gets corrupted.

You can treat it as information, but not as science - it's not protected from malice the same way scientific studies are.

Awesome.

Pie in the sky fantasizing:

What I'd really love to see is much cheaper and faster chemical/bio assays, something like a blood glucose monitor that could read out hormone levels, vitamin levels, hematocrit, etc. Something easy enough for millions of people to adopt and commit to on a daily basis. Throw it all into a giant database along with each participant's genome for good measure. The personal insights individuals could gain by comparing their data to the entire database would probably have a much more profound effect on health than a few decades worth of drug development -- of course, the tool would be invaluable for drug development as well.

The first thing that comes to my hyper paranoid mind is what would happen, for example, if the lithium did seem to work for these patients. Who would then prescribe the lithium, and based on what? If it isn't supported by ordinary studies (let's assume it isn't) and it's not even remotely standard of care, then there's going to be some trouble.

So I'm a progressive doctor, and I look this data over and I say to give it a try; and the patient dies of lithium toxicity. Seems like they have a good case against me.

I do think it's a defensible maneuver (they could still sue me, though) but my worry is more about the very difficult position this puts everyone in. I'm not against this type of research, just wondering aloud.

I'd speculate that this is better suited for surveillance, or for identifying which subgroups benefit more or less from a treatment. Everyone's going to hate this idea, but I think it's quite realistic: it would be great if doctors in general uploaded such data to a common site, especially about illnesses for which novel treatments are lacking. Pharma could/would help cover the costs, of this I am sure.

Free the data!

The reporting engine they have created is impressive but it always better to have more people looking at the data. Who knows what mashups hackers on the side would make?

I applaud the idea of getting a large set medical data together though crowd sourcing. I just wish anyone could run there own statistics on the data.

This is great. But what's FRS?

The "people" in the quoted bit are correct. This is not science; this is statistical analysis.

It is possible that an individual would be better served by this social network, though I have generally agreed that a physician who treats himself has a fool for a patient, and the more so for a layman who neglects to consult competent medical authorities. These social networks certainly cannot take the place of original research; they rely on existing observed trends.