andrewducker: (default)
andrewducker ([personal profile] andrewducker) wrote2008-10-13 08:34 pm

Feedback #1 - Thanks to the science people

I'm not going to reply to everyone on the last post, so a general "thanks" to everyone that replied. Lots of interesting stuff there.

One of the interesting things in the responses was the number of people who thought they should let me know that it wasn't a peer-reviewed paper in a renowned journal. Clearly, I knew that - it was someone's personal page, with their thoughts on it. If it had been a published paper I wouldn't have bothered asking you lot, I'd have had a look to see if it had been refuted.

Similarly, some people seemed to think that because it wasn't presented as Pure Science, but also had personal opinion, it couldn't have anything to it, an approach I find frankly baffling.

However, there were also plenty of good arguments against it, and while some of the ideas are interesting, I'm certainly not taking it at face value. Cheers to all of you!

[identity profile] ninox.livejournal.com 2008-10-13 07:50 pm (UTC)(link)
Peer review process is flawed and doesn't stand up to the test of modern medium. The problem is that no-one has found a good alternative. Peer reviewed journals are not the be all and end all in modern health information, hence why I sent a variety of tools which can be used to evaluate content.

Why are you baffled by the science aspect? Let me ask you this - you are a health professional dealing directly with patient care. When you are legally liable for treatment, would you go on the strength of someones opinion or would you go on the results of scientific evidence?

Opinion (in relation to health care) is only crediable if it comes from an authoritive source, many people can not judge this simple basic principle.

There are heirarchies of evidence on which we judge the credibility of a study.

http://medicine.mercer.edu/files/fammed_clerk_evidencepyramid.pdf

There are variations of this model but they all run along the same principles. We generally only use case report upwards unless it is something with little literature. As your example has little literature it currently can not fully be dismissed and is in need of further investigation.

[identity profile] ninox.livejournal.com 2008-10-13 08:03 pm (UTC)(link)
You asked should it be believed. I answered from a professional perspective and I didn't say nonsense. I stated it was a theory yet to be proven and in need of research.

Science can prove or disprove these kind of theories and personal opinions. This is valid no matter who you are.

[identity profile] ninox.livejournal.com 2008-10-13 08:14 pm (UTC)(link)
Don't worry I'm not taking it personally, just answering in my own way and hopefully for those interested in appraising information giving them a start on how to do it.

[identity profile] henriksdal.livejournal.com 2008-10-14 02:58 pm (UTC)(link)
"This is a personal blog, by someone outside of their field, and it has stuff in it that's their feelings. Therefore it's bad."

Wasn't your question whether or not the claims she was making had any validity? "I'm wondering if it's junk science, or it's something I should be paying attention to." Eh? What was your question then? That's nothing about "are personal opinions valid?" I feel like this is some sort of trick..

[identity profile] henriksdal.livejournal.com 2008-10-14 03:05 pm (UTC)(link)
Ohh OK - I thought you were responding with "You're all wrong! HAHAHAHA!" I thought it wasn't worth paying attention to because it cited wikipedia, which, as we all know, is run by 16 year olds. But had you already decided if it was worth paying attention to when you asked the question?

[identity profile] henriksdal.livejournal.com 2008-10-14 03:11 pm (UTC)(link)
Oh I see! I apologise for being particularly dense about all of this and not understanding the question *returns to kitten*

[identity profile] henriksdal.livejournal.com 2008-10-14 03:19 pm (UTC)(link)
Something like "can anyone back up the claims in this essay better than I can?" or "is anyone familiar with this"? Is that more like what you meant?

[identity profile] ninox.livejournal.com 2008-10-13 07:58 pm (UTC)(link)
Sorry I meant credibility of information rather than study.

[identity profile] robhu.livejournal.com 2008-10-13 08:00 pm (UTC)(link)
My point was not to make you aware that it's not peer reviewed (which is obvious), but rather to imply that for those of us who lack the background to properly analyse complex scientific claims we can be led on a merry jig by anyone who does write an article like the one you linked to. It might be true, or it might not - really you need a sufficiently well trained person to have a look at it (which is what you asked for), but even then it seems a bit pointless as the best they could say is no this is BS.

[identity profile] robhu.livejournal.com 2008-10-13 08:05 pm (UTC)(link)
Oh OK. I assumed at the end of it you might want to have the article influence your life in some (more tangible) way.

[identity profile] endless-psych.livejournal.com 2008-10-13 09:43 pm (UTC)(link)
Mixing science and personal opinion, without any clear demarcation, is pretty much equivalent to tabloid journalism. Also it wasn't that the article presented science and personal opinion to a large extent it presented personal opinion as science.

[identity profile] endless-psych.livejournal.com 2008-10-14 09:45 am (UTC)(link)
I'd be shocked and appalled if it turned out I'd presented personal opinion as science though.

[identity profile] drdoug.livejournal.com 2008-10-14 03:52 pm (UTC)(link)
Hmm - for me, it's a question of weight of claim and weight of evidence. The central claims are ... somewhat beyond what conventional scientists studying autism spectrum disorders generally think. For me to think it's worth looking in to further, I'd want to see some pretty conclusive evidence that'd been fairly solidly tested. Hence the serious journal article standard.

It's not that such anecdotal arguments are automatically wrong - they aren't. And it's not that people writing well outside their expertise can't come up with important new ways of conceptualising a field - they do. But it doesn't happen very often. And as I've no doubt you're aware from a casual glance at the Internet, there are an awful lot more people who think they have a rock-solid revolutionary new understanding of some issue than actually do. There really isn't enough time to wade through them all and debunk them step-by-step.

A big or unusual claim needs more in the way of evidence than a small run-of-the-mill one. If I claimed to have eaten quiche for lunch today, most people would take that on trust. If I claimed to have lived on nothing but air for a decade, most people would want some pretty damn compelling independent evidence (and would probably doubt it anyway). The claims in the article were pretty large and pretty unusual and there was only the sketchiest evidence presented.

As Sagan said (or something like it): they laughed at Galileo, they laughed Columbus, they laughed at the Wright brothers, but they also laughed at Bozo the Clown. And I don't think it's too much of a big or unusual claim to say that there are far more bozos than unappreciated geniuses on the web. (And I speak as a bozo.)