Showing posts with label scientific procedure. Show all posts
Showing posts with label scientific procedure. Show all posts

Thursday, June 2, 2011

Phineas and Ferb, Climate Change and Language Barriers



I recently read an article on climate change that made me laugh. Not because it was particularly funny, but because it was about the language discrepancy between the scientific community and the lay person. In this article they attributed the general population's reluctance to believe in climate change to the lack of concrete language used by the researchers. They urged these experts to use more black and white statements and "regular" language. This is the point where I laughed.

Because here's the thing. We just can't do it! When I went to write this blog post I looked for the original article I read but couldn't find it. I did however find a great article here and I love this portion of it:

"Scientists are often compelled by their education to tell you more about what isn't known than what is known. That intellectual and academic honesty allows critics to use the scientists' own honesty as a brickbat to pummel their work. As an example, for the past 20 years when reporters would call and ask whether this flood, or hurricane or that tornado was due to global warming, the entire scientific community studying the effects of increased CO2 in the atmosphere would say, "No single event can be attributed to global warming." That is the truth, and climate change skeptics will use that honesty to say, "See, there's no detectible change." "

As a scientist myself I understand this dilema. The more you study science the more variables you discover and you start getting in to the, well that depends on what the definition of "is" is! And it's true. Define your terms is a common phrase in the scientific community. What do you mean by "change?" It's a valid question to the scientific community and unfortunately the lay comunity just thinks you're being difficult or avoiding the truth, when another scientist would simply define their terms and move on.

So why am I talking about climate change on a forensic blog? Because this language barrier exists every time you take the stand. Not only do we have the barrier between ourselves and the jury, but then you have to throw in lawyers and hoo boy, now you have a third language!

I'm reminded of an episode of my son's favorite show. In Phineas and Ferb, the spy bosses give Perry the platapus a robot, but then tell him that the manual is only in Dutch. Unfortunately they don't have a Dutch to English dictionary, but they do have a Dutch to French Dictionary and a French to English Dictionary. So Perry has to use both dictionaries to figure out how to control the robot.

That's like being an expert witness. You have to translate the attorneys question from legalese into science speak and then translate your science speak into layman's terms for the jury. Here's the problem. There are no dictionaries. When you gain familiarity to the legal community you get to the point where you know what they mean to ask even if that's not quite where they're asking, and over time you begin to answer what they mean to ask as opposed to what they actually asked.

Now, what do I mean by this? In breath testing for example an attorney may ask you "Is this test accurate?" I have always hated this question. Why? Because all the attorney wants to know is, is this test right or wrong. To me, my science side starts piping up and yelling in the background what do you mean by "accurate?" To what degree? And accurate of what? Of what the instrument saw or the body burden of the individual?

To answer that question I would state what I was relying upon and then answer whether the test result met the accuracy requirments as by Rule for what the instrument saw in the breath chamber. Is that what the attorneys were always asking? No, probably not.

And the reason I say that it is probably not is because I often run into attorneys who don't understand how two different test results could both be "accurate." Well, define your terms. What do you mean by accurate? When a scientist answers that question they're going to answer whether they were within the accuracy limits required (10% in Vermont for breath alcohol testing) for what was in the instrument at the time the sample was analyzed. If that isn't what the attorney wants to know then they need to change the question.

Although scientists are often aware that there is a language barrier I find that attorneys are often baffled by it. I have often sat on the stand arguing what appears to be minutea to the attorney but what matters quite a bit to me. It's furstrating because although I may know what they mean by their question I simply can not answer it if the terms are inaccurate.

And this is why the urge to researchers to change their dialogue when speaking about their research is doomed to fail. They are still scientists and they must first and foremost be repsected in that community. A person who speaks in blacks and whites and absolutes is not a scientist and will not be taken seriously by that community. That's not how research works. The scientific process will always be to form a hypothesis and then try to disprove it. The answers will always be that the evidence thus far indicates or research suports x, y and z. It will never be x causes z. It will never be in absolutes.

In order to be effective in the courtroom, expert witnesses need to be able to bridge the language barriers without compromising their scientific integrity. It's a difficult balance because you often do fall into answering what is meant by the question as opposed to what is asked. That is why it is so important to qualify every answer you give with what you are basing your answer on. The problem remains that there are no dictionaries and far too often attorneys or the public may not realize that there even is a barrier present.

How we can work more effectively together and walk that line is a difficult one and if anyone has ideas that have worked well, let me know. To me the best we can do is help the attorneys we work with understand that words matter. They already understand this concept in the court room they just need to understand that there is another language spoken by scientists.

I love how the article I mentioned above ends:

"So, scientists are changing the message. It is a subtle change, but important. When reporters like me ask the question, "Was the flood, or the drought or the tornadoes caused by global warming?" The scientists now respond, "No single event can be attributed to global warming, but we told you this was going to happen.""

To scientists that's the compromise you'll get and it's the best our integrity will allow.

Thursday, October 28, 2010

The Forensics of Horror Part IV: Ghosts

"It said: 'I am the invisible nonentity. I have affinities and am subtle. I am electric, magnetic, and spiritualistic. I am the great ethereal sigh-heaver. I kill dogs. Mortal, wilt thou choose me?'" Sir Arthur Conan Doyle






Stories of ghosts are observed in every culture. Every child has pretended to be one. Countless stories and movies have starred them, and now the trend is to hunt them with scientific equipment, because if we use scientific equipment then we must be doing science!
Now, I won't say whether I believe in ghosts or not. I've known many people who swear they've encountered ghosts. Even Vermont's own police academy is said to be haunted and many say they've dealt with Mary during their overnight visits. Whether we believe or not is really not the point. The point is could we prove they exist or do not exist in a court of law? Could we prove beyond a reasonable doubt that a house is haunted?

Proving something does not exist or did not happen is nearly impossible so we'll eliminate that aspect. Indeed, even our legal system has been changed so that the defendant does not have to prove that they did not do something, because how is that possible? How do you prove a negative?

Instead, let's talk about proving their existence. There are several wildly popular shows using "science" to investigate the paranormal. They have their scientific tools and they use these to profess that what they are doing is science. However, just as holding a scalpel does not make you a surgeon, holding an EMF recorder does not make you a scientist. In fact, Ghost Hunting Kits are sold in many places. For $160 dollars you too can be an expert paranormal investigator!

Ghost Hunting tend to focus on several measurements, they look for fluctuation in electromagnetic fields, changes in temperature, strange drafts or breezes and abnormal photographic or phonic recordings. Why? Because places that have stories of hauntings have these variations. Therefore these variations must mean there are ghosts present. There's a problem with this logic.

Let's try a hypothesis, shall we? I have been to resorts in Mexico. At these resorts many people exhibited signs of impairment including euphoric behavior, fine motor skill impairment, slurred speech etc. Therefore, Mexican resorts cause impairment. If I go to a house and see this same behavior then I know that I am in a Mexican resort. Tada!

This is very similar to the observations and measurements made by Ghost Hunters. First off, the Ghost Hunters lack a control group. Measurements of the same nature should be made in houses which have not shown any signs of haunting. Do these same EMF fluctuations exist? Are there cold spots? Strange drafts? I live in an old farm house that I have never, ever observed paranormal activity in, and I can tell you, we have cold spots and drafts. If these same measurements exist in the control group then they are not linked directly to ghostly activity and should be discounted as indicators. Just as signs of impairment should  not be used as an indicator that we are at a Mexican Resort.

Control groups are always used in any credible scientific study. In terms of impairment the control group is typically the same group of individuals before they have been administered an impairing substance. Therefore you isolate the number of variables at any one time.

Ok, so there is no control group, do the Ghost Hunters reduce the number of variables? Well, they use the same equipment and presumably the same people to do the measurements so there is no variable there. Of course this leads to a new problem which we will discuss in a moment. However, they move to new locations each time. Each location is different. Are measurements done throughout a long extended period under a variety of factors? No. Is the non-paranormal edge looked at? Is a home inspector brought in?
As Sherlock Holmes said: 
"How often have I said to you that when you have eliminated the impossible, whatever remains, however improbable, must be the truth?" Of course, they're not trying to eliminate the other reasons. As opposed to trying to prove that something is not correlated as scientific procedure dictates, Ghost Hunters are looking to prove that there is a correlation and this is much simpler to do. Anything you find can be evidence because you say it is so.

Now, as for our new problem. By using the same equipment and the same people the Ghost Hunters are adding a new problem. Reproducibility. Are their measurements reproducible by an independent group as is required in any scientifically valid study? No, of course not. That would not be good tv.

I could go on, but for the sake of brevity let's leave it at this: The evidence of ghosts obtained by shows like "Ghost Hunters" would not be sufficient to prove ghostly existence in a court of law. Scientific procedure is not followed and as of yet I would say there is no scientifically or legally valid proof that ghosts exist.

However, I would be interested in seeing someone do just that.