Probably?
(Mainly) bayesian data analysis with a philosophical twist

False positives in DNA identification 1

One context in which probabilities are extensively used is the use of DNA evidence. In testifying about the DNA match at trial, experts often assess the probability that a random person, unrelated to the crime, would coincidentally match the crime stain profile (random match probability). RMP is often an impressively low number, say 1 in 100 million or lower. Usually, such a match is taken to constitute strong evidence against the defendant.

However, while DNA evidence seems as scientific as it gets, the risk of a false positive is not negligible (Shaer, 2016). For instance, Houston Police Department Crime Laboratory, a large public forensic center in Texas, handles around 500 cases a year. In 2016, KHOU 11, a local television station, sent dozens of profiles processed by the lab to independent experts. The results were not optimistic: police technicians quite systematically misinterpreted samples.

One notorious case involving a false positive is that of Josiah Sutton (then 16) and Gregory Adams (then 19), who were arrested for a rape of a 41-year-old woman. The victim was abducted in a parking lot and assaulted in a driving car (Ford Expedition). A few days after the incident, the victim spotted Sutton and Adams walking down a street, flagged down a patrol car, and accussed them of the assault. Both Sutton and Adams had alibis, neither of them matched the victim’s original description of the perpetrators. Sutton and Adams agreed to a DNA test to clear their names. A Houston lab analyst Christy Kim compared their results with DNA obtained from a vaginal swab, which contained a mixture of genetic material from at least three contributors, including the victim herself. The lab report did not report a match for Adams, but concluded that Sutton’s DNA was consistent with the mixture DNA. In result, in 1999, Sutton was sentenced to 25 years in prison. Later on, a re-examination by prof. William Thompson, indicated that the three DNA profiles typed by Kim (two from blood, one from saliva) varied, despite reportedly coming from a single source. Moreover, Kim failed to report that the DNA from the semen found on the car seat did not match that of Sutton. In effect, the DNA evidence was reprocessed, no DNA match was found, and in 2003 Sutton was released from prison.[1]

This is only one example of DNA matching going awry, and the existing anecdotal evidence suggests there are quite a few potential sources of error. See for instance Thompson (2013) for a more exhaustive treatment and multiple examples. Check out Josiah Sutton’s entry in the national registry of exonerations, and a discussion of the case in a newspaper.

Shaer, M. (2016). The false promise of DNA testing. The Atlantic, (June). Retrieved from https://www.theatlantic.com/magazine/archive/2016/06/a-reasonable-doubt/480747/

Thompson, W. C. (2013). Forensic dna evidence: The myth of infallibility. In S. Krimsky & J. Gruber (Eds.), Genetic explanations: Sense and nonsense (pp. 227–347). Harvard University Press.

[1] Christy Kim later on sued her employer for her firing that resulted and won, her mistakes being atttributed to systemic failures and inadequate supervision.

Josiah Sutton (source: The national registry of exonerations).