Two decades ago, a new form of genetic testing helped send a man to prison. But the case exposed the limits of using complicated forensics in a criminal trial.