Reader Comments

Post a new comment on this article

Additional information for Readers on performance of Detect-Ready MRSA Panel in this study

Posted by DetectReady on 30 Oct 2012 at 10:31 GMT

We believe there is additional information readers should know when assessing the conclusions drawn in this article. First, the sensitivity of the Detect-Ready MRSA Panel reported in this study is much lower than the sensitivity reported in all other studies with the Detect-Ready MRSA Panel. The authors of this paper acknowledge this fact. However, more is known about this anomaly in performance results than the authors chose to include. The omissions have been discussed at length with the authors, were acknowledged by the authors, and were fully credited by the authors in a previous public presentation of this material. The fact that this information is completely absent from this article undermines its accuracy and utility.

We worked closely with the authors during the design and conduct of this study. In response to the higher-than-expected number of false negative results generated by the Detect-Ready MRSA Panel in the study, we undertook an investigation into the possible causes. Our researchers found that 7 of the 11 samples reported as MRSA false negatives were tested using a single batch of PCR mastermix, which on retesting showed an unexpected deterioration in performance in two of the four amplification reactions in the PCR.

We informed the authors about the results of these investigations prior to any public presentation of this material. In response, the authors included a written report on, and acknowledgment of, the results of our investigations when they presented the same data earlier this year as a poster at the 22nd European Congress of Clinical Microbiology and Infectious Diseases (ECCMID) meeting on April 23, 2012. Yet despite having publicly acknowledged the issue at ECCMID, the authors omitted it entirely from the discussion in this paper. We believe that considerations of accuracy, good scientific method and transparency make it essential that the authors include this information—that the effect of a known product performance issue from a single batch of PCR mastermix was a probable cause of the unusually low sensitivity of the assay in this study. The EECMID poster included the following language added by the authors:

“The manufacturer of the Detect-Ready MRSA Panel has investigated why the sensitivity of the assay reported in our study was significantly lower than the normal sensitivity of at least 98%. Their investigation reported that 7 of the 11 samples reported as false negative for MRSA were tested with the same batch of PCR Reaction Tubes, which on retesting showed significant deterioration in performance in two of the four channels used by the assay. The cause of the failure of one batch of PCR Reaction Tubes has been identified and corrective actions implemented, which include a follow up study performed by our laboratory.”

As soon as the cause of the reduced product stability affecting this batch was identified, corrective actions were implemented. A follow up study performed by our laboratory then confirmed that the problem was limited to the one batch, and our previous performance levels are again consistently being achieved. Corrective actions included permanent changes in aspects of our production process to ensure this problem does not re-occur.

In view of this situation, we believe that this study as published by PLOS is not an accurate representation of the performance of the Detect-Ready MRSA Panel.

Tzvi Tzubery, Ph.D.
Director of Research and Development
Molecular Detection Inc.

Competing interests declared: R&D Director for Molecular Detection Inc, manufacturer of the Detect-Ready MRSA Panel

RE: Additional information for Readers on performance of Detect-Ready MRSA Panel in this study

schildgeno replied to DetectReady on 30 Oct 2012 at 12:35 GMT

We have carefully read the comments by Dr. Tzubery and have to contradict the conclusions drawn.

First, the study design was designed in a manner that the normal routine would have been performed. The study design was performed exculsively by the the investigators that contributed to the manuscript and was provided to the German distributor (Alere, Cologne).

Second, we reported the problems with the assay at an early state to Molecular Detection Inc., namely to David Wilson from the London Office of the company. The initial response was that there were no problems with the assay. As soon as we prepared the ECCMID poster presentation we were informed that we should wait for further information. A week before the conference start the above mentioned technical issues were reporteds to us, thus we agreed to post a notice aside our poster.

Unfortunately, so far we have not seen the original data related to this information and thus decided not to include this information in our manuscript but informed David Wilson that we will submit the manuscript and that the company should post a comment on our manuscript accomanied by those original data.
We also agreed to test a novel assay version with another 500 samples in our clinical routine, but so far did not get any reply or proposal for a study design.
Moreover, a number of problems we experienced with the assay remain even if we take into account the problems reported by the manufacturer. So far the software that is part of the assay cannot differentiate between a minor population of MRSA overgrown by MSSA and a true negative swab, thus a small number of samples would have still produced a false negative result.

However, it was not our intention to miscredit the assay, but if we would have ordered the assay for routine usage the rate of false results would have been unacceptable high.
We also are convinced that the assay has the potential to become an important tool in molecular MRSA diagonstics, provided its "teething troubles" will be eliminated.

Competing interests declared: Oliver Schildgen reports to have received travel grants from Roche Diagnostics, Germany.

RE: RE: Additional information for Readers on performance of Detect-Ready MRSA Panel in this study

DetectReady replied to schildgeno on 01 Nov 2012 at 10:40 GMT

Whether or not one accepts the statements included in Dr. Schildgen’s response (and we do not), in our view none justifies the decision not to include the information we had provided to Dr. Schildgen in this paper, which would have enabled readers to make these assessments on their own.

Competing interests declared: R&D Director for Molecular Detection Inc, manufacturer of the Detect-Ready MRSA Panel