AssessmentsSensitivity and specificity
Sensitivity and specificity
In (sequential/simultaneous) testing, there is a gain in net specificity because a negative on any test is considered negative.
USMLE® Step 1 style questions USMLE
A cardiology clinic at an academic medical center is conducting a study regarding new automated ECG monitors. The computers in the new ECG monitors were designed to have an increased ability to aid in electrophysiologic disease diagnosis. The monitors are placed on 450 patients with and without various cardiac conditions. Data from the ECG computer are compared with hand measurements by a fellowship trained cardiologist. The outcomes for patients diagnosed with first degree AV block are displayed in the table below. Which of the following represents the sensitivity of the new ECG monitors in diagnosing first degree AV block?
Content Reviewers:Rishi Desai, MD, MPH
Let’s say a new screening test is developed to figure out if people have diabetes before they start showing symptoms. Before using the test, we have to make sure that the test works - in other words, can the test correctly identify if a person has diabetes or not? This is the test’s validity, and it has two components - sensitivity and specificity.
A test with high sensitivity will correctly identify most people who have the condition, and a test with high specificity will correctly identify most people who don’t have the disease.
We can organize the results using a 2 by 2 table, where the true disease status, positive or negative, of the individual is on the top of the box and the results of the screening test, positive or negative, are on the side, and each of the cells is labeled a, b, c, or d. In this situation, a positive test indicates that a person has diabetes.
And lastly a person who gets a negative test result even though they have diabetes, would be a false negative.
In this situation, the sensitivity would be 80%, because there are 100 people who truly have diabetes - cell a plus cell c, and 80 of them - in cell a - are true positives. In other words, this test will correctly identify 80% of people who have diabetes.
The specificity would be 89%, because 900 people don’t have diabetes, cell d plus cell b, and 800 of them - in cell d - are true negatives. In other words, this test will correctly identify 89% of people who don’t have diabetes.
Sometimes deciding if a person has a condition is a matter of yes or no - like having a cavity or not having a cavity - but other conditions are on the continuous scale, like blood glucose level. For these conditions, there has to be a cut- off point that makes the test result either positive or negative.
Even though the blood sugar levels of people with diabetes tends to be higher, there’s no clear cut-off point because there’s a lot of overlap in the blood glucose levels of people with and without diabetes.
Let’s say that we pick a high cut- off value. Then, bringing back our 2 by 2 table, we can see that we might end up with only 2 false positives, but 15 false negatives, so the test has high specificity and low sensitivity, and a large number of people that have diabetes won’t be diagnosed.
That can be a serious problem for conditions that need to be diagnosed early, either because they develop quickly or can only be cured in the early stages.
On the other hand, let’s say that we pick a low cut- off value. Then we might end up with only 3 false negatives, but 14 false positives, so the test has high sensitivity and low specificity, and a large number of people that don’t have diabetes will be misdiagnosed as having it!
That can lead to extra anxiety and a lot of extra expense related to unnecessary medical workups for something that they don’t even have.
So there’s always a trade- off between sensitivity and specificity, so choosing an appropriate cut- off point should depend on the severity of the disease being screened for, the effectiveness of available treatments, and whether the effectiveness is greater if the treatment is administered earlier rather than later.
Now, to calculate sensitivity and specificity, we would have to know the number of individuals who truly have the condition or don’t.
But this usually isn’t the case, since the whole purpose of testing is to figure out if a person has a certain condition.
So, a newly developed test is often compared to an existing gold standard test - the best known test that already exists.
For example, the gold standard test for diabetes is the oral glucose tolerance test, which involves measuring blood glucose levels before and after drinking a certain amount of glucose sugar.
But the oral glucose tolerance test takes multiple hours to complete and it can’t really be used to screen a lot of people at a time, so a new test called the fasting plasma glucose test was developed because it’s simpler and faster.
The fasting plasma glucose test only requires one blood sample and is usually taken in the morning, after a person has fasted overnight.
But before it was put into practice, the fasting plasma glucose test was compared to the oral glucose tolerance test, to make sure it had a relatively high sensitivity and specificity.
Oftentimes, an individual will be tested using two tests, either sequentially or simultaneously.