the most frequently used neck disability questionnaires are the neck pain and disability scale ( npad )   and neck disability index ( ndi ) , which are validated in several languages [ 4 , 16 , 21 , 22 , 38 ] . to evaluate the effect of treatment programs for neck disorders
it is necessary that questionnaires are responsive , i.e. , have the ability to detect clinical important changes over time .
there is a need to define minimum changes in scores on questionnaires that are relevant from patients- , clinicians- or socioeconomic perspectives . to determine relevant change two concepts of interpretability
are described [ 1 , 3 , 8 , 10 , 34 ] . in a distribution - based approach the statistical characteristics of the sample
are used to express the observed change in a standardized metric [ 8 , 10 , 34 ] .
the most commonly used measure is the minimal detectable change ( mdc ) [ 3 , 57 , 9 , 10 , 16 , 22 , 29 , 32 , 36 , 38 , 40 ] .
the mdc assesses the minimal magnitude of change required to be confident that the observed change reflects 
real change and not measurement error [ 1 , 8 , 10 , 30 , 34 ] .
a major limitation of distribution - based approaches is that they are statistical measures which by themselves do not provide a good indication of the clinical relevance of the observed change [ 8 , 10 , 34 ] .
the anchor - based approach assesses which change on a questionnaire corresponds with an important change defined on an external criterion or anchor [ for example global perceived effect ( gpe ) ] [ 8 , 10 , 17 , 34 ] .
the most common method in this approach is the calculation of the minimal important change ( mic ) determined by the receiver operator characteristic ( roc ) curve cut - off point [ 68 , 10 , 23 , 29 , 33 , 34 , 40 ] .
a major limitation of the anchor - based approach is the absence of a gold standard for the external criterion .
a further limitation is that it does not take measurement precision into account and therefore does not necessarily imply statistical significance [ 8 , 10 , 34 ] .
hence , studies which apply both approaches are relevant for clinicians and researchers [ 8 , 10 , 34 ] .
moreover , there is a need of studies that assess relevant changes and compare the responsiveness of neck disability questionnaires applied at the same time to the same sample of patients using the same methods to investigate which questionnaire is most appropriate .
there are no studies assessing the mdc and the mic as concepts of interpretability of relevant change for both npad and ndi .
the aim of this study was to investigate relevant change on the npad and ndi and to investigate which questionnaire is most responsive in a single sample of patients with non - specific chronic neck pain ( cnp ) in an outpatient tertiary rehabilitation setting .
patients with cnp were recruited from referrals from general practitioners or medical specialists for diagnostic procedures as well as advices and rehabilitation treatment in a tertiary university center for rehabilitation in the netherlands . to be admitted for a multidisciplinary pain rehabilitation , patients had to agree with the time - contingent approach to restore activities and to facilitate return to work .
inclusion criteria for this study were non - specific cnp ( > 3  months duration ) , admitted for outpatient rehabilitation , age between 18 and 65  years , and sufficient knowledge of the dutch language to complete questionnaires .
neck pain was labeled as  non - specific  or mechanical when the neck pain was produced or aggravated by neck movements or sustained neck postures and no specific underlying pathology could be established [ 2 , 13 ] .
exclusion criteria were status post neck surgery , co - morbidity severely diminishing physical or mental capacity , pregnancy , addiction to drugs , and extensive psychological or behavioral problems . specific neck pain and exclusion criteria were assessed based on clinical examination with help of  red flags  and  orange flags  and based on the information of the referrals [ 25 , 26 , 31 ] .
prior to the first visit ( t0 ) a questionnaire to assess patient and clinical characteristics was filled out . during
t0 a review of the medical history and a physical examination was performed . a second visit ( t1 )
was scheduled , prior to the start of the multidisciplinary rehabilitation program . during t1 the patients filled out the npad and ndi .
after completion of the program varying from 3 to 5  months ( t2 ) , patients filled out the npad , ndi , and the gpe .
data were gathered as part of care as usual between november 2006 and october 2010 .
each item has a vas of 100  mm with numeric anchors at 0 , 1 , 2 , 3 , 4 , and 5 ( each 20  mm apart ) .
item scores range from 0 ( no pain or activity limitation ) to 5 ( as much pain as possible or maximal limitation ) .
higher scores indicate greater disability . the npad has shown to be a reliable and valid measure of disability in different languages [ 4 , 16 , 18 , 19 , 21 , 22 , 38 ] .
each item has six different assertions expressing progressive levels of pain or limitation in activities .
item scores range from 0 ( no pain or limitation ) to 5 ( as much pain as possible or maximal limitation ) .
the ndi has shown to be a reliable and valid measure of disability in different languages [ 6 , 7 , 1822 , 29 , 36 , 38 , 40 ] .
for the gpe patients were asked to rate their overall perception of change since beginning treatment ranging from 3 ( completely recovered ) to zero ( no change ) to 3 ( worse than ever ) .
the reliability of the gpe was moderate to good in patients with neck pain and chronic arthritis [ 14 , 24 ] and the validity was fair to moderate in patients with neck pain [ 6 , 7 , 24 , 29 , 40 ] .
patients were considered improved when they scored completely recovered ( 3 ) or much recovered ( 2 ) and stable when they scored slightly recovered ( 1 ) no change ( 0 ) or slightly worsened ( 1 ) .
baseline ( t0 and t1 ) variables were compared between these groups using t tests for independent samples and chi - square tests for categorical data .
mdc was calculated as 1.96    2     standard error of measurement ( sem ) .
the sem was calculated in stable patients as sd    (1    r ) where r is the test  retest reliability coefficient expressed in icc value and sd is the standard deviation of the baseline scores [ 30 , 34 ] .
roc curves were constructed to determine mic for npad and ndi [ 11 , 30 ] .
the roc cut - off point was calculated by identifying the point on the roc curve nearest to the upper left - hand corner , which is considered to be the best cut - off for which the sum of the percentages of false positives and false negatives classifications ( [ 1    sensitivity ]  +  [ 1    specificity ] ) is smallest .
responsiveness was assessed by examining areas under roc - curve ( auc ) and correlations between change scores of npad and ndi , and gpe .
auc was obtained to describe the ability of the npad and ndi to distinguish improved patients from stable patients .
auc of 0.50 indicates the questionnaire has no diagnostic accuracy beyond chance , whereas a value of 1.00 would indicate perfect accuracy .
auc of at least 0.70 was considered adequate . a visual method called  anchor - based mic distribution   method
was used to integrate anchor - based and distribution - based approaches . for the improved and stable group
the distribution of the change scores on the npad and ndi were depicted in a graph [ 11 , 12 ] .
all statistical analyses were performed with spss software , version 18.0 . the critical value for significance was p  <  0.05 .
patients with cnp were recruited from referrals from general practitioners or medical specialists for diagnostic procedures as well as advices and rehabilitation treatment in a tertiary university center for rehabilitation in the netherlands . to be admitted for a multidisciplinary pain rehabilitation , patients had to agree with the time - contingent approach to restore activities and to facilitate return to work .
inclusion criteria for this study were non - specific cnp ( > 3  months duration ) , admitted for outpatient rehabilitation , age between 18 and 65  years , and sufficient knowledge of the dutch language to complete questionnaires .
neck pain was labeled as  non - specific  or mechanical when the neck pain was produced or aggravated by neck movements or sustained neck postures and no specific underlying pathology could be established [ 2 , 13 ] .
exclusion criteria were status post neck surgery , co - morbidity severely diminishing physical or mental capacity , pregnancy , addiction to drugs , and extensive psychological or behavioral problems . specific neck pain and exclusion criteria were assessed based on clinical examination with help of  red flags  and  orange flags  and based on the information of the referrals [ 25 , 26 , 31 ] .
prior to the first visit ( t0 ) a questionnaire to assess patient and clinical characteristics was filled out . during
t0 a review of the medical history and a physical examination was performed . a second visit ( t1 )
was scheduled , prior to the start of the multidisciplinary rehabilitation program . during t1 the patients filled out the npad and ndi .
after completion of the program varying from 3 to 5  months ( t2 ) , patients filled out the npad , ndi , and the gpe .
data were gathered as part of care as usual between november 2006 and october 2010 .
each item has a vas of 100  mm with numeric anchors at 0 , 1 , 2 , 3 , 4 , and 5 ( each 20  mm apart ) .
item scores range from 0 ( no pain or activity limitation ) to 5 ( as much pain as possible or maximal limitation ) .
higher scores indicate greater disability . the npad has shown to be a reliable and valid measure of disability in different languages [ 4 , 16 , 18 , 19 , 21 , 22 , 38 ] .
each item has six different assertions expressing progressive levels of pain or limitation in activities .
item scores range from 0 ( no pain or limitation ) to 5 ( as much pain as possible or maximal limitation ) .
higher scores indicate greater disability . the ndi has shown to be a reliable and valid measure of disability in different languages [ 6 , 7 , 1822 , 29 , 36 , 38 , 40 ] . for the gpe patients
were asked to rate their overall perception of change since beginning treatment ranging from 3 ( completely recovered ) to zero ( no change ) to 3 ( worse than ever ) .
the reliability of the gpe was moderate to good in patients with neck pain and chronic arthritis [ 14 , 24 ] and the validity was fair to moderate in patients with neck pain [ 6 , 7 , 24 , 29 , 40 ] .
patients were considered improved when they scored completely recovered ( 3 ) or much recovered ( 2 ) and stable when they scored slightly recovered ( 1 ) no change ( 0 ) or slightly worsened ( 1 ) .
baseline ( t0 and t1 ) variables were compared between these groups using t tests for independent samples and chi - square tests for categorical data .
mdc was calculated as 1.96    2     standard error of measurement ( sem ) .
the sem was calculated in stable patients as sd    (1    r ) where r is the test  retest reliability coefficient expressed in icc value and sd is the standard deviation of the baseline scores [ 30 , 34 ] .
roc curves were constructed to determine mic for npad and ndi [ 11 , 30 ] .
the roc cut - off point was calculated by identifying the point on the roc curve nearest to the upper left - hand corner , which is considered to be the best cut - off for which the sum of the percentages of false positives and false negatives classifications ( [ 1    sensitivity ]  +  [ 1    specificity ] ) is smallest .
responsiveness was assessed by examining areas under roc - curve ( auc ) and correlations between change scores of npad and ndi , and gpe .
auc was obtained to describe the ability of the npad and ndi to distinguish improved patients from stable patients .
auc of 0.50 indicates the questionnaire has no diagnostic accuracy beyond chance , whereas a value of 1.00 would indicate perfect accuracy .
auc of at least 0.70 was considered adequate . a visual method called  anchor - based mic distribution   method
was used to integrate anchor - based and distribution - based approaches . for the improved and stable group
the distribution of the change scores on the npad and ndi were depicted in a graph [ 11 , 12 ] .
all statistical analyses were performed with spss software , version 18.0 . the critical value for significance was p  <  0.05 .
during the recruitment period 391 patients with cnp were referred to the center for rehabilitation .
a total of 129 patients , of which 4 were with status post neck surgery , were admitted for multidisciplinary outpatient rehabilitation .
a total of 125 patients fulfilled inclusion criteria for this study . during the waiting period 14 patients decided not to start with the rehabilitation program because of practical reasons unrelated to the study . after the start of the rehabilitation program 35 patients decided not to continue because of lack of further interest or practical reasons .
the clinical characteristics of these patients and of the 35 dropouts are presented in table  1 . after the rehabilitation program 6
patients were completely recovered as assessed with gpe , 39 much recovered , 17 slightly recovered , 10 no change , 3 slightly worsened , 0 much worsened and 1 worse than ever . in total 45 ( 60  % ) patients were labeled as improved and 30 ( 40  % ) patients as stable .
baseline differences between improved and stable patients were non - significant , as were baseline differences between improved and stable patients on the one hand and dropouts on the other hand .
more male patients dropped out than female patients.table  1baseline characteristics of improved and stable patients , and dropoutsimproved patients ( n  =  45)stable patients ( n  =  30)dropouts ( n  =  35)age ( years)37.7 ( 12.3)39.5 ( 12.0)39.2 ( 10.1)duration of chronic pain ( months)18.5 ( 9.358.5)24.0 ( 9.069.0)18.0 ( 7.548.0)sick leave in the past year ( weeks)18.5 ( 19.4)16.1 ( 17.6)17.5 ( 20.6)ndi ( 050)21 ( 5.5)21 ( 8.1)23 ( 8.6)npad ( 0100)50 ( 12.3)53 ( 16.5)56 ( 20.0)vaspain ( 0100)52 ( 20.1)52 ( 18.6)54 ( 24.8)female ( % ) 677749pain radiating to ( % )  shoulder(s)828386  upper arm(s)514054  forearm(s)332046  hand / fingers271740  between shoulder blades475350pins and needles below elbow ( % ) 363338concomitant complaints ( % )  headache846371  dizziness362735  concentration problems291712  nausea111312  fatigue695362  low back pain333149self reported cause of neck pain ( % )  motor vehicle accident564037  other trauma91317  spontaneously / unknown779  stress476  work related91014  other162317previous treatment for neck pain ( % ) 919394education  low700  intermediate697982  high242118work status ( self employed / employee ) ( % ) 4/7810/8017/60involved in litigation ( % ) 402729values are means ( sd ) unless otherwise indicatednpad neck pain and disability scale , ndi neck disability index , vas visual analog scalemedian and interquartile range for duration of pain ( months ) baseline characteristics of improved and stable patients , and dropouts values are means ( sd ) unless otherwise indicated npad neck pain and disability scale , ndi neck disability index , vas visual analog scale median and interquartile range for duration of pain ( months ) the results for npad and ndi at baseline and follow - up and the change scores in the stable and improved groups are shown in table  2 .
the icc values calculated for stable patients were 0.52 ( 95  % ci 0.330.67 ) for npad and 0.86 ( 95  % ci 0.790.91 ) for ndi .
the sem values of the stable patients were 11.4 for npad and 3.0 for ndi .
these values resulted in mdc values of 31.7 points for npad and 8.4 for ndi.table  2baseline , follow - up and mean change scores of npad and ndi for the total , improved , and stable group of patientsbaseline mean ( sd)follow - up mean ( sd)change mean ( sd)95  % cip valuenpad  total ( n  =  76)51 ( 14.0)36 ( 19.0)15 ( 17.4)11.119.2<0.001  improved ( n  =  45)50 ( 12.3)29 ( 17.3)21 ( 16.1)15.725.7<0.001  stable ( n  =  30)53 ( 16.5)46 ( 16.9)7 ( 16.2)0.313.10.04ndi  total ( n  =  76)21 ( 6.6)15 ( 7.2)6 ( 5.9)4.27.0<0.001  improved ( n  =  45)21 ( 5.5)13 ( 6.2)8 ( 6.3)5.79.6<0.001  stable ( n  =  30)21 ( 8.1)18 ( 7.7)3 ( 4.2)1.24.40.001npad neck pain and disability scale , ndi neck disability indexone patient scored  worse than ever and was not included in the improved or stable group , but was included in the total group baseline , follow - up and mean change scores of npad and ndi for the total , improved , and stable group of patients npad neck pain and disability scale , ndi neck disability index one patient scored  worse than ever and was not included in the improved or stable group , but was included in the total group roc curves for npad and ndi are presented in fig . 
the roc cut - off mic was for npad 11.5 points ( sensitivity 0.74 ; specificity 0.70 ) and for ndi 3.5 points ( sensitivity 0.74 ; specificity 0.66 ) .
changes should exceed these values of mdc and mic cut - offs ( 31.7 and 11.5 for npad and 8.4 and 3.5 for ndi ) to be interpreted as relevant .
the auc for npad was 0.75 ( 95  % ci 0.620.87 ) and for ndi 0.75 ( 95  % ci 0.640.87 ) .
the correlation between change scores of npad and ndi , and gpe were , respectively , 0.48 ( 95  % ci 0.290.64 ) and 0.49 ( 95  % ci 0.300.64).fig . 
1receiver operator characteristic ( roc ) curves of npad and ndi change scores receiver operator characteristic ( roc ) curves of npad and ndi change scores the  anchor - based mic distribution graphs for npad and ndi are presented in fig . 
2a and b. these figures illustrate the effect of using mic cut - off for change scores in the distribution of true and false positives and negatives .
when the change score equals mic , 26  % of the anchor - based improved patients have a lower change score .
they are considered false negatives because the sensitivity of npad and ndi  =  0.74 .
when the change score equals mic , 30  % ( npad ) and 34  % ( ndi ) of the anchor - based stable patients have higher change scores .
they are considered false positives because specificity of npad  =  0.70 and of ndi  =  0.66.fig . 
2distribution of npad - change scores in anchor - based improved and stable patients with indication of mic at 11.5 .
at this point sensitivity  =  0.74 and specificity  =  0.70 ( a ) .
distribution of ndi - change scores in anchor - based improved and stable patients with indication of mic at 3.5 . at this point sensitivity 
the gray parts of the improved and stable patients represent the true positives ( dark gray ) and the true negatives ( light gray ) , respectively .
mdc is indicated at 31.7 for npad and at 8.4 for ndi distribution of npad - change scores in anchor - based improved and stable patients with indication of mic at 11.5 . at this point sensitivity  =  0.74 and specificity  =  0.70 ( a ) .
distribution of ndi - change scores in anchor - based improved and stable patients with indication of mic at 3.5 . at this point sensitivity 
the gray parts of the improved and stable patients represent the true positives ( dark gray ) and the true negatives ( light gray ) , respectively .
this study demonstrated that relevant change on both npad and ndi assessed with mdc or mic resulted in different cut - offs with different amounts of certainty that the patient is improved .
furthermore , it demonstrated that the responsiveness of npad and ndi was similar when using the aucs and the correlations between change scores and the gpe .
there is no consensus regarding the number of sems required to express statistically clinically relevant change : 1    sem , 1.65    sem or 1.9    sem .
we used the 1.96    sem to correspond with 95  % ci . in the present study
mdc for npad and ndi was 31.7 and 8.4 , respectively . in a previous npad study   [
mean baseline score 39.8 ( sd 23.3 ) ] the icc was 0.97 , the sem 3.8 scale points , and follow up 12  weeks ; therefore , the mdc of 10.5 was low compared with the present study .
the iccs of 0.52 for npad and 0.86 for ndi in the present study measured on 
stable patients  was compared with the iccs of 0.76 for npad and 0.84 for ndi in a previous study in the same setting with a retest interval of 18  days .
larger instability of the npad may be explained by differences in operationalizations of neck disability between items of the npad and the ndi [ 35 , 37 ] .
post hoc analysis showed that the amount of variation of the npad could be attributed to significant differences in seven individual items ( 2 , 6 , 812 ) of the questionnaire . with an icc of 0.76 for npad
previous ndi studies report for mdc ranges between 1.7 and 13.4 [ 57 , 29 , 33 , 36 , 39 , 40 ] .
apart from different patient populations , the observed differences are most likely the result of different formula for the mdc calculation ( 1.96 or 1.65    2     sem ) and large ranges in sem ( 0.604.4 ) in these ndi studies [ 57 , 29 , 33 , 36 , 39 , 40 ] .
mic is defined as  the smallest change that is important to patients  [ 8 , 10 , 17 , 33 , 34 ] .
how to classify the smallest important change and patients as improved or stable with gpe scale levels , is an arbitrary decision [ 57 , 10 , 29 , 36 , 3840 ] . in most studies using gpe as external standard
, a 15-point scale was used with 3 ( moderately better ) as cut - off to distinguish improved from stable patients [ 6 , 7 , 29 , 39 , 40 ] .
we classified patients as improved when their score completely recovered or much recovered to reflect important improvement similar to other studies [ 11 , 29 ] .
mic for ndi has been reported to range from 3.5 to 9.5 [ 57 , 29 , 33 , 39 , 40 ] .
differences between these studies and the present study could be the result of several factors , such as different external criteria ( prognostic estimate of change , health transition item of sf-36   and gpe by patient [ 6 , 7 , 29 ] or by patient and therapist ) , the number of scale levels of the external criteria , the combination of scale levels to form the improved and stable group , characteristics of population ( such as age , nature and acuity of neck condition , patient setting , baseline scores ) , treatment , and period of follow up [ 57 , 29 , 39 , 40 ] .
the auc was used to determine the probability that the improved patient can be correctly distinguished from the stable patient . in this study npad and ndi
both have an auc of 0.75 which is a satisfactory result and in line with results found by other studies ( range 0.570.90 ) [ 6 , 7 , 22 , 29 , 32 , 33 , 39 , 40 ] .
the auc of 0.90 for the ndi was reported in a study using a prognostic estimate of change as external criterion made by clinicians at patient s initial visit . in one study   responsiveness of npad and ndi
clinicians should be aware of the fact that choosing either the mdc or the mic cut - off gives different values and amounts of certainty on whether the observed change is relevant .
smaller values for the mic were observed in almost all neck pain studies including the present study [ 57 , 29 , 39 , 40 ] . using the anchor - based mic the proportion of false positives and false negatives
, the probability of false positives is reduced and the probability of false negatives is increased . applying the more conservative mdc ,
the certainty that the change score is relevant and larger than the measurement error , is high .
the amount of certainty needed may depend on the consequences in patient care and could be a case by case decision .
for example for risk , full neck surgery or an expensive time - consuming multidisciplinary rehabilitation the more conservative mdc cut - off could be used , while in primary care setting the more liberal mic cut - off could be used . on the other hand , socio - economic factors such as chance of returning to work as result of a therapy may be also of importance as external criterion for relevant change . in the present study ,
the visual  anchor - based mic distribution method was used whereby the distribution of the change scores on the npad and ndi was depicted in curves .
the narrower the curves and the smaller the overlap of the curves , the smaller the chance of misclassification .
both aspects of the curves largely depended on the correlation between change scores of npad and ndi and gpe as anchor . in the present study
these correlations were similar to those of most other npad ( range 0.420.59 ) [ 16 , 22 , 38 ] and ndi ( range 0.190.58 ) studies [ 6 , 7 , 22 , 32 , 3840 ] .
the gpe as external criterion to operationalize relevant change has been criticized because it consists of only one question and patient s ability to recall their previous health status is questionable [ 15 , 27 ] .
any anchor - based approach is as good as the used external criterion and the methodology to define relevant change .
the present study is conducted in a university setting and is therefore representative of patients with cnp in a tertiary referral center .
percentage of females was similar to that of other responsiveness studies [ 47 , 16 , 21 , 22 , 29 , 32 , 33 , 36 , 38 , 40 ] . mean age in our study was lower ( 38.5  years ) compared with other responsiveness studies [ 47 , 16 , 21 , 22 , 29 , 32 , 33 , 36 , 38 , 40 ] .
a potential limitation of this study is that the sample consisted largely of patients with moderate neck pain and disability .
although this may be expected in this tertiary rehabilitation setting generalizability beyond this setting can not be assumed .
the dropouts did not introduce bias because this study was aimed to measure the questionnaires and not the effect of the rehabilitation program .
the strength of this study is that relevant changes were assessed with mdc and mic on the npad and ndi and that a head - to - head comparison of the responsiveness of npad and ndi was performed .
further study of mdc , mic , and responsiveness of npad and ndi is necessary to assess the measurement properties in other patient groups and also in comparison with other external criteria for relevant change .
relevant change of both npad and ndi assessed with mdc and mic resulted in different cut - offs with different amounts of certainty that the patient is improved .
this article is distributed under the terms of the creative commons attribution license which permits any use , distribution , and reproduction in any medium , provided the original author(s ) and the source are credited .
 purposeto investigate relevant change on the neck pain and disability scale ( npad ) and neck disability index ( ndi ) and which questionnaire is the most responsive in patients with non - specific chronic neck pain ( cnp).methodsseventy - six patients with non - specific cnp in an outpatient tertiary rehabilitation setting were dichotomized into  improved  and  stable  based on global perceived effect ( gpe ) scores . to investigate relevant change minimal detectable change ( mdc ) and minimal important change ( mic ) with the receiver operator characteristic ( roc ) 
 cut - off point were assessed . 
 comparison of responsiveness was performed using areas under the roc curve ( auc ) and correlations between change scores of npad and ndi , and gpe.resultsmdc and mic on npad ( scale 0100 ) were 31.7 and 11.5 points , respectively . 
 mdc and mic on ndi ( scale 050 ) were 8.4 and 3.5 points , respectively . 
 changes should exceed this mdc or mic cut - off to be interpreted as relevant . 
 auc was 0.75 for both npad and ndi . 
 correlations between change scores of npad and ndi , and gpe were , respectively , 0.48 ( 95  % ci 0.290.64 ) and 0.49 ( 95  % ci 0.300.64).conclusionsrelevant change on both npad and ndi assessed with mdc and mic resulted in different cut - offs and consequently with different amounts of certainty that the patient is improved . 
 responsiveness of npad and ndi was similar . 
Introduction
Materials and methods
Study sample
Procedures
Measurements
Data analyses and interpretation
Results
Discussion
Conclusion
Conflict of interest
Open Access