Introduction
Scales | Abbreviated items |
---|---|
Skill discretion (6 items) | Q3: “learn new things” |
Q4: “repetitive work”a
| |
Q5: “requires creative” | |
Q7: “high skill level” | |
Q9: “variety” | |
Q11: “develop own abilities” | |
Decision authority (3 items) | Q6: “allows own decisions” |
Q8: “little decision freedom”a
| |
Q10: “lot of say” | |
Psychological demands (5 items) | Q19: “work fast” |
Q20: “work hard” | |
Q22: “no excessive work”a
| |
Q23: “enough time”a
| |
Q26: “conflicting demands”a
| |
Supervisor support (4 items) | Q48: “supervisor is concerned” |
Q49: “supervisor pays attention” | |
Q51: “helpful supervisor” | |
Q52: “supervisor good organizer” | |
Coworker support (4 items) | Q53: “coworkers competent” |
Q54: “coworker interest in me” | |
Q56: “friendly coworkers” | |
Q58: “coworkers helpful” | |
Physical demands (5 items) | Q21: “much physical effort” |
Q24: “lift heavy loads” | |
Q25: “rapid physical activity” | |
Q30: “awkward body positions” | |
Q31: “awkward arm positions” |
Centers | Brussels | Ghent | Lille | Milana
| Leiden | Gothenburg 95 | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
M | W | M | W | M | W | M | W | M | W | M | W | |
Sample size | 7,105 | 2,909 | 9,230 | 2,175 | 1,726 | 371 | 1,738 | 3,112 | 682 | 202 | 479 | 562 |
Sampling period (years) | 1994 to 1998 | 1995 to 1998 | 1996 to 1997 | 1991 to 1997 | 1994 to 1996 | 1994 to 1995 | ||||||
Age (years): Mean (SD) | 45.9 | 44.3 | 45.9 | 44.4 | 43.0 | 42.0 | 44.4 | 42.8 | 42.8 | 43.7 | 47.5 | 47.4 |
(6.0) | (5.7) | (6.0) | (5.6) | (5.8) | (5.9) | (6.7) | (5.5) | (5.4) | (5.4) | (7.3) | (7.0) | |
Education (years): Mean (SD) | 12.5 | 12.0 | 12.5 | 12.1 | 11.9 | 13.9 | 10.4 | 9.4 | 10.4 | 11.2 | 12.4 | 12.5 |
(3.3) | (2.8) | (3.1) | (2.8) | (2.8) | (3.5) | (2.9) | (3.1) | (5.5) | (5.6) | (3.9) | (3.4) | |
Translated JCQ (language) | Flemishb/Frenchc
| Flemish | French | Italian | Dutch | Swedish |
Materials and Methods
The JACE-JCQ Database
Samples and Items for Cross-Language DIF Analyses
Scales | JCQ items | Brusselsa
| Lille | Milan | Leiden | Gothenburg 95 | Percent of samples with DIF (primary analysis) | Percent of samples with DIF (secondary analysis) | ||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Primary | Primary | Secondaryb
| Primary | Secondaryb
| Primary | Secondaryb
| Primary | Secondaryc
| ||||
Skill discretion | Q3 | O | + | + | O | O | − | − | O | O | 40 | 40 |
Q4 | O | − | − | − | − | − | O | O | O | 60 | 40 | |
Q5 | O | O | O | − | − | O | O | O | O | 20 | 20 | |
Q7 | O | − | − | + | + | + |
+
| + | O | 80 | 60 | |
Q9 | O | O | O | O | O | O | O | O | O | 0 | 0 | |
Q11 | + | + | + | + | + | + |
+
| + | O | 100 | 80 | |
Decision authority | Q6 | O | O | O | − | O | O | O | O |
+
| 20 | 20 |
Q8 | O | O | O | O | O | O | O | O | O | 0 | 0 | |
Q10 | O | O | O | + | + | O | O | O | O | 20 | 20 | |
Psychological demands | Q19 | O | O | O | − | − | O | O | − | − | 40 | 40 |
Q20 | O | O | O | + | + | + | + | O | O | 40 | 40 | |
Q22 | O | O | O | O | O | + | + | + | + | 40 | 40 | |
Q23 | O | − | − | − | − | O | O | O | O | 40 | 40 | |
Q26 | O | + |
+
| O | O | − | − | O | O | 40 | 40 | |
Supervisor support | Q48 | − | − | − | O | − | O | O | 50 | 75 | ||
Q49 | O | O | O | O | O | O | O | 0 | 0 | |||
Q51 | O | + | + | − | − | − | − | 75 | 75 | |||
Q52 | O | + | + | + | + | + | + | 75 | 75 | |||
Coworker support | Q53 | O | O | O | O | O | O | O | + | + | 20 | 20 |
Q54 | O | O | O | O | O | O | O | + | + | 20 | 20 | |
Q56 | O | O | O | O | O | O | O | − | − | 20 | 20 | |
Q58 | − | − | − | O | O | − | − | − | − | 80 | 80 | |
Physical demands | Q21 | O | O | O | − | − | O | O | − | O | 40 | 20 |
Q24 | O | + | + | − | − | O | O | + | O | 60 | 40 | |
Q25 | O | O | O | O | O | − | − | O | O | 20 | 20 | |
Q30 | O | O | O | + | + | O | O | O | O | 20 | 20 | |
Q31 | O | − | − | + |
+
| O | O | 50 | 50 | |||
% of DIF items: | 11.1 | 44.4 | 44.4 | 55.6 | 55.6 | 40.7 | 37.0 | 45.5 | 27.3 | 39.2 | 36.2 |
Weighting Samples
DIF Analysis Procedures
Results
Cross-Cultural Comparisons of the DIF Items by Site
Comparison Between Judgmental Reviews on Translation Equivalence and Statistical DIF Analyses
Scales | JCQ items | Judgmental reviews The Flemish JCQ : The Dutch JCQ | Statistical DIF analysis |
---|---|---|---|
(conceptual difference or any missing/adding words?) | (category of DIF items) | ||
Skill discretion | Q3 | – | C |
Q4 | ‘Repetitief’(repetitive) : ‘kortdurende’ (short lasting) | B | |
Q5 | – | A | |
Q7 | – | C | |
Q9 | ‘Nogal’ (quite some) : ‘heel veel’ (a lot of) | A | |
Q11 | ‘Bijzondere bekwaamheden’ (special abilities) : ‘vakbekwaamheid’ (profession) | C | |
Decision authority | Q6 | ‘Dikwijls’ (often)a : ‘veel’ (many) | A |
Q8 | – | A | |
Q10 | Missing word for ‘a lot’a : ‘veel’ (a lot) | A | |
Psychological demands | Q19 | – | B |
Q20 | – | C | |
Q22 | – | C | |
Q23 | – | A | |
Q26 | Adding ‘op het werk’ (at work)a : no word for it | C | |
Supervisor support | Q48 | ‘Ondergeschikten’ (subordinates) : ‘medewerkers’ (co–workers) | A |
Q49 | – | A | |
Q51 | ‘Mijn werk’ (my work)a : ‘het werk’ (work in general) | C | |
Q52 | ‘Goed’ (well) – work well together a: no word for it – work together | C | |
Coworker support | Q53 | ‘Competente’ (competent) and ‘weten’ (know) : ‘goed (well) | A |
Q54 | ‘Als person’ (as an individual) : missing word for it | A | |
Q56 | – | B | |
Q58 | – | C | |
Physical demand | Q21 | – | A |
Q24 | – | A | |
Q25 | ‘Inspanning’ (effort) : ‘activiteiten’ (activities) | C | |
Q30 | ‘Onnatuurlijke’ (unnatural) : ‘ongemakkelijk’ (uncomfortable) ‘vaak en gedurende lange periodes’ (often AND during long periods) : ‘Vaak langdurig’ (often during long periods) | B | |
Q31 | ‘Onnatuurlijke’ (unnatural) : ‘ongemakkelijk’ (uncomfortable) no word for ‘vaak’ (often) : adding ‘vaak’ | B |
Impact of DIF Items on the Scale-Level Mean Comparisons with the Ghent Sample
JCQ scalesa
| Items used for scales | Men | Cohen’s d
|
p value | Women | Cohen’s d
|
p value | ||
---|---|---|---|---|---|---|---|---|---|
Brussels | Ghent | Brussels | Ghent | ||||||
Skill discretion | Full items = (Q3 + Q4 + Q5 + Q7 + Q9 + Q11) × 2 | 34.67 | 35.20 | −0.08 | .000 | 31.67 | 32.29 | −0.09 | .003 |
Non-DIF items = (Q3 + Q4 + Q5 + Q7 + Q9) × 2 × (6/5) | 34.74 | 35.81 | −0.17 | .000 | 31.80 | 32.87 | −0.15 | .000 | |
DIF item = (Q11) × 2 × 6 | 34.10 | 32.09 | 0.22 | .000 | 30.89 | 29.29 | 0.17 | .000 | |
Supervisor support | Full items = (Q48 + Q49 + Q51 + Q52) | 10.87 | 10.71 | 0.06 | .000 | 10.83 | 10.56 | 0.10 | .001 |
Non-DIF items = (Q49 + Q51 + Q52) × (4/3) | 10.97 | 10.64 | 0.13 | .000 | 10.86 | 10.46 | 0.15 | .000 | |
DIF item = (Q48) × 4 | 10.55 | 10.90 | −0.11 | .000 | 10.80 | 10.86 | −0.02 | .581 | |
Coworker support | Full items = (Q53 + Q54 + Q56 + Q58) | 12.15 | 12.02 | 0.07 | .000 | 11.96 | 12.02 | −0.03 | .234 |
Non-DIF items = (Q53 + Q54 + Q56) × (4/3) | 12.20 | 12.00 | 0.11 | .000 | 12.04 | 12.02 | 0.01 | .761 | |
DIF item = (Q58) × 4 | 11.96 | 12.07 | −0.05 | .003 | 11.68 | 12.00 | −0.13 | .000 |
Impact of DIF Items on the Scale-Level Mean Comparisons Among Multi-Language Samples
JCQ scales | Used items for scales | Brussels | Ghent | Lille | Milan | Leiden | Goth.95 |
p value | Brussels | Ghent | Lille | Milan | Leiden | Goth.95 |
p value |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Men: means(rank, rank group based on statistical significance test) | Women: means(rank, rank group based on statistical significance test) | ||||||||||||||
Skill discretion | Full items | 34.67 (5, II) | 35.20 (3, II) | 35.66 (2, II) | 31.06 (6, III) | 35.14 (4, II) | 36.96 (1, I) | 0.000 | 31.67 (4, II) | 32.29 (3,II) | 32.96 (2,II) | 30.40 (6,III) | 31.42 (5, II) | 35.51 (1,I) | 0.000 |
Non-DIF item (Q9) | 36.23 (5, II) | 36.53 (3, II) | 38.05 (1, I) | 34.56 (6, III) | 36.48 (4, II) | 37.74 (2, I) | 0.000 | 33.58 (5, II) | 34.09 (4, II) | 35.32 (2, I) | 35.21 (3, II) | 33.07 (6,II) | 37.14 (1,I) | 0.000 | |
DIF item (Q11) | 34.10 (4, II) | 32.09 (5, III) | 36.46 (1, I) | 30.88 (6, III) | 35.11 (3, I) | 35.52 (2, I) | 0.000 | 30.89 (4, II) | 29.29 (6, III) | 34.95 (1,I) | 30.02 (5, II) | 31.84 (3,II) | 34.12 (2, I) | 0.000 | |
Decision authority | Full items | 34.90 (4, II) | 34.96 (3, II) | 36.46 (1, I) | 30.38 (6, III) | 34.78 (5, II) | 36.29 (2, I) | 0.000 | 32.89 (3,II) | 32.68 (4,II) | 34.24 (2, I) | 31.32 (6,III) | 31.54 (5,III) | 34.57 (1, I) | 0.000 |
Non-DIF item (Q8) | 33.54 (5, II) | 34.54 (4, II) | 35.70 (3, I) | 29.60 (6, III) | 35.74 (2, I) | 36.33 (1, I) | 0.000 | 33.19 (4,I) | 33.16 (5, I) | 34.31 (3, I) | 31.82 (6,II) | 34.55 (2,I) | 35.32 (1, I) | 0.000 | |
DIF itema (Q6) | 37.09 (3, II) | 36.84 (4, II) | 37.91 (2, I) | 30.80 (6, III) | 36.19 (5,II) | 39.26 (1, I) | 0.000 | 33.67 (4,II) | 33.78 (3, II) | 35.68 (2,I) | 30.12 (6, IV) | 30.27 (5, IV) | 36.87 (1, I) | 0.000 | |
Psychological demands | Full items | 31.37 (4, III) | 30.47 (6, III) | 30.72 (5, III) | 32.97 (1, I) | 31.72 (3, II) | 32.52 (2, I) | 0.000 | 32.17 (4, I) | 31.11 (6,II) | 33.01 (1, I) | 31.30 (5,II) | 32.23 (3, I) | 32.64 (2, I) | 0.000 |
Non-DIF item (Q20) | 32.37 (1, I) | 30.32 (4,II) | 31.63 (3,I) | NA | NA | 32.02 (2, I) | 0.000 | 33.47 (2, I) | 32.00 (4,II) | 34.67 (1, I) | NA | NA | 32.09 (3, II) | 0.000 | |
Non-DIF item (Q22) | 30.68 (2, II) | 29.56 (3, II) | 29.18 (4,III) | 33.95 (1, I) | NA | NA | 0.000 | 31.43 (2, I) | 30.09 (4,II) | 31.36 (3,I) | 32.31 (1,I) | NA | NA | 0.000 | |
DIF itemb (Q23) | 27.88 (5, II) | 28.84 (3, II) | 25.64 (6, III) | 29.27 (2, II) | 28.55 (4, II) | 31.26 (1, I) | 0.000 | 29.05 (4, II) | 29.54 (2,II) | 27.92 (5,II) | 26.80 (6, III) | 29.15 (3, II) | 31.39 (1, I) | 0.000 |