Background
Physical literacy assessment
Portuguese physical education and PL
The Portuguese physical literacy assessment (PPLA)
Methods
Studies overview
Domain identification
Theoretical framework | Operational definition (number of items) | Instruments used as reference | |
---|---|---|---|
Psychological Domain | |||
Motivation | Reasons for engaging in movement and physical activity in response to internal or external factors [1] | ||
Foundation: Controlled motivation (5 items) | |||
Mastery: Autonomous motivation (5 items) | |||
Confidence | Psychological need satisfaction -Perceived competence [57] | A belief in self-worth and ability to perform in movement and physical activity [1] | Psychological Need Satisfaction in Exercise Scale (PNSE) [56] |
Foundation: Beliefs of self-worth and ability (5 items) | |||
Mastery: Beliefs of self-worth and ability in challenging contexts (5 items) | |||
Emotional Regulation | Emotional Intelligence [58] | Ability to manage emotions and resulting behaviors in relation to movement and physical activity [1] | Wong and Law’s Emotional Intelligence Scale (WLEIS) [59] |
Foundation: Awareness of own emotions and other’s (5 items) | |||
Mastery: Emotional regulation and control (5 items) | |||
Physical Regulation | NA | Recognizing and managing physical signals such as pain, fatigue and exertion [1] | NA |
Foundation: Awareness of physical signals (5 items) | |||
Mastery: Regulation and management of physical signals (5 items) | |||
Social Domain | |||
Culture & Society | Sport Education [60] | Appreciation of cultural values which exist within groups, organizations and communites [1] | NA |
Foundation: Participation in sport’s cultural phenomena (5 items) | |||
Mastery: Valuing participation in sport’s cultural phenomena and encouragement of others to do so (5 items) | |||
Ethics | Moral principles that govern a person’s behavior, relating to fairness and justice, inclusion, equity, integrity, and respect [1] | Fair Play Questionnaire in Physical Education (FPQ-PE) [63] | |
Foundation: Respect for basic moral and ethical principles in physical activity contexts (fair-play) (5 items) | |||
Mastery: Autonomy and empowerment of others in respecting moral and ethical principles in physical activity contexts (fair-play) (5 items) | |||
Collaboration | Personal and Social Responsibility [64] | Social skills for successful interaction with others, including: communication, cooperation, leadership and conflict resolution [1] | Personal and Social Responsability Questionnaire (PSRQ) [65] |
Foundation: Respect and cooperation with others | |||
Mastery: Caring and leading others to success | |||
Relationships | Psychological need satisfaction -Perceived Relatedness [57] | Building and maintaining respectful relationships that enable a person to interact effectively with others [1]. | Psychological Need Satisfaction in Exercise Scale (PNSE) [56] |
Foundation: Interaction and relatedness with others | |||
Mastery: Management and maintaining relationships with others |
Content | Operational definition |
---|---|
Nutrition | Foundation: Identify healthy food options (C1) |
Mastery: Evaluate impact of energetical balance in regulation of body weight (C2) | |
Fitness and training | Foundation: Identify main components of physical fitness (C3) |
Mastery: Evaluate training methods for components of physical fitness (C4) | |
Safety and risk | Foundation: Identify safety rules and principles in physical activities (C5) |
Mastery: Interpret doping’s impact on health and sport ethics (C6) | |
PA Health Benefits | Foundation: Identify general physical activity guidelines for children, adolescents, and adultsa(C7) |
Mastery: Relate types of training with their benefits for health (C8) | |
Body composition | Foundation: Identify Body Mass Index’s calculation formula (C9) |
Mastery: Evaluate body composition profile and make recommendations (C10) |
Item generation
Psychological and social modules
Cognitive domain
Content validity
Cognitive interviews
Evaluation by experts
Pilot testing
Preliminary item analysis
Results
Domain identification
Psychological domain
Social domain
Cognitive domain
Content validity
Version one (v0.1): cognitive interviews
Version two (v0.2): expert evaluation – 1st round
Module Element (items) | Relevance | Clarity | ||||
---|---|---|---|---|---|---|
Kappa1 | S-CVI (Ave2/UA3) | Kappa4 | ||||
Elimination | Good | Excellent | Revision | Clear | ||
1st round (version 0.2) | ||||||
Cognitive | .87 / .60 | |||||
Nutrition (C1 & C2) | 1 | – | 1 | 1 | 1 | |
Fitness and training (C3 & C4) | – | – | 2 | 2 | ||
Safety and risk (C5 & C6) | – | – | 2 | 1 | 1 | |
Health benefits of PA (C7 & C8) | – | – | 2 | 1 | 1 | |
Body composition (C9 & C10) | – | – | 2 | – | 2 | |
Psychological | .98 / .93 | |||||
Motivation (P1-P9, P37) | – | – | 10 | 1 | 9 | |
Confidence (P10-P18, P38) | – | – | 10 | – | 10 | |
Emotional Regulation (P19-P27, P39) | – | – | 10 | – | 10 | |
Physical Regulation (P28-P36, P40) | – | – | 10 | 1 | 9 | |
Social | .90 / .68 | |||||
Culture & Society (S1-S9, S37) | 1 | 4 | 5 | 4 | 6 | |
Ethics (S10-S18, S38) | – | – | 10 | – | 10 | |
Collaboration (S19-S27, S39) | – | 4 | 6 | 3 | 7 | |
Relationships (S28-S36, S40) | 2 | 1 | 7 | 2 | 8 | |
2nd round (version 0.3) | ||||||
Social | .96* / .84* | |||||
Culture & Society | – | – | 10 | 5 | 5 |
Version three (v0.3): 2nd round results for Culture & Society element
Version four (v0.4): pilot Testing & Cognitive Interviews
Feasibility
Preliminary reliability (psychological and social modules)
Psychological Module | Social Module | ||||||
---|---|---|---|---|---|---|---|
Element (Subscale) | Item | Outer Loading | Subscale Reliabilitya | Element (Subscale) | Item | Outer Loading | Subscale Reliabilitya |
Motivation (Foundation) | P1 | .32 | .76/ .22 | Culture (Foundation) | S1 | .69 | .66/ .79 |
P2 | −.81 | S2 | .79 | ||||
P3 | −.77 | S3 | .34 | ||||
P4 | .37 | S4 | .91 | ||||
P5 | −.10 | ||||||
Motivation (Mastery) | P6 | .85 | .87/ .91 | Culture (Mastery) | S5 | .88 | .86/ .90 |
P7 | .86 | S6 | .87 | ||||
P8 | .88 | S7 | .81 | ||||
P9 | .80 | S8 | .89 | ||||
P37 | .67 | S34 | .54 | ||||
Confidence (Foundation) | P10 | .88 | .93/ .95 | Ethics (Foundation) | S9 | −.14 | .57/ .59 |
P11 | .87 | S10 | −.95 | ||||
P12 | .92 | S11 | −.88 | ||||
P13 | .91 | S12 | −.28 | ||||
P14 | .86 | S13 | .11 | ||||
Confidence (Mastery) | P15 | .81 | .70/ .80 | Ethics (Mastery) | S14 | .27 | .36/ .53 |
P16 | .84 | S15 | .81 | ||||
P17 | .21 | S16 | −.51 | ||||
P18 | .81 | S17 | .72 | ||||
P38 | .59 | S35 | .61 | ||||
Emotional Regulation (Foundation) | P19 | .70 | .75/ .76 | Collaboration (Foundation) | S18 | .77 | .81/ .87 |
P20 | .66 | S19 | .91 | ||||
P21 | .44 | S20 | .58 | ||||
P22 | .74 | S21 | .69 | ||||
P23 | .55 | S22 | .80 | ||||
Emotional Regulation (Mastery) | P24 | .68 | .61/ .78 | Collaboration (Mastery) | S23 | .83 | .80/ .87 |
P25 | .75 | S24 | .84 | ||||
P26 | .65 | S25 | .88 | ||||
P27 | .85 | S26 | .80 | ||||
P39 | .21 | S36 | .35 | ||||
Physical Regulation (Foundation) | P28 | −.28 | .62/ .17 | Relationships (Foundation) | S27 | .73 | .85/ .90 |
P29 | −.26 | S28 | .79 | ||||
P30 | −.14 | S29 | .90 | ||||
P31 | .78 | S30 | .91 | ||||
P32 | .76 | ||||||
Physical Regulation (Mastery) | P33 | .80 | .76/ .84 | Relationships (Mastery) | S31 | .91 | .74/ .91 |
P34 | .38 | S32 | .68 | ||||
P35 | .85 | S33 | .79 | ||||
P36 | .83 | S37 | .60 | ||||
P40 | .69 |
Item analysis (cognitive module)
Content | p1 | D2 | Evaluation3 | Distractor analysis (%)4 | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Level | Item | Response Option | |||||||||
a | b | c | d | e | f | ||||||
Nutrition | Foundation | C1 | .95 | .08 | – | 0 | 95 | 5 | 0 | – | – |
Mastery | C2 | .78 | .31 | + | 3 | 5 | 13 | 80 | – | – | |
Fitness and training | Foundation | C3 | .45 | .54 | ++ | 48 | 45 | 5 | 3 | – | – |
Mastery | C4 | .32 | .77 | ++ | 33 | 10 | 15 | 43 | – | – | |
Safety and risk | Foundation | C5* | .40 | .54 | ++ | 98 | 0 | 80 | 15 | 90 | 45 |
Mastery | C6 | .82 | .31 | + | 3 | 3 | 85 | 10 | – | – | |
PA’s Health Benefits | Foundation | C7 | .32 | .46 | ++ | 33 | 20 | 15 | 33 | – | – |
Mastery | C8 | .80 | .23 | – | 10 | 8 | 3 | 80 | – | – | |
Body Composition | Foundation | C9 | .15 | .23 | – | 15 | 18 | 53 | 15 | – | – |
Mastery | C10* | .10 | .23 | – | 43 | 13 | 90 | 5 | 53 | – | |
Average p | .50 |