Development and Adaptation of Questionnaires in Scientific Research Work
Study Course Implementer
Riga, 5 J. Asara Street, vppk@rsu.lv, +37167061587
About Study Course
Objective
Preliminary Knowledge
Learning Outcomes
Knowledge
1.Student defines and explains basic concepts of psychometrics, measurement scales, reliability and validity criteria for tests and surveys.
Examination • Attendance • Individual work
2.Demonstrate understanding of the stages of development of tests and surveys and explain standardisation and adaptation procedures.
Individual work
Skills
1.Use the terminology acquired in the study course.
Examination • Individual work • Attendance
2.Discuss in a reasoned manner the types of tests and surveys and their design and adaptation;
Attendance • Examination
3.Plan pilot study for adaptation/construction of test/survey.
4.Translate the test/survey and correctly prepare the stimulus materials necessary to perform it.
Individual work
5.Calculate and analyse the psychometric parameters of the test/survey articles and scales.
Individual work
6.Use the SPSS programme to calculate the psychometric parameters of tests/surveys.
Individual work
7.Discuss in a reasoned manner the stages of development of tests and surveys, measurement scales, verse analysis, safety and validity of tests and surveys.
Examination • Attendance
Competences
1.Ability to expertly perform the adaptation/construction of the test/survey in a new cultural environment in accordance with psychometric principles.
Examination
Assessment
Individual work
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Individual work |
30.00% from total grade
|
Test
|
|
Students choose a test/questionnaire to adapt or formulate what variable the test/survey should be designed to measure. - Working in groups, students formulate/translate the items of the selected test/questionnaire, describe the test/survey administration procedure, prepare the necessary stimulus materials for the pilot study, present the pilot study plan. - Students carry out a pilot study, process and analyse the necessary data, analysing, describe and present the results. |
||
Examination
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Examination |
60.00% from total grade
|
10 points
|
|
1. Prepare, describe and agree on a pilot study plan and implementation steps (40%): • The survey/test items are clearly formulated. • The test/survey administration procedure is correctly described. • Stimulus material is properly prepared. • Steps to be followed for the implementation of the pilot study are in line with the guidelines of the International Test Commission. 2. Prepare and submit a pilot study report on the development or adaptation of the test/questionnaire (40%): • The report is submitted on time. • The report is fully compliant in form and content and is very well integrated and justified.• The work has appropriate structure and content and is well integrated and reasonable. Presents a pilot study report on the development or adaptation of the test/questionnaire (20%). • The presentation reflects the stages of the test/questionnaire development r adaptation that have been completed. • Uses appropriate terminology during the presentation, is able to justify his/her opinion, answer questions. • Is able to engage productively in discussion of other students' presentations. |
||
|
2.
Attendance |
10.00% from total grade
|
Test
|
Study Course Theme Plan
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Introduction to the study course. Types of psychological tests and questionnaires. Concepts of psychometrics, principles of test and survey design.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of test and questionnaire development, measurement scales, item analysis, reliability and validity, standardisation and adaptation samples.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Principles for the preparation of pilot studies for test/survey adaptation or development. Items' formulation/translation.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Principles for the preparation of pilot studies for test/survey adaptation or development. Items' formulation/translation.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Processing of data from the pilot study. Calculation and analysis of psychometric indicators of tests/surveys. Using the SPSS software to calculate test/survey item scores.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Processing of data from the pilot study. Calculation and analysis of psychometric indicators of tests/surveys. Using the SPSS software to calculate test/survey item scores.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Analysis of test/survey items and scale structure in SPSS. Description and interpretation of results.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Analysis of test/survey items and scale structure in SPSS. Description and interpretation of results.
|
Bibliography
Required Reading
Bender, M., & Adams, B. (Eds.). (2021). Methods and Assessment in Culture and Psychology (Culture and Psychology). Cambridge: Cambridge University Press.Suitable for English stream
John Rust, Michal Kosinski, & David Stillwell. (2021). Modern Psychometrics : The Science of Psychological Assessment: Vol. Fourth edition. Routledge.Suitable for English stream
Hernández-Orallo, J. (2017). The Measure of All Minds: Evaluating Natural and Artificial Intelligence. Cambridge: Cambridge University Press.Suitable for English stream
Mārtinsone K, Pipere A, Martinsone K, Pipere A, Berķis U, Cauce V et al. (2021). Zinātniskās darbības metodoloģija: starpdisciplināra perspektīva. Riga: Rīgas Stradiņa universitāte, 608 p.
Patil, S. (2020). Research Methodology in Social Sciences. NIPA.Suitable for English stream
Additional Reading
Cripps, B. (Ed.). (2017). Psychometric testing: Critical perspectives. John Wiley & Sons, Incorporated.Suitable for English stream
Holmes Finch. (2016). Applied Psychometrics Using SPSS and AMOS. Information Age Publishing.Suitable for English stream
Hong Jiao. (2020). Innovative Psychometric Modeling and Methods. Information Age Publishing.Suitable for English stream
Hong Jiao. (2018). Technology Enhanced Innovative Assessment: Development, Modeling, and Scoring From an Interdisciplinary Perspective. Information Age Publishing.Suitable for English stream
Stehlik-Barry, K., & Babinec, A. J. (2017). Data Analysis with IBM SPSS Statistics. Packt Publishing.Suitable for English stream
Other Information Sources
Educational and Psychological MeasurementSuitable for English stream
Psychological AssessmentSuitable for English stream
European Journal of Psychological AssessmentSuitable for English stream
International Journal of TestingSuitable for English stream
International Test Commission Guidelines for Translating and Adapting TestsSuitable for English stream