Development and Adaptation of Questionnaires in Scientific Research Work
Study Course Implementer
Riga, 5 J. Asara Street, vppk@rsu.lv, +37167061587
About Study Course
Objective
Preliminary Knowledge
Learning Outcomes
Knowledge
1.Student defines and explains basic concepts of psychometrics, measurement scales, reliability and validity criteria for tests and surveys.
Examination • Individual work
2.Demonstrate understanding of the stages of development of tests and surveys and explain standardisation and adaptation procedures.
Practical work in harm’s way • Individual work
Skills
1.Use the terminology acquired in the study course.
Examination • Individual work • Practical work in harm’s way
2.Discuss in a reasoned manner the types of tests and surveys and their design and adaptation;
Examination
3.Plan pilot study for adaptation/construction of test/survey.
Practical work in harm’s way
4.Translate the test/survey and correctly prepare the stimulus materials necessary to perform it.
Individual work
5.Calculate and analyse the psychometric parameters of the test/survey articles and scales.
Individual work • Practical work in harm’s way
6.Use the SPSS programme to calculate the psychometric parameters of tests/surveys.
Practical work in harm’s way • Individual work
7.Discuss in a reasoned manner the stages of development of tests and surveys, measurement scales, verse analysis, safety and validity of tests and surveys.
Examination
Competences
1.Ability to expertly perform the adaptation/construction of the test/survey in a new cultural environment in accordance with psychometric principles.
Examination
Assessment
Individual work
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Individual work |
30.00% from total grade
|
Test
|
|
Students choose a test/questionnaire to adapt or formulate what variable the test/survey should be designed to measure. - Working in groups, students formulate/translate the items of the selected test/questionnaire, describe the test/survey administration procedure, prepare the necessary stimulus materials for the pilot study, present the pilot study plan. - Students carry out a pilot study, process and analyse the necessary data, analysing, describe and present the results. |
||
Examination
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Examination |
60.00% from total grade
|
10 points
|
|
1. Prepare, describe and coordinate the pilot study plan and implementation steps (40%): • The questionnaire/test articles are clearly worded. • The procedure for administering the test/survey is correctly described. • The required stimulant material has been correctly prepared. • The expected steps for implementing the pilot study are in line with the International Test Commission guidelines. 2. Prepare and submit a pilot study report on the development or adaptation of the test/survey (40%): • The report has been submitted in time. • The report is fully in line with form and content and is very well integrated, grounded. 3. Present a pilot study report on the development or adaptation of the test/survey (20%): • The presentation reflects the stages of development or adaptation of the test/survey. • use appropriate terminology during the presentation, be able to substantiate your opinion, answer questions. • be productive in engaging in discussions about presentations from other students. |
||
|
2.
Practical work in harm’s way |
10.00% from total grade
|
Test
|
Study Course Theme Plan
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Introduction to the study course. Types of psychological tests and questionnaires. Concepts of psychometrics, principles of test and survey design.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of test and questionnaire development, measurement scales, item analysis, reliability and validity, standardisation and adaptation samples.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Principles for the preparation of pilot studies for test/survey adaptation or development. Items' formulation/translation.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Principles for the preparation of pilot studies for test/survey adaptation or development. Items' formulation/translation.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Stages of questionnaire/test development and adaptation and their evaluation criteria. International Test Commission guidelines. Process of conducting a pilot study. Preparation of stimulus material.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Processing of data from the pilot study. Calculation and analysis of psychometric indicators of tests/surveys. Using the SPSS software to calculate test/survey item scores.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Processing of data from the pilot study. Calculation and analysis of psychometric indicators of tests/surveys. Using the SPSS software to calculate test/survey item scores.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Analysis of test/survey items and scale structure in SPSS. Description and interpretation of results.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Analysis of test/survey items and scale structure in SPSS. Description and interpretation of results.
|
Bibliography
Required Reading
Bender, M., & Adams, B. (Eds.). (2021). Methods and Assessment in Culture and Psychology (Culture and Psychology). Cambridge: Cambridge University Press.Suitable for English stream
John Rust, Michal Kosinski, & David Stillwell. (2021). Modern Psychometrics : The Science of Psychological Assessment: Vol. Fourth edition. Routledge.Suitable for English stream
Hernández-Orallo, J. (2017). The Measure of All Minds: Evaluating Natural and Artificial Intelligence. Cambridge: Cambridge University Press.Suitable for English stream
Mārtinsone K, Pipere A, Martinsone K, Pipere A, Berķis U, Cauce V et al. (2021). Zinātniskās darbības metodoloģija: starpdisciplināra perspektīva. Riga: Rīgas Stradiņa universitāte, 608 p.
Patil, S. (2020). Research Methodology in Social Sciences. NIPA.Suitable for English stream
Additional Reading
Cripps, B. (Ed.). (2017). Psychometric testing: Critical perspectives. John Wiley & Sons, Incorporated.Suitable for English stream
Holmes Finch. (2016). Applied Psychometrics Using SPSS and AMOS. Information Age Publishing.Suitable for English stream
Hong Jiao. (2020). Innovative Psychometric Modeling and Methods. Information Age Publishing.Suitable for English stream
Hong Jiao. (2018). Technology Enhanced Innovative Assessment: Development, Modeling, and Scoring From an Interdisciplinary Perspective. Information Age Publishing.Suitable for English stream
Stehlik-Barry, K., & Babinec, A. J. (2017). Data Analysis with IBM SPSS Statistics. Packt Publishing.Suitable for English stream
Other Information Sources
Educational and Psychological MeasurementSuitable for English stream
Psychological AssessmentSuitable for English stream
European Journal of Psychological AssessmentSuitable for English stream
International Journal of TestingSuitable for English stream
International Test Commission Guidelines for Translating and Adapting TestsSuitable for English stream