Psychometric Evaluation Services and Survey Support

Scientifically grounded and reliable methods are essential when important decisions are made based on data and measurements. Surveys are increasingly used for data collection, but the questions and response scales are often not designed according to research on survey methodology and questionnaire design. In addition, survey-based measurements rarely undergo rigorous scientific quality assurance.

Using scientifically validated methods, we help design and refine surveys to ensure that every component contributes effectively to the overall purpose of the measurement.

Quality-Assured Survey Development

Perhaps the most important quality criterion for surveys and response scales is their ability to measure what they are intended to measure, that is, the validity of the survey. At the same time, the respondent experience must be taken into account. In an era of declining response rates and increasing survey fatigue, methods are needed that encourage high participation and elicit honest and reliable responses, ensuring that the results accurately reflect reality.

A thorough understanding of the survey response process, and ensuring that questions are interpreted consistently by all respondents, is essential. RISE has extensive expertise in questionnaire design, response scales, survey methodology, and cognitive testing methods. We can also support data collection methods, fieldwork, and non-response adjustment (see Statistical Analyses).

Quality-Assured Measures of Intangible Constructs

Sometimes what we want to measure is not directly observable, such as experiences, emotions, or attitudes. These constructs are often measured using survey questions with ordinal response categories, for example:

1. Strongly agree
2. Partly agree
3. Hardly agree
4. Do not agree at all

However, such responses are often analyzed as if they were numerical interval data, which can lead to biased estimates of the underlying construct (such as an attitude, ability, or experience).

Using Item Response Theory (IRT) and advanced measurement methods, we can transform ordinal data (category-based data) into interval-level data (data with equally spaced scale steps). RISE has extensive expertise in IRT, enabling us to ensure the validity, precision, and comparability of measurements.

Typical Project Process

1. Needs Assessment and Planning

Initial discussions to understand the purpose, objectives, and measurement needs. We can also provide expertise in impact evaluation and measurement.

2. Survey Design and Development

We identify and map the relevant theoretical frameworks underlying what is to be measured. We design and develop survey questions and response scales, or refine existing ones. For psychometrically based instruments, we place particular emphasis on ensuring validity and reliability. We often recommend pilot studies to test and evaluate survey items before implementation.

3. Analysis and Refinement

We analyze collected data to verify that the measures capture the intended constructs. We conduct quality assessments of the data and provide recommendations for improvement and adjustment.

4. Reporting

Delivery of finalized survey questions and response scales, together with a report containing implementation guidance and analytical recommendations.

Our Areas of Expertise at a Glance

Survey Development Support

Support in developing surveys that reliably measure the intended constructs.

Statistical Analyses

Quality-assured advanced data analysis using modern psychometric methods such as Item Response Theory (IRT) or Classical Test Theory (CTT).

Design of Statistical and Scientific Studies

Design and implementation of statistical and scientific investigations, including research design, sampling methodology, data collection, data analysis, and scientific reporting.