Test Development Service

The starting point for developing fair, valid, and reliable tests is a thorough and comprehensive Job Analysis. First, the knowledge, skills, and abilities essential for effectively performing a specific task are clarified. Next, test definitions and blueprints are designed, determining the format (multiple choice, written, etc.), difficulty level, knowledge areas to be covered, and the number of questions. This ensures a design that allows for consistent evaluation of all Candidate using the same criteria. The deliverables are the test definition document and the blueprint.

We support the creation of highly valid and fair exam questions by sharing the correct question-setting process and rules. Based on the blueprint, we analyze the existing item bank and propose whether to continue using/discontinue items and the number of additional items for each area. We also conduct workshops with experts in the target field (SMEs) to support the construction of fair and practical exams rooted in on-the-ground knowledge. We solve challenges such as question-setting methods, the creation of the required number of questions, quality standards, and the efficiency of continuous operation. The deliverables are "exam question creation rules" and "exam questions".

We will build a system that simultaneously ensures flexible testing opportunities through computer-based testing (CBT) and guarantees fairness.
The exam form will be created using a blueprint and an item bank (set of exam questions). To avoid excessive exposure of exam questions and to prevent unfair situations among Candidate, we will consider the most appropriate method of presenting questions to Candidate, including the form format and the LOFT (Linear-on-the-fly Testing) method*.

*LOFT method: This is a computer-based testing (CBT) method that ensures statistical fairness by presenting different test questions to each Candidate. For more details, please refer to the column.

The results analysis process is crucial for accurately understanding the quality of a test. By verifying the validity and reliability of the test through psychometric analysis based on test theory and scientific methods, and feeding the results back into the test design process, it becomes possible to continuously maintain and improve the quality of the test.

Our company employs a strong team of psychometric analysis experts whose primary responsibility is to help Test sponsor ensure that their exams ultimately meet design objectives, market requirements, and are fully legal.
At our company, we conduct various analyses to determine the quality of the test questions and measurements for each test.
All tests employ professional industry-standard modeling, and we also conduct standard validation, simulation studies, and custom research, utilizing methodologies that adhere to industry standards.