Mixed Model Evaluation CSE-UCLA and Assessment Evaluability Performance Monitoring (AEPM) as an Approach to Evaluating the Competency Test Certification Program

Abstract

The aim of the study is to assess the competency test certification (CTC) program for mechanical engineering techniques in Vocational High Schools (VHS) by combining the CSE-UCLA program evaluation model with the Assessment Evaluability And Performance Monitoring (AEPM) in order to determine the program's effectiveness level in detail. This program evaluation research use a mixed-methods approach, with a quantitative approach to evaluate the accuracy of the data collected during the research period and a qualitative approach using the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) analysis. System assessment, program planning, implementation of the program, program improvement, program certification, and performance monitoring are the six evaluation components that make up the program evaluation design used in this study, which combines the CSE-UCLA model with the AEPM. The head of the machining program, the head of the workshop, the productive machining teachers, the vice principal in charge of curriculum, the vice principal in charge of industrial relations, the vice principal in charge of facilities and infrastructure, and the principal are the subjects of this research. Five sample vocational high schools in the Special Capital Region of Jakarta Province area were given questionnaires as part of the data collection process. The technique for determining all subjects uses the Purposive Sampling technique. With an average of all program dimension components, the research results indicate the level of effectiveness of the machining competency test certification program's performance. (1). Good is the category rating for the system assessment (2). Category grade for program planning: Good (3). Satisfactory rating for program implementation (4). Fair, (5) is the program improvement category score. Category score for program certification: Fair (6). tracking the Fair performance category score. An approach to show the effectiveness of the statements and questions in the competency test certification for the mechanical engineering machining program is to apply program evaluation using a combination of the CSE-UCLA model and Assessment Evaluability and Performance Monitoring (AEPM).