The Certification Program Evaluation for Students in Vocational Schools using The CSE UCLA Model

Authors

  • Sugeng Priyanto Universitas Negeri Jakarta, Indonesia http://orcid.org/0000-0001-6570-1869
  • Siti Sahara Universitas Negeri Jakarta, Indonesia
  • Hari Din Nugraha Universitas Negeri Jakarta, Indonesia

DOI:

https://doi.org/10.33394/jk.v10i4.12693

Keywords:

Certification Competency Test, System Assessment, CSE-UCLA Model.

Abstract

This research aims to get an overview of the evaluation results and various obstacles faced in the implementation of machining competency test certification in Vocational High Schools (VHS). The evaluation method of this program is a qualitative research approach that uses the analysis of Techniques for Sequence Preference with Ideal Solution Similarity (TOPSIS). This study uses the CSE-UCLA model in designing program evaluation, which consists of five evaluation components: system assessment, program planning, program implementation, program improvement, and certification. Data collection involved subjects who were researched by filling out questionnaires, including school principals, vice principals for curriculum, deputy principals for industrial relations, deputy principals for facilities and infrastructure, heads of machining programs, workshop heads, machining productive teachers, and competency certification institutions/professional certification institutions in schools. Participants involved in collecting information used survey forms in five Vocational High Schools (VHS) in the Province of the Special Capital Region of Jakarta. In this study, five subjects of State Vocational High Schools were selected The study resulted that the machining competency test certification program has a good level of effectiveness, with certain components assessed as sufficient. Considering the dimension of the system assessment program, the value program planning category needs to be maintained or improved. In the context of program implementation, program improvement, and program certification, efforts are needed to improve the criteria for the better. Therefore, the findings of this study can be considered for the improvement of sustainable certification programs.

References

Abdullah, M. N., Ahmad, A., & Gani, H. A. (2022). Development of Learning by doing Governance Model Industry based on Vocational Middle School in Makassar. Asian Journal of Applied Sciences, 10(1). https://doi.org/10.24203/ajas.v10i1.6850

Abdurrahman, Parmin, & Muryanto, S. (2022). Evaluation on the automotive skill competency test through ‘discontinuity’ model and the competency test management of vocational education school in Central Java, Indonesia. Heliyon, 8(2). https://doi.org/10.1016/j.heliyon.2022.e08872

Antonietti, C., Cattaneo, A., & Amenduni, F. (2022). Can teachers’ digital competence influence technology acceptance in vocational education? Computers in Human Behavior, 132. https://doi.org/10.1016/j.chb.2022.107266

Ariyani, L. F., Widjaja, S. U. M., Wahyono, H., Haryono, A., Rusdi, J. F., & Pratama, C. B. A. (2021). Vocational education phenomena research method. MethodsX, 8. https://doi.org/10.1016/j.mex.2021.101537

Arnita, V., & Chrisna, H. (2022). Accountings Students Following Test Certification Accounting Yunior Test In Indonesia. Economics, Business and Management Science Journal, 2(2). https://doi.org/10.34007/ebmsj.v2i2.289

Badan Pusat Statistik Indonesia. (2023, January 16). Proportion of Workforce in Manufacturing Sector (Percent), 2022. https://www.bps.go.id/id/statistics-table/2/MTIxNyMy/proporsi-tenaga-kerja-pada-sektor-industri-manufaktur--persen-.html

Billett, S. (2000). Defining the demand side of vocational education and training: Industry, enterprises, individuals and regions. Journal of Vocational Education and Training, 52(1), 5–31. https://doi.org/10.1080/13636820000200104

Burke, A. E., Benson, B., Englander, R., Carraccio, C., & Hicks, P. J. (2014). Domain of competence: Practice-based learning and improvement. Academic Pediatrics, 14(2 SUPPL.). https://doi.org/10.1016/j.acap.2013.11.018

CHIBA, Y., KOBAYASHI, R., OSHIDA, J., & ICHIKAWA, H. (2023). Analysis of Human Resource Development Issues in the Machining Industry. Journal of JSEE, 71(2). https://doi.org/10.4307/jsee.71.2_89

Dirim, Ş., Özener, O. Ö., & Sözer, H. (2023). Prioritization and parallel execution of test cases for certification testing of embedded systems. Software Quality Journal, 31(2). https://doi.org/10.1007/s11219-022-09594-1

Elakas, A., Tarlan, O., Safak, I., Kalkan, K., & Sozer, H. (2023). Towards Test Automation for Certification Tests in the Banking Domain. UBMK 2023 - Proceedings: 8th International Conference on Computer Science and Engineering. https://doi.org/10.1109/UBMK59864.2023.10286638

Finegold, D., & Soskice, D. (1988). The failure of training in Britain: Analysis and prescription. Oxford Review of Economic Policy, 4(3), 21–53. https://doi.org/10.1093/oxrep/4.3.21

Fullerton, A., & Leckie, G. (1999). Information literacy in science and engineering undergraduate education: faculty attitudes and pedagogical practices. College and Research Libraries, January 1999, 9–29.

Huang, F., Huang, B., Wang, Y., & Wang, Y. (2023). A Taxonomy of Software Defect Forms for Certification Tests in Aviation Industry. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14181 LNCS. https://doi.org/10.1007/978-3-031-40923-3_5

Knippa, S., Thompson-Brazill, K. A., Roller, A., & Mullen, J. (2023). Certification Test Prep: Professional Caring. In Critical Care Nurse (Vol. 43, Issue 5). https://doi.org/10.4037/ccn2023394

Kuntoro, T., Sudana, I. M., & Anis, S. (2019b). The Implementation of Competency Certification Test for Vocational Students of Light Vehicle Engineering Program by LSP-P3 in Banyumas. Journal of Vocational Career Education, 4(1), 74–82. https://doi.org/https://doi.org/10.15294/jvce.v4i2.23053

Li, J., & Pilz, M. (2023). International transfer of vocational education and training: a literature review. Journal of Vocational Education and Training, 75(2). https://doi.org/10.1080/13636820.2020.1847566

Ling, Y., Chung, S. J., & Wang, L. (2023). Research on the reform of management system of higher vocational education in China based on personality standard. Current Psychology, 42(2). https://doi.org/10.1007/s12144-021-01480-6

Mahmudah, F. N., & Santosa, B. (2021). Vocational School Alignment Based-on Industry Needs. 4(1), 36–45.

Majetic, C., & Pellegrino, C. (2018). Building Information Literacy Skills Using Science News Media. Journal of College Science Teaching, 48(1).

Makinde, W. A., & Bamiro, T. O. (2023). Service Quality of Teaching Vocational Education and Training (TVET) and Student’s Satisfaction in Nigeria. Journal of Pedagogy and Education Science, 2(01), 10–25. https://doi.org/10.56741/jpes.v2i01.157

Mason, R. B., Mbambo, S. N., & Pillay, M. A. (2018). Service quality at technical and vocational education and training colleges: Perception according to demographic factors. Journal of Technical Education and Training, 10(1), 15–29. https://doi.org/10.30880/jtet.2018.10.01.002

Muja, A., Blommaert, L., Gesthuizen, M., & Wolbers, M. H. J. (2019). The vocational impact of educational programs on youth labor market integration. Research in Social Stratification and Mobility, 64. https://doi.org/10.1016/j.rssm.2019.100437

Nurtanto, M., Sofyan, H., Pardjono, P., & Suyitno, S. (2020). Development model for competency improvement and national vocational qualification support frames in automotive technology. International Journal of Evaluation and Research in Education, 9(1). https://doi.org/10.11591/ijere.v9i1.20447

Pardjono, P., Sugiyono, S., & Budiyono, A. (2015). Developing A Model Of Competency And Expertise Certification Tests For Vocational High School Students. REID (Research and Evaluation in Education), 1(2). https://doi.org/10.21831/reid.v1i2.6517

Parkinson, J., & Mackay, J. (2016a). The literacy practices of vocational training in Carpentry and Automotive Technology. Journal of Vocational Education and Training, 68(1). https://doi.org/10.1080/13636820.2015.1104714

Parkinson, J., & Mackay, J. (2016b). The literacy practices of vocational training in Carpentry and Automotive Technology. Journal of Vocational Education and Training, 68(1), 33–50. https://doi.org/10.1080/13636820.2015.1104714

Priyanto, S., Soeprijanto, Badrujaman, A., & Sahara, S. (2024). Evaluation Approach Of The Mechanical Engineering Competency Test Certification Using The Assessment Evaluability And Performance Monitoring Model. Decision Science Letters, 13(1). https://doi.org/10.5267/j.dsl.2023.9.002

Republic of Indonesia Employment Law Number 13 of 2003. (n.d.).

Rodriguez, R., Svensson, G., & Wood, G. (2020a). Assessing corporate planning of future sustainability initiatives in private healthcare organizations. Evaluation and Program Planning, 83(August). https://doi.org/10.1016/j.evalprogplan.2020.101869

Rodriguez, R., Svensson, G., & Wood, G. (2020b). Assessing corporate planning of future sustainability initiatives in private healthcare organizations. Evaluation and Program Planning, 83. https://doi.org/10.1016/j.evalprogplan.2020.101869

Rofiq, Z., Surono, S., Bruri Triyono, M., & Setiyo Hari Purwoko, B. (2019a). Developing the Standard Competencies for Vocational Teacher Candidates of Mechanical Engineering. Journal of Physics: Conference Series, 1273(1). https://doi.org/10.1088/1742-6596/1273/1/012032

Stofkova, Z., & Sukalova, V. (2020). Sustainable Development of Human Resources in Globalization Period. Sustainabiliity Journal, 7681(12), 1–14. https://doi.org/https://doi.org/10.3390/su12187681

Suharno, Pambudi, N. A., & Harjanto, B. (2020). Vocational education in Indonesia: History, development, opportunities, and challenges. In Children and Youth Services Review (Vol. 115). https://doi.org/10.1016/j.childyouth.2020.105092

Vaganova, O. I., Bakharev, N. P., Kulagina, J. A., Lapshova, A. V., & Kirillova, I. K. (2020). Multimedia technologies in vocational education. Revista Amazonia Investiga, 9(26), 391–398. https://doi.org/10.34069/ai/2020.26.02.45

Wang, H., & Chen, S. (2023). Insights into the Application of Machine Learning in Reservoir Engineering: Current Developments and Future Trends. Energies, 16(3). https://doi.org/10.3390/en16031392

XU, Z., & WANG, Y. (2021). Electrochemical machining of complex components of aero-engines: Developments, trends, and technological advances. In Chinese Journal of Aeronautics (Vol. 34, Issue 2, pp. 28–53). https://doi.org/10.1016/j.cja.2019.09.016

Yildiz, F., & Yildirim, E. (2023). Important insect pests in winter vegetables grown in Beydere Seed Certification Test Directorate. Plant Protection Bulletin (Turkey), 63(3). https://doi.org/10.16955/bitkorb.1274312

Zhu, D., Feng, X., Xu, X., Yang, Z., Li, W., Yan, S., & Ding, H. (2020). Robotic grinding of complex components: A step towards efficient and intelligent machining – challenges, solutions, and applications. Robotics and Computer-Integrated Manufacturing, 65. https://doi.org/10.1016/j.rcim.2019.101908

Downloads

Additional Files

Published

2024-12-21

How to Cite

Priyanto, S., Sahara, S., & Nugraha, H. D. (2024). The Certification Program Evaluation for Students in Vocational Schools using The CSE UCLA Model. Jurnal Kependidikan, 10(4), 1473–1484. https://doi.org/10.33394/jk.v10i4.12693

Issue

Vol. 10 No. 4 (2024): December

Section

Articles

Citation Check

License

License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:

  • They are authorized by their co-authors to enter into these arrangements.
  • The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  • That it is not under consideration for publication elsewhere,
  • That its publication has been approved by all the author(s) and by the responsible authorities tacitly or explicitly of the institutes where the work has been carried out.
  • They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  • They agree to the following license and publishing agreement.

Copyright
Authors who publish with JK agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Licensing for Data Publication

JK use a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data:
Other data publishing licenses may be allowed as exceptions (subject to approval by the editor on a case-by-case basis) and should be justified with a written statement from the author, which will be published with the article.

 

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.