HighTech and

Since the COVID-19 pandemic, there have been many free online platforms that can be used to support the online learning process at health colleges in Bali. However, it is difficult to determine the best online platform from the various choices of free online platforms that are scattered on the internet. Therefore, it needs innovations that contribute to helping solve these problems. One model as an innovation that can be used and contributes to solving problems is the Weighted Product -based CIPP evaluation model. The model needs to be measured for the quality of its calculations to ensure success in determining the best online platform. Therefore, this research aimed to show the quality of the Weighted Product method calculation integrated with the CIPP ( Context-Input-Process-Product ) model in determining the best platform used in health colleges during the COVID-19 pandemic. The instrument used to assess the quality of that calculation was a questionnaire consisting of eight questions. The subjects involved in the assessment were 20 experts. The research was carried out at several health colleges in Bali. The analytical technique used in analyzing the research data was descriptive-quantitative. The analysis was carried out by comparing the quality percentage of the calculation simulation with the quality standard based on an eleven-point scale. The study results showed the quality percentage of calculation simulation was 87.250%, so it was included in the very good category. This research has a significant impact on the progress of the educational evaluation field through research findings in the form of the appearance of the combination of the Weighted Product method with the CIPP evaluation model. The novelty of this research is the combination of the Weighted Product method and the CIPP model, which makes it easier for educational evaluators to determine the best online platform that supports online learning during the COVID-19 pandemic and even post-COVID-19.


Introduction
Online learning during the COVID-19 pandemic is the most suitable strategy to use to minimize the spread of the coronavirus in college environments. Many online platforms can be used to realize online learning. Some of those Several previous research results that baseline this research include Purwaningsih and Dardjito's research [5], which showed the use of the CIPP evaluation model to evaluate the effectiveness of e-learning during the COVID-19 pandemic. The limitation of Purwaningsih and Dardjito's research was that it had not shown a combination of decision support system methods with educational evaluation models to obtain accurate evaluation results of the e-learning platform suitable implemented during the COVID-19 pandemic.
Damayanti et al.'s research [6] only showed the CIPP model used to evaluate the effectiveness of online learning in universities. Damayanti et al. had not implemented a decision support method combined with the CIPP model in determining the best platform for supporting the effectiveness of online learning. Anh & Pang's [7] showed the application of the CIPP model to evaluate the implementation of online-based English language teaching. The limitation of Anh & Pang's research was that it had not shown the best online platform that was able to be used to support English language teaching. Prayogo et al. [8] focused on determining the evaluation results of the implementation of online-based distance learning, which refers to the CIPP evaluation component. Prayogo's et al. research had not shown any combination of the CIPP model with decision support methods in determining the best online platform that supports distance learning. Research by DeCoito & Estaiteyeh [9] showed the use of the CIPP model in evaluating the curriculum and assessment of science/STEM teachers in online learning in Canada during the COVID-19 pandemic. The limitation of DeCoito & Estaiteyeh's research was that it did not show the best online platform that supports the implementation of a quality curriculum and assessment in online learning during the COVID-19 pandemic. Therefore, in DeCoito & Estaiteyeh's research, a combination of decision support methods and the CIPP model is needed to perform accurate calculations in determining the best online platform to support learning during the COVID-19 pandemic.
Toan et al. [10] showed the use of decision support methods in assessing and selecting the best e-learning platform to support the learning process. The limitation of Toan et al.'s research was that it had not shown an educational evaluation model integrated with the decision-making method used in the research, so the platform chosen had not been able to comprehensively facilitate the needs of the learning process in the field. Ong et al. [11] showed an analysis of the accuracy of selecting online learning attributes by students during the COVID-19 pandemic. The limitation of Ong et al.'s research was that it did not show an accurate calculation process in determining the selection of online learning attributes assisted by decision support methods and educational evaluation models. Nguyen & Nguyen [12] showed that the Schoology platform is suitable for improving student learning abilities. The limitation of Nguyen and Nguyen's research was that it did not show detailed calculation processes in determining the choice of the Schoology platform as the best platform. Research by Shashiprabha et al. [13] showed the results of an analysis of e-learning platforms, but the best platform that can be used to support e-learning has not yet appeared. Cabual & Cabual [14] showed the students challenges in implementing learning using online platforms during COVID-19. The limitation of the Cabual & Cabual's research was that it had not been shown what the best platform certainty was for the learning process during COVID-19.
Based on some of the limitations of those previous studies, the idea of this research is very appropriate to be expressed to overcome the limitations of previous research related to selecting the best platform for online learning. The idea of this research is to show the calculation of the Weighted Product method combined with the CIPP model to determine the best platform to use in supporting online learning during the COVID-19 pandemic and even post-COVID-19.

Research Approach
The approach of this research was development with a focus on the calculation simulation of the Weighted Product integrated with the CIPP model and the quality assessment of the calculation simulation of the Weighted Product method integrated with the CIPP model. The Weighted Product calculation simulation is more focused on the correctness of the process and the quality stages of the calculation of the three formulas in the Weighted Product, while the quality assessment is focused on the validity of the simulation results of the calculation of the Weighted Product integrated with the CIPP model. The simulation stages for calculating the Weighted Product in this study can be seen in Figure 1. The stages for evaluating the simulation quality for the calculation of the Weighted Product method integrated with the CIPP model can be seen in Figure 2.   Figure 1 shows the five stages that must be passed in the Weighted Product calculation simulation. Stage-1 is the determination of the initial data for simulation. Initial data for simulation were obtained from the average of interest rating scores given by respondents to each aspect of the CIPP evaluation model. Stage-2 is the revision of weights by experts for each CIPP evaluation component. Stage-3 is the calculation of the S vector using the formula shown in Determination of the Initial Data for the Simulation Equation 2. Stage-4 is the calculation of the V vector using the formula shown in Equation 3. Stage-5 is ranking to determine the best online platform based on the highest V-vector score. Figure 2 shows the five stages in assessing the simulation quality of the Weighted Product calculation combined with the CIPP model. Stage-1 is giving assessment questionnaires to experts. The questionnaires are used as a tool to obtain an assessment score from experts on the quality of calculation simulations. Stage-2 is the assessment process carried out by experts. Stage-3 is the activity of regularly collecting and compiling all the scores that have been obtained from the results of expert's assessment. Stage-4 is an activity to cross-check between the score from the expert's assessment and the quality standard of the calculation simulation which refers to eleven's scale. Stage-5 is the categorization of the quality of the calculation simulation process by reference to the quality standards of the eleven's scale.
is the criteria preference which is often called the vector. is the criterion value. is a positive weight for the profit attribute and a negative weight for the cost attribute. wj must be valuable of 1.
is an alternative preference for determining rank. This is often called a vector.

Subject, Object, and Location of Research
The subjects involved in the quality assessment of the simulation results of Weighted Product calculations were 20 experts. The 20 experts consisted of 10 education experts and 10 informatics experts. The subjects involved in the weight improvement process were six experts, consisting of three education experts and three informatics experts. Determination of subjects for this research was carried out based on the purposive sampling technique. The reason for using this technique is because if you choose another sampling technique, it will be difficult to determine a subject that is truly sensitive and understands in depth about the online platform used in learning. In general, this purposive sampling technique makes it easier for researchers to obtain data from sources that are indeed appropriate and have in-depth experience with the object under research. All subjects involved in this research had in-depth knowledge and experience of the role of online platforms in supporting learning. The advantage of using this purposive sampling technique is that it increases the sensitivity of the assessments made by the subjects involved in this research, because the subjects will provide an assessment according to their experience.
The object of this research was a Weighted Product method combined with the CIPP model to determine the best online platform. The object of this research was the research focus because it was based on ideas raised to overcome problems found in the field related to difficulties in determining the best online platform to support the online learning process.
The research was conducted at several health universities in Bali. The universities are located in several regencies, including: Tabanan, Badung, Denpasar, Klungkung, Buleleng, and Gianyar. The reason for selecting several health colleges as research locations was to obtain differences in the characteristics of online platform users. The existence of differences in the characteristics of online platform users is very good, because it will provide a more objective sensitivity to the assessment results and a variety of perspectives on the online platform being assessed.

Data Collection Instrument
The instrument used to assess the quality of the calculation simulation was a questionnaire consisting of eight questions. Question-1 about the initial data conditions for the simulation. Question-2 about the results of the weight improvement from the expert. Question-3 about the accuracy of the calculation results for the S vector. Question-4 about the accuracy of the V vector calculation results. Question-5 about the accuracy of the ranking results in the context component. Question-6 about the accuracy of the ranking results in the input component. Question-7 about the accuracy of the ranking results in the process component. Question-8 about the accuracy of the ranking results in the product component.

Data Analysis Technique
The results of the analysis of the calculation quality assessment using the quantitative descriptive technique. This analysis technique was carried out by comparing the quality of the calculation simulation results with quality standards that refer to the eleven's scale. The formula for calculating the quality percentage is shown in Equation 4 [33][34][35][36][37][38][39], while the quality standard, which refers to the eleven's scale, is shown in Table 1 [40][41][42][43][44].
where is percentage of quality, is total of the acquisition value, and is total of maximum value. Table 1 shows the eleven quality standard scales used as the basis for categorizing the quality of the calculation simulation of the Weighted Product method, which is integrated with the CIPP model. If the quality percentage range is 75%-100%, then the quality of the average calculation simulation is good, so there is no need to repeat the calculation. If the range of quality percentages is less than 75%, then the quality of the calculation simulation is generally classified as poor, so a re-simulation is necessary.

Online Platforms used in Health Colleges in Bali
Several online platforms used at health colleges in Bali to support the online learning process during the COVID-19 pandemic, including: Microsoft Teams, Kelase, Moodle, and SEVIMA EdLink. The display of some of these platforms can be seen in Figure    Microsoft Teams is a modern application offered by Microsoft. This application is a hub for a team, both in small or large-scale organizations that allow users to collaborate and communicate easily whenever and wherever they are. Microsoft Teams can be accessed through this URL: https://www.microsoft.com/en/microsoft-teams/group-chatsoftware.
Moodle is a web-based service that assists in online learning activities. Moodle is an acronym for Modular Object-Oriented Dynamic Learning Environment which can be said to be a dynamic learning place using models and objectoriented. Moodle can be accessed through this URL: https://moodle.org/.
The Kelase application is an application developed by PT. Edukasi Satu Nol Satu from Indonesia helps education organizations provide online services so they can collaborate, learn, and exchange knowledge with various features and ease of access. Kelase can be accessed through this URL: https://www.kelase.com/.
SEVIMA EdLink is an online learning platform made by Indonesians which has several facilities, including online presence, remote video conferencing, notifications of online lecture schedules, interactive quizzes with attractive packaging, discussion forums for material that is easy but still interactive, and recapitulation of each student's presence. SEVIMA EdLink can be accessed through this URL: https://edlink.id/.

Calculation Simulation of Weighted Product Method
Based on those online platforms, it was necessary to determine the best platform that was able to be used in the learning process during the COVID-19 Pandemic. Therefore, in this research, calculation simulation was carried out to determine the best online platform using the CIPP model based on Weighted Product. The calculation simulation process can be shown as follows.

1) Determination of Initial Data for Simulation
The initial data used for the calculation simulation of the Weighted Product method consists of the average score of the interest rating given by the respondents to each CIPP evaluation aspect. The respondents involved were 10 experts. The initial data intended can be seen in Table 2.  Table 2 shows the evaluation aspects used to measure the quality of several online platforms in view of the CIPP evaluation component. There were four platforms whose quality was measured, including Microsoft Teams, Kelase, Moodle, and SEVIMA EdLink. The average importance rating score shown for each evaluation component in Table 2 was obtained from the assessment scores given by 20 respondents, consisting of 10 informatics experts and 10 education experts.

2) Determination of Weights from Experts that had been Revised for Each Evaluation Component
Based on Equation 1, it can be determined the weight given by the experts that had been corrected/improved for each CIPP evaluation component. The results of the weights that had been corrected can be seen in Table 3.

5) Determination of the Best Platform
Based on the value of the V vector in each evaluation aspect, so can be carried out the process of determining the best online platform. The best platform is determined based on the highest score of the V vector. Recapitulation of the V vector for each online platform based on evaluation aspects can be seen in Table 4. The highest score of the V vector shown in Table 4 was 0.0195. This clearly showed that the best online platform that was able to be used to support online learning during the COVID-19 pandemic was Moodle (shown by green block in Table 4). The score of 0.0195 was obtained from the evaluation aspect of the "purpose of implementing online learning". This indicates that the Moodle platform is very appropriate to use supporting the realization of the goals of organizing online learning.

Quality Assessment of the Weighted Product Method Simulation Calculation
The quality of the Weighted Product calculation simulation was assessed by 20 experts. The tool used by the expert to assess was a questionnaire consisting of eight questions. The quality assessment results of the Weighted Product method simulation calculation can be seen in Table 5. Based on the average percentage of quality shown in Table 5, it was able to be stated that the quality of the Weighted Product calculation simulation was categorized as very good when viewed from the quality standard refers to eleven's scale. In addition, when viewed from the simulation results of the Weighted Product calculation, it was found that the best online platform that was able to be used to support the online learning process during the COVID-19 pandemic was Moodle.
If the results of this research are compared with Vydia et al.'s [45] research, there are certainly similarities and differences. The similarity between this research and Vydia et al.'s research is that both use decision-support methods in choosing an online platform. The difference is that this study combines the educational evaluation model "CIPP" with a decision support method "Weighted Product" in determining the best online platform to support the learning process. Meanwhile, research by Vydia et al. only uses decision support methods (F-MADM/Fuzzy Multiple Attribute Decision Making) in determining online platforms to support the learning process.
In principle, this research has similarities with the research of Ouadoud et al. [46], which shows several online platforms that can be used to support the learning process. However, the difference is that Ouadoud et al.'s research does not show in detail the best online platform that can be used to support online learning. Meanwhile, this research has shown that there is a best online platform; there is even complete evidence of a calculation process to get the best online platform.
Satria's [47] research shows the best online platform can be used for learning in the new normal era. In principle, Satria's research and the results of this study have similarities in determining the best platform. However, the difference is the mechanism or method used to get the best online platform. The results of this research have an advantage when compared to Satria's research results, namely in the calculation process used to make decisions about the best online platform. This research uses a combination of educational evaluation models and decision support methods to obtain accurate calculation results in determining the best online platform. Meanwhile, Satria's research only used respondents' perception scores, which were obtained using an instrument in the form of questionnaires.  [55], and Mpungose [56], which principle stated that Moodle was an online platform that was suitable for use during the COVID-19 pandemic to support online learning.
Based on the several advantages of the results of this research and the existence of strengthening support from several previous studies, the novelty of this research is the existence of an educational evaluation model that is combined with one of the methods in a decision support system called the Weighted Product. This model can be used to determine the best online platform to support the online learning process in the education field generally and in health colleges specifically. The limitation of this research is that it is difficult to determine the best online platform if there are V vectors that have the same value.

Conclusion
Generally, the results of this research showed a very good simulation of the Weighted Product method calculation. The results of this categorization show the positive significance of this results study which are useful for convincing the public regarding the best online platforms that can be used to support the learning process in health colleges. This positive significance is confirmed by the result of a quality percentage of 87.250% in the range of 85-94% when referring to the eleven-scale quality standard. Theoretically, the results of this research make a positive contribution to science and technology by demonstrating a combination of knowledge between educational evaluation models combined with decision support system methods. The combination of two pieces of knowledge produces an accurate calculation process for determining the best online platform that is useful in supporting a better learning process for the advancement of education. Practically, future work can be done by researchers, the academic community, or educational observers to overcome the obstacle of this research, which is to determine the best online platform based on platform priority if the V vector values are the same. In addition to referring to the V vector value, it is better if the evaluation aspect that is a priority to support the success of the online learning implementation also needs to be used as a determinant of the best online platform selection. The novelty of this research is the combination of the Weighted Product method and the CIPP model, which can produce accurate recommendations to make it easier for educational evaluators to determine the best online platform that supports online learning during the COVID-19 pandemic and after the COVID-19 pandemic. The impact of these research results on the field of education is new knowledge for education evaluators to use the product weighted method combined with the educational evaluation model in conducting an evaluation.

Data Availability Statement
The data presented in this study are available in the article.