Integrating Fuzzy-Based Evaluation Method to Analyse Attributes and Parameters for the Assessment Model Development

Mohamad Ariffin Abu Bakar; Ahmad Termimi Ab Ghani; Mohad Lazim Abdullah

doi:10.11113/mjfas.v20n6.3485

Authors

Mohamad Ariffin Abu Bakar Faculty of Computer Science and Mathematics, Universiti Malaysia Terengganu, 21030 Kuala Nerus, Terengganu, Malaysia
Ahmad Termimi Ab Ghani Faculty of Computer Science and Mathematics, Universiti Malaysia Terengganu, 21030 Kuala Nerus, Terengganu, Malaysia
Mohad Lazim Abdullah Faculty of Computer Science and Mathematics, Universiti Malaysia Terengganu, 21030 Kuala Nerus, Terengganu, Malaysia

DOI:

https://doi.org/10.11113/mjfas.v20n6.3485

Keywords:

Triangular fuzzy conjoint, Fuzzy Delphi method, assessment model, attributes and parameters, fuzzy-based evaluation method.

Abstract

In this paper, an assessment model was developed based on the proposed integrated fuzzy-based evaluation method on students' mathematics learning ability. This model classifies six main attributes that structure the overall evaluation model into several parameters. The weightings of these main attributes and parameters were collected through fuzzy questionnaires among teachers and experts based on triangular fuzzy conjoint and fuzzy Delphi methodology. This highlighted integration contributes to a more reasonable and effective procedure for developing a structured and dynamic assessment model. It can reduce the problem of the measurement results obtained straying from the structure of the developed model due to procedural errors in identifying and analyzing the attributes and parameters of the model when it was developed. In addition, the presented case application also provides an analysis protocol that is simpler and easier compared to other complicated and complex approaches to developing assessment models.

References

Maba, W., & Mantra, I. B. N. (2017). An analysis of assessment models employed by the Indonesian elementary school teachers. International Journal of Social Sciences and Humanities (IJSSH), 1(1), 39–45.

Sarala, N., & Kavitha, R. (2015). Model of mathematics teaching: A fuzzy set approach. IOSR Journal of Mathematics, 11(1–1), 19–22. https://doi.org/10.9790/5728-11111922

Ramlawati, R., Liliasari, L., Martoprawiro, M. A., & Wulan, A. R. (2014). The effect of electronic portfolio assessment model to increase of students' generic science skills in practical inorganic chemistry. Journal of Education and Learning (EduLearn), 8(3), 179–186.

Schuwirth, L. (2004). Optimising new modes of assessment: In search of qualities and standards. Tijdschrift voor Medisch Onderwijs, 5(23), 250–251.

Karyotaki, M., & Drigas, A. (2016). Latest trends in problem solving assessment. International Journal of Recent Contribution from Engineering, Science & IT, 4(2), 1–10. http://dx.doi.org/10.3991/ijes.v4i2.5800

Alghafri, A. S. R., & Ismail, H. N. (2011). The effects of neuroscience- and non-neuroscience-based thinking strategies on primary school students' thinking. Procedia Social and Behavioral Sciences, 15, 3291–3298.

Alpar, G., & Hoeve, M. V. (2019). Towards growth-mindset mathematics teaching in the Netherlands. In C. M. Stracke (Ed.), LINQ, EPiC Series in Education Science (Vol. 2, pp. 1–17).

Sgrò, F., Mango, P., Pignato, S., Piccolo, A. L., Nicolosi, S., Schembri, R., & Lipoma, M. (2010). A neuro-fuzzy approach for student module of physical activity ITS. Procedia-Social and Behavioral Sciences, 9, 189–193.

Basaran, S. (2016). Multi-criteria decision analysis approaches for selecting and evaluating digital learning objects. Procedia Computer Science, 102, 251–258.

Muhammad, M. N., & Cavus, N. (2017). Fuzzy DEMATEL method for identifying LMS evaluation criteria. Procedia Computer Science, 120, 742–749.

Stanton, E. A., Ackerman, F., & Kartha, S. (2009). Inside the integrated assessment models: Four issues in climate economics. Climate and Development, 1(2), 166–184. https://doi.org/10.3763/cdev.2009.0015

Leigh, I. W., Smith, I. L., Bebeau, M. J., Lichtenberg, J. W., Nelson, P. D., Portnoy, S., Rubin, N. J., & Kaslow, N. J. (2007). Competency assessment models. Professional Psychology: Research and Practice, 38(5), 463–473. https://doi.org/10.1037/0735-7028.38.5.463

Albayrak, E., & Özcan Erkan Akgün, O. E. (2022). A program development model for information technologies curriculum in secondary schools. Participatory Educational Research (PER), 9(5), 161–182. http://dx.doi.org/10.17275/per.22.109.9.5

Roberson, L., Kulik, C. T., & Pepper, M. B. (2003). Using needs assessment to resolve controversies in diversity training design. Group & Organization Management, 28(1), 148–174. https://doi.org/10.1177/1059601102250028

Jahanvand, B., Mortazavi, S. B., Mahabadi, H. A., & Ahmadi, O. (2023). Determining essential criteria for selection of risk assessment techniques in occupational health and safety: A hybrid framework of fuzzy Delphi method. Safety Science, 167, 106253. https://doi.org/10.1016/j.ssci.2023.106253.

Wang, Y., Yeo, G. T., & Ng, A. K. (2014). Choosing optimal bunkering ports for liner shipping companies: A hybrid Fuzzy-Delphi–TOPSIS approach. Transport Policy, 35, 358–365.

Rahayu, P., & Wulandari, I. A. (2022). Defining e-portfolio factor for competency certification using fuzzy Delphi method. Procedia Computer Science, 197, 566–575.

Huang, J., Koopialipoor, M., & Armaghani, D. J. (2020). A combination of fuzzy Delphi method and hybrid ANN-based systems to forecast ground vibration resulting from blasting. Scientific Reports, 10(1), 19397.

Yusoff, A. F. M., Hashim, A., Muhamad, N., & Wan Hamat, W. N. (2021). Application of fuzzy Delphi technique to identify the elements for designing and developing the e-PBM PI-Poli module. Asian Journal of University Education (AJUE), 7(1), 292–304.

Wang, W. M., Lee, A. H., Peng, L. P., & Wu, Z. L. (2013). An integrated decision-making model for district revitalization and regeneration project selection. Decision Support Systems, 54(2), 1092–1103.

Schoenfeld, A. H. (2016). Learning to think mathematically: Problem solving, metacognition, and sense making in mathematics. Journal of Education, 196(2), 1–38.

Abdullah, A. H., Julius, E., Suhairom, N., Ali, M., Abdul Talib, C., Mohamad Ashari, Z., Abdul Kohar, U. H., & Abd Rahman, S. N. S. (2022). Relationship between self-concept, emotional intelligence and problem-solving skills on secondary school students' attitude towards solving algebraic problems. Sustainability, 14, 14402. https://doi.org/10.3390/su142114402

Mayer, R. E., & Wittrock, M. (2006). Problem solving (2nd ed.). Hand Book of Educational Psychology: Mahwah, NJ, USA.

Phonapichat, P., Wongwanich, S., & Sujiva, S. (2014). An analysis of elementary school students' difficulties in mathematical problem solving. Procedia-Social and Behavioral Sciences, 116, 3169–3174. https://doi.org/10.1016/j.sbspro.2014.01.728

Mohd, N., Mahmood, T. F. P. T., & Ismail, M. N. (2011). Factors that influence students in Mathematics achievement. International Journal of Academic Research, 3(3), 49–54.

Alvi, E., Mursaleen, H., & Batool, Z. (2016). Beliefs, processes and difficulties associated with mathematical problem solving of Grade 9 students. PJERE, 1(1), 85–110.

Leo, I. D., & Muis, K. R. (2020). Confused, now what? A Cognitive-Emotional Strategy Training (CEST) intervention for elementary students during mathematics problem solving. Contemporary Educational Psychology, 62, 101879.

Molenberghs, P., Trautwein, F. M., Bockler, A., Singer, T., & Kanske, P. (2016). Neural correlates of metacognitive ability and of feeling confident: A large-scale fMRI study. Social Cognitive and Affective Neuroscience, 2016, 1942–1951. https://doi.org/10.1093/scan/nsw093.

McRae, K. (2016). Cognitive emotion regulation: A review of theory and scientific findings. Current Opinion in Behavioral Sciences, 10, 119–124. http://dx.doi.org/10.1016/j.cobeha.2016.06.004

Otoo, D., Iddrisu, W. A., Kessie, J. A., & Larbi, E. (2018). Structural model of students' interest and self-motivation to learning mathematics. Education Research International, 2018, 1–10.

Ching, B. H. H. (2017). Mathematics anxiety and working memory: Longitudinal associations with mathematical performance in Chinese children. Contemporary Educational Psychology, 51, 99–113.

Hohnen, B., & Murphy, T. (2016). The optimum context for learning: Drawing on neuroscience to inform best practice in the classroom. Educational & Child Psychology, 33(1), 75–90.

Do, Q. H., & Chen, J. F. (2013). A comparative study of hierarchical ANFIS and ANN in predicting student academic performance. WSEAS Transactions on Information Science and Applications, 12(10), 396–405.

Richey, R. C., & Klein, J. (2007). Design and development research: Methods, strategies, and issues. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

Stojanović, J., Petkovic, D., Alarifi, I. M., Cao, Y., Denic, N., Ilic, J., et al. (2021). Application of distance learning in mathematics through adaptive neuro-fuzzy learning method. Computers & Electrical Engineering, 93, 107270.

Yiğit, F. (2023). A three-stage fuzzy neutrosophic decision support system for human resources decisions in organizations. Decision Analytics Journal, 100259.

Tseng, M. L. (2010). Implementation and performance evaluation using the fuzzy network balanced scorecard. Computers & Education, 55, 188–201. https://doi.org/10.1016/j.compedu.2010.01.004

Volarić, T., Brajković, E., & Sjekavica, T. (2014). Integration of FAHP and TOPSIS methods for the selection of appropriate multimedia application for learning and teaching. International Journal of Mathematical Models and Methods in Applied Sciences, 8, 224–232.

Jeong, J. S., & Gonzalez-Gomez, D. (2020). Assessment of sustainability science education criteria in online-learning through fuzzy-operational and multi-decision analysis and professional survey. Heliyon, 6, 1–11. https://doi.org/10.1016/j.heliyon.2020.e04706

Wulandari, F., Hadi, S., & Haryanto. (2020). Computer-based adaptive test development using fuzzy item response theory to estimate student ability. Computer Science and Information Technology, 8(3), 66–73. https://doi.org/10.13189/csit.2020.080302

Zimmermann, H. J. (2001). Fuzzy set theory and its applications. Springer Science and Business Media, Dordrecht. https://doi.org/10.1007/978-94-010-0646-0

Wang, L. X. (1999). A course in fuzzy systems and control. Prentice-Hall International, Inc.

Hsieh, C. H., & Chen, S. H. (1999). Similarity of generalized fuzzy numbers with graded mean integration representation. In Proceedings of the 8th International Fuzzy Systems Association World Congress, Taipei, 551–555.

Tsai, H. C., Lee, A. S., Lee, H. N., Chen, C. N., & Liu, Y. C. (2020). An application of the fuzzy Delphi method and fuzzy AHP on the discussion of training indicators for the regional competition, Taiwan national skills competition, in the trade of joinery. Sustainability, 12(10), 4290.

Chang, P. T., Huang, L. C., & Lin, H. J. (2000). The fuzzy Delphi method via fuzzy statistics and membership function fitting and an application to the human resources. Fuzzy Sets and Systems, 112(3), 511–520.

Yusof, N., Hashim, N. L., & Hussain, A. (2022). A review of fuzzy Delphi method application in human-computer interaction studies. In AIP Conference Proceedings, 2472(1).

Dawood, K. A., Sharif, K. Y., Ghani, A. A., Zulzalil, H., Zaidan, A. A., & Zaidan, B. B. (2021). Towards a unified criteria model for usability evaluation in the context of open source software based on a fuzzy Delphi method. Information and Software Technology, 130, 106453.

Tarmudi, Z., Muhiddin, F. A., Rossdy, M., & Tamsin, N. W. D. (2016). Fuzzy Delphi method for evaluating effective teaching based on students' perspective. E-Academic Journal UiTMT, 5, 1–10.

Ishikawa, A., Amagasa, M., Shiga, T., Tomizawa, G., Tatsuta, R., & Mieno, H. (1993). The max-min Delphi method and fuzzy Delphi method via fuzzy integration. Fuzzy Sets and Systems, 55(3), 241–253. https://doi.org/10.1016/0165-0114(93)90251

Camacho-Morles, J., Slemp, G. R., Oades, L. G., Morrish, L., & Scoular, C. (2019). The role of achievement emotions in the collaborative problem-solving performance of adolescents. Learning and Individual Differences, 70, 169–181.

Thomsen, T., & Lessing, N. (2020). Children's emotion regulation repertoire and problem behavior: A latent cross-lagged panel study. Journal of Applied Developmental Psychology, 71, 101198.

Menon, V., & Chang, H. (2021). Emerging neurodevelopmental perspectives on mathematical learning. Developmental Review, 60, 100964. https://doi.org/10.1016/j.dr.2021.100964

Smart, J., & Linder, S. M. (2018). Development, validation, and implementation of the elementary mathematics motivation inventory (EMMI): Examining motivational constructs in elementary mathematics. Fields Math Educ J, 3(2).

Math study skills inventory. Retrieved from: https://www.schoolcraft.edu/docs/librariesprovider35/default-document-library/math-study-skills-inventory-(1).pdf?sfvrsn=0

Brainware cognitive rating scale, BrainWare Learning Company. Retrieved from: https://mybrainware.com/brainware-cognitive-rating-scales/

Dagdag, J. D., Anoling Jr, O. C., Salviejo, R. P., Pascual, J. F., & Dagdag, J. M. H. (2020). Development of problem-solving efficacy scales in mathematics. Universal Journal of Educational Research, 8(6), 2397–2405. https://doi.org/10.13189/ujer.2020.080624

Serin, O., Serin, N. B., & Saygili, G. (2010). Developing problem solving inventory for children at the level of primary education (PSIC). Elementary Education Online, 9(2), 446–458.

Liu, E. Z. F., & Lin, C. H. (2010). The survey study of mathematics motivated strategies for learning questionnaire (MMSLQ) for grade 10–12 Taiwanese students. The Turkish Online Journal of Educational Technology, 9(2), 221–233.

Bieleke, M., Goetz, T., Yanagida, T., Botes, E., Frenzel, A. C., & Pekrun, R. (2023). Measuring emotions in mathematics: The achievement emotions questionnaire-mathematics (AEQ-M). ZDM – Mathematics Education, 55, 269–284. https://doi.org/10.1007/s11858-022-01425-8

Heron, C. L., Holroyd, C. B., Salamone, J., & Husain, M. (2019). Brain mechanisms underlying apathy. Neurol Neurosurg Psychiatry, 90, 302–312. https://doi.org/10.1136/jnnp-2018-318265

Chand, S., Chaudhary, K., Prasad, A., & Chand, V. (2021). Perceived causes of students' poor performance in mathematics: A case study at Ba and Tavua secondary schools. Frontiers in Applied Mathematics and Statistics, 7, 614408. https://doi.org/10.3389/fams.2021.614408

Fuente, J. D. L., Pachón-Basallo, M., Martínez-Vicente, J. M., Peralta-Sánchez, F. J., Garzón-Umerenkova, A., & Sander, P. (2022). Self- vs. external-regulation behavior Scale™ in different psychological contexts: A validation study. Frontiers in Psychology, 13, 922633. https://doi.org/10.3389/fpsyg.2022.922633

Majeed, A. A., Darmawan, I. G. N., & Lynch, P. (2013). A confirmatory factor analysis of attitudes toward mathematics inventory (ATMI). The Mathematics Educator, 15(1), 121-135.

Akın, A., Güzeller, C. O., & Evcan, S. S. (2016). The development of a mathematics self-report inventory for Turkish elementary students. Eurasia Journal of Mathematics, Science & Technology Education, 12(9), 2373-2386.

Fiorella, L., Yoon, S. Y., Atit, K., Power, J. R., Panther, G., Sorby, S., Uttal, D. H., & Veurink, N. (2021). International Journal of STEM Education, 8(52). https://doi.org/10.1186/s40594-021-00307-x

Niu, Z., Zhong, G., & Yu, H. (2021). A review on the attention mechanism of deep learning. Neurocomputing, 452, 48-62.

Simamora, R. E., Saragih, S., & Hasratuddin. (2019). Improving students' mathematical problem-solving ability and self-efficacy through guided discovery learning in local culture context. International Electronic Journal of Mathematics Education, 14(1), 61-72. https://doi.org/10.12973/iejme/3966

Soliman, A. M. (2014). The problem-solving inventory: Appraisal of problem solving in the Arab context, factor structure, and validation. International Perspectives in Psychology: Research, Practice, Consultation, 3(4), 252–267.

Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460-475.

Vallat-Azouvi, C., Pradat-Diehl, P., & Azouvi, P. (2012). The working memory questionnaire: A scale to assess everyday life problems related to deficits of working memory in brain injured patients. Neuropsychological Rehabilitation, 22(4), 634–649. https://doi.org/10.1080/09602011.2012.681110

Bueren, N. E. R. V., Kroesbergen, E. H., & Cohen Kadosh, R. (2021). Neurocognitive mechanisms of numerical intervention studies: The case of brain stimulation. In A. Henik & W. Fias (Eds.), Heterogeneous Contributions to Numerical Cognition: Learning and Education in Mathematical Cognition (pp. 253).

Passolunghi, M. C. (2011). Cognitive and emotional factors in children with mathematical learning disabilities. International Journal of Disability, Development and Education, 58(1), 61-73. https://doi.org/10.1080/1034912X.2011.547351

Clark, C. A. C., Hudnall, R. H., & Pérez-González, S. (2020). Children's neural responses to a novel mathematics concept. Trends in Neuroscience and Education, 20, 1-9. https://doi.org/10.1016/j.tine.2020.100128

Mareschal, D. (2016). The neuroscience of conceptual learning in science and mathematics. Current Opinion in Behavioral Sciences, 10, 114–118.

Gul, F., & Shehzad, S. (2012). Relationship between metacognition, goal orientation, and academic achievement. Procedia - Social and Behavioral Sciences, 47, 1864-1868. https://doi.org/10.1016/j.sbspro.2012.06.914

Shawan, M., Osman, S., & Abu, M. S. (2021). Difficulties in solving non-routine problems: Preliminary analysis and results. ASM Science Journal, 16. https://doi.org/10.32802/asmscj.2021.800

Medina, J. B., Buan, A. T., Mendoza, J. V. D., & Liwanag, G. P. (2019). Development of mathematics collaborative problem-solving skills scale. Journal of Physics: Conference Series, 1340, 012058.

Twilhaar, E. S., De Kieviet, J. F., Van Elburg, R. M., & Oosterlaan, J. (2020). Neurocognitive processes underlying academic difficulties in very preterm born adolescents. Child Neuropsychology, 26(2), 274-287.

Träff, U., Olsson, L., Skagerlund, K., & Östergren, R. (2018). Cognitive mechanisms underlying third graders' arithmetic skills: Expanding the pathways to mathematics model. Journal of Experimental Child Psychology, 167, 369-387.

Van Stockum Jr, C. A., & DeCaro, M. S. (2020). When working memory mechanisms compete: Predicting cognitive flexibility versus mental set. Cognition, 201, 104313.

Undorf, M., Amaefule, C. O., & Kamp, S. M. (2020). The neurocognitive basis of metamemory: Using the N400 to study the contribution of fluency to judgments of learning. Neurobiology of Learning and Memory, 169, 107176. https://doi.org/10.1016/j.nlm.2020.107176

Sugden, N. (2015). The prospective memory concerns questionnaire: An investigation of self-reported prospective memory and its relation to clinical disorders, aging, naturalistic prospective memory, personality, and social desirability. PhD Thesis, Charles Sturt University, Burlington.

Broadbent, D. E., Cooper, P. F., FitzGerald, P., & Parkes, K. R. (1982). The cognitive failures questionnaire (CFQ) and its correlates. British Journal of Clinical Psychology, 21, 1-16.