ChatGPT 's Performance Evaluation in Spreadsheets Modelling to Inform Assessments Redesign

Contextual Teaching and Learning (CTL), a learning approach which connects learning materials with real life applications within the context of students’ lives, encourages students to find the meaning of what they have learned on their own and the lecturer only act as a guide or facilitator, so the students are motivated to think critically. This study aims to describe the implementation of CTL approach to enhance students’ higher order thinking skill (HOTS) in writing ability of STKIP PGRI Sidoarjo, which has been found in preliminary observations to be lacking in this aspect. This quantitative research uses a quasi-experimental design through a pretest-posttest pattern. The research sample was 22 students of 2021 A class (Experimental Class) and 23 students of 2021 B class (Control Class). The data were collected through observation, test, and questionnaires. The higher order thinking skill includes: understanding problems (24,20%), making assumptions (28,17%), explaining in depth (25,13%), solving problems (23,25 %), and making conclusions (20,63%). From the table of t-test results, the results (α) = 0.004. It can be stated that (α) < 0.05, so it can be concluded that there is a significant difference in the students' higher order thinking skill in writing ability by using contextual teaching and learning approach. The findings revealed that the contextual teaching and learning approach was successful to enhance students’ higher order thinking skill in writing ability. Moreover, it is recommended that CTL and higher order thinking skill have significant influence toward writing ability.

Background: Medical curricula should encourage the development of advanced cognitive skills. Examination questions are an indicator of the cognitive level expected of students. However, it is believed that many factors, such as difficulty in maintaining objectivity in marking, large numbers of scripts and poor language ability of students lead to compiling of essay questions requiring lower cognitive levels. Objectives: The objective of the study was to categorize essay questions of the undergraduate medical program of a Sri Lankan university according to the cognitive level tested. Methods: Essay questions were classified into cognitive levels based on Bloom’s taxonomy and subsequently categorized broadly as those requiring lower order thinking skills (LOTS), middle order thinking skills (MOTS) and higher order thinking skills (HOTS). Analysis was done based on discipline and components of study (pre-clinical, paraclinical and clinical). Results and Discussion: Most questions required LOTS. However, a majority of Physiology questions required HOTS while a majority of questions in the Communication Learning and Research module, Anesthesiology, Gynecology and Obstetrics and Paediatrics required MOTS. Evaluation of questions at pre-clinical, para-clinical and clinical components revealed a focus on questions requiring LOTS at all levels. However, the proportion of questions requiring MOTS increased from pre-clinical to clinical part of the course while the proportion of questions requiring HOTS decreased from the pre-clinical to the clinical part of the course. It is advisable that relevant academic departments reflect upon these findings in view of improving the impact of their examinations on development of higher order cognitive skills among students. Conclusions: Essay questions requiring LOTS predominate in most disciplines and at all levels of the course. An increase in the proportion of questions requiring MOTS and a decline in the proportion of questions requiring HOTS was observed from pre-clinical to the clinical part of the course. Systematic evaluations of examination questions to identify their cognitive levels would generate valid evidence to reflect upon institutional commitments to improve higher order cognitive skills among students.

Higher order thinking skills are skills needed in studying chemistry. Student higher order thinking skills are currently still relatively low, so appropriate learning models are needed to overcome them. This research aimed at finding out the effect of Discovery Learning (DL) model toward student higher order thinking skills on Buffer Solution lesson. This research was conducted to the eleventh-grade students of Chemistry class at the second semester in the Academic Year of 2023/2024 at State Senior High School 2 Tambang. Quantitative method was used in this research with pretest-posttest non-equivalent control group design. The samples consisted of two classes selected by using cluster random sampling technique. The techniques of analyzing data were t-test to find out whether there was an effect of Discovery Learning model toward student higher order thinking skills and determination coefficient test to find out the effect. Based on the research findings, (1) t-test showed that the significant score 0.002 was lower than 0.05, it meant that there was a significant difference between experiment and control groups, the experiment group higher order thinking skills posttest mean was 80.21, and the control group was 72.64, so H0 was rejected and Ha was accepted; (2) determination coefficient test showed that the score of r2 was 0.130, so it could be concluded that DL learning model affected student higher order thinking skills on Buffer Solution lesson 13%.

Abstrak: Salah satu tujuan pendidikan khususnya di Perguruan Tinggi adalah agar mahasiswa memiliki kemampuan berpikir kreatif dan kritis yang dikenal dengan istilah HOTS (Higher Order of Thinking Skills). Tujuan yang ingin dicapai dalam penelitian ini adalah untuk mengetahui peningkatan HOTS (Higher Order of Thinking Skills) mahasiswa pada mata kuliah Pengembangan Materi Ajar Bahasa dan Sastra Indonesia Universitas Muhammadiyah Bulukumba. Penelitian ini menggunakan jenis penelitian tindakan kelas dengan objek penelitian adalah mahasiswa Semester 5 (INA 17 A) Program Studi Pendidikan Bahasa Indonesia yang berjumlah 32 orang. Teknik pengumpulan data berupa hasil belajar dan aktivitas mahasiswa dalam perkuliahan. Hasil belajar dengan menggunakan tes dan aktivitas mahasiswa berupa lembar observasi. Analisis data dilakukan dengan mendeskripsikan hasil pengamatan dan analisis statistik sederhana untuk menghitung hasil tes mahasiswa. Hasil tes pada siklus I menunjukkan bahwa 31% (10 orang) mahasiswa yang memeroleh ketuntasan sedangkan 69% (22 orang) mahasiswa yang belum mencapai ketuntasan. Berdasarkan hal tersebut, penelitian dilanjutkan ke siklus kedua. Hasil tes pada siklus II menunjukkan peningkatan yang signifikan dimana sebesar 87% (28 orang) mahasiswa yang berhasil mencapai ketuntasan belajar sedangkan 13% (4 orang) mahasiswa belum tuntas. Dengan demikian, dapat disimpulkan pemanfaatan teknik SCAMPER terbukti efektif dalam meningkatkan HOTS (Higher Order of Thinking Mahasiswa) mahasiswa pada mata kuliah Pengembangan Materi Ajar Bahasa dan Sastra Indonesia. Abstract: One of the education goals especially in higher education is that students have creative and critical thinking skills known as higher order thinking skills or hots. The aim of this research is to find out the improvement of the students’ higher order thinking skills in the subject of Teaching Materials Development of Indonesian Language and Literature at Universitas Muhammadiyah Bulukumba. This study used a classroom action research with research objects that consist of 32 students in the 5th semester students of class 17 A from Indonesian Language Education Department. Techniques of collecting data used are students’ learning outcomes and students’ activities during lectures. Students’ learning outcomes were measured with tests and students’ activities were taken by using observation sheets. Data analysis was carried out by describing the results of observations and simple statistical analysis to calculate students’ test results. The test results in the first cycle show that 31 percent of students or 10 students can reach the learning completeness criteria, while 69 percent of students or 22 students cannot reach the completeness criteria of learning. Based on this research result, the actions were continoud to the second cycle. The second cycle test results show a significant increase in the students’ higher order thinking skills in that 87 percent of students or 28 students are able to achieve the learning completeness criteria and 13 percent of students or 4 students are not able to gain the completeness. Thus, it can be concluded that the SCAMPER technique proves effective in increasing the students’ higher order thinking skills in the subject of Teaching Materials Development of Indonesian Language and Literature.

Developing Higher Order Thinking Skills and Team Commitment via Group Problem Solving: A Bridge to the Real World

This study aims to investigate the analysis of the implementation of multi techniques based learning media in improving the elementary school students’ higher order thinking skill in solving exponential problem. This is caused by the lesson plans cannot motivate students to improve higher order thinking skills. The method used in this study is a mixed method which is a combination of quantitative and qualitative methods. The research subjects were the fifth grade students of elementary school consisting of 25 students of experimental class and 24 students of the control class. The instruments of this research are an interview, a questionnaire, observation, and documentation. Quantitative method is applied to analyze the difference of student achievement result among two classes, while the qualitative method is applied to analyze the students' higher order thinking skills. The results show that there are significant differences between the two classes that applied multi techniques based learning and conventional learning. The statistical result indicates that the (2-tailed) significance of the independent sample t-test in the pre-test was 0.000 or α ≤ 0.05. It implies that the implementation of multi techniques media affects the students' higher order thinking skill in solving exponential problem.

Concept attainment is a method of learning a new concept by contrasting and comparing certain aspects of the concept. In order to effectively use higher order thinking skills to improve the performance, there was a dire need for teachers to re-evaluate their teaching strategies and lay more responsibility on prospective teachers to learn and understand concepts of research. The researcher studied the effect of concept attainment model (CAM) based teaching on prospective teachers’ higher order thinking skills. The objective of the study was to examine the effect of concept attainment model (CAM) based teaching on prospective teachers’ higher order thinking skills. The investigation was quantitative in nature. The researcher used a quasi-experimental approach with non-equivalent control groups design. The subject of this study were all prospective teachers of Master of Education, two year programme. There were 30 participants in each intact group. The researcher first developed a table of specification then multiple choice questions (MCQs) test based on higher order thinking. There were 30 items present in the achievement test. After data collection from 16 weeks of intervention, the researcher used the paired sample t-test and independent samples t-test to examine the data gathered from pre-tests and post-tests pertaining to CAM and conventional methods. The results indicated that the achievement level of higher order thinking skills of the prospective teachers who received Concept Attainment Model (CAM) based teaching was higher than those who received conventional instruction methods.

Thinking styles of students and higher order thinking skills are important aspects of teaching and learning process. The purpose of this study was to investigate the relationship between thinking styles and higher order thinking skills (HOTS) of secondary school students and also to find the gender-wise difference in the nature of this relationship. The population of this study was male and female chemistry students of grade 9 in Tehsil Rawalpindi. Random sampling technique was used to select the sample. The data were obtained using the Convergent and Divergent Test and Achievement Test of Chemistry; developed in the light of Bloom Taxonomy. A quantitative research method was used for collection, interpretation and analysis of data. According to results, the relationship between convergent thinking style and higher order thinking skills of students was negligible. However, the strength of this correlation between divergent thinking style and higher order thinking skills of students is positive. Therefore, the understanding of student’s thinking styles can serve as initial guide in developing more effective and conductive teaching and learning environment for mastering higher order thinking skills (HOTS).

Narwianta, Nanang. (2019). The Evaluation of Higher Order Thinking Skills in English School Nationally Standardized Examination at State Senior High School 6 Semarang. Thesis, English Language Education Pascasarjana Universitas Negeri Semarang. Supervisor I. Dr. Dwi Anggani Linggar Bharati, M.Pd. Supervisor II. Prof. Dr. Dwi Rukmini, M.Pd Keywords: Evaluation, HOTS, English Nationally Standardized Examination The English school nationally standardized examination as an assessment of the learning outcomes conduct by educational unit is designed to measure the student`s achievement competencies, to determine student`s graduation from the school, it is very significant to conduct test items evaluation since it gives a clear portrait of the quality of the items and the test as a whole. The purpose of this study was to explain the realization of higher order thinking skills reflected in English school nationally standardized examination at state senior high school 6 Semarang academic year of 2018/2019. Then this research evaluate whether the items in English school nationally standardized examination met the requirement of content validity, reliability and practicality. The researcher use the mixed method using analysis card to analyze the realization of higher order thinking skills in English school nationally standardized examination. The content validity analyze through matching method between the basic competensies and the question in paper test.While to ensure the reliability of higher order thinking skills in English school nationally standardized examination, use the KR-21 for multiple choice test items and alpha cronbach for essay test items. And the practiality obtained through checklist instrument. The results indicated that HOTS realized in listening, reading, and writing questions. The listening in the form of spoken written, because it is to test listening simultaneously with speaking. There are one listening question categorized into HOTS of analyzing level, in reading the questions belonging to HOTS reach 8 questions that consist of 5 questions of analyzing level and 3 questions of evaluating level. Meanwhile, there is one question of HOTS into creating level in writing questions. The results also showed the proportion of HOTS comprised 22,22% met the requirement from BNSP that stated in academic year 2018/2019 there is approximately 10-15% of higher order thinking skills test items. Meanwhile, the content validity of the questions is high, and then the reliability of those test items categorized as unreliable and the practicality meet the requirements of the practical test items. Accordingly, this finding reveals that there is still much room for the variation of HOTS levels implemented all skills in English school nationally standardized examination. In the light of these result, this study recommends modifying the proportion of HOTS in four skills by providing them with more representation of the content validity.

In this study, we attempted to examine the quality of Iranian MA and PhD testing classes to find out how they prepare potential teachers and test makers for the journey of testing in their professional career and whether the exercises and assignments can prepare them to apply higher order thinking in their test construction process.Ten university professors holding PhD in TEFL, along with their students, participated in this study. After recording the assignments and activities, the data were listened, re-listened, and transcribed. The results showed that lower order thinking skills (69.445%) were used more than medium (30.555%) thinking skills in MA testing classroom activities, but higher order thinking skills (0%) were never used. On the other hand, medium order thinking skills (58.335%) were used more than higher order thinking skills (41.665%) in PhD testing classroom activities, and lower order thinking skills were never used. Moreover, activities and assignments given to postgraduate students first led to lower order thinking skills, next led to medium order thinking skills, and finally led to higher order thinking skills. There was a systemic pattern in the distribution of the order of thinking skills of Bloom's Revised Taxonomy in postgraduate activities and assignments. The findings of this study offer several pedagogical implications for students, instructors, and test designers in TEFL.

Please Many studies have described meta-analysis on the overall effect of e-learning influence in learning. However, there has been no meta-analysis of the overall effect of STEM-based e-learning on Higher Order Thinking Skills (HOTS). The purpose of this study investigates the effect of STEM-based e-learning on students' critical thinking skills in Indonesia. This type of research is a Systematic Literature Review (SL) and meta-analysis. Data sources came from 12 national and international journals published in 2018-2023. The process of searching for data sources through Google Scholar, ScienceDirect, Wiley, Eric, and Springer. Data analysis used the Hedge formula to calculate effect size with the help of the JSAP application. The findings show that the effect size value (ES = 0.84) is very high. This explains that STEM-based e-learning provides a very high positive impact and is effective in improving students' Higher Order Thinking Skills (HOTS). Furthermore, HOTS characteristics do not cause heterogeneity in the results of STEM-based e-learning research on students' Higher Order Thinking Skills. The findings suggest that educators should choose STEM-based e-learning as one of the learning models to improve students' Higher Order Thinking skills in Indonesia

This study aims to determine efforts to improve students' HOTS abilities through the Problem Based Learning learning model in social science subject, based on the learning carried out in the previous cycle, there are still a lot of students who have not reached the minimum completeness criteria when answering questions at the HOTS cognitive level. The solution to overcome these problems is using the Problem Based Learning (PBL) learning model. In carrying out this classroom action research, the researchers focused on research that aimed to determine whether there was a change in students' higher-order thinking skills through the application of problem-based learning models, and to find out how much the students' higher-order thinking skills increased using problem-based learning models. This classroom action research was conducted in two cycles of activity with each cycle consisting of two learning meetings. The data collection techniques used in this research are observation and test techniques. Based on the results of the classroom action research that has been carried out, it is concluded that the use of problem-based learning models can be used as an effort to improve participants' Higher Order Thinking Skills (HOTS). students in Social Studies class IX.9 SMP Negeri 2 Singaraja for the 2022/2023 academic year. Based on the results of the data analysis conducted, it is known that after being given action, there was a significant increase in HOTS in students from previously only 46.4% of students increased to 71.4% of students who were at the level of thinking skills. ABSTRAKPenelitian ini bertujuan untuk mengetahui upaya untuk meningkatkan kemampuan HOTS peserta didik melalui model pembelajaran Problem Based Learning pada mata pelajaran IPS. Berdasarkan pembelajaran yang dilakukan siklus sebelumnya, masih banyak peserta didik yang belum mencapai kriteria ketuntasan minimum saat menjawab soal-soal dalam level kognitif HOTS. Solusi untuk mengatasi permasalahan tersebut adalah penggunaan model pembelajaran Problem Based Learning (PBL). Keterlaksanaan penelitian tindakan kelas ini, peneliti memfokuskan penelitian yang bertujuan untuk mengetahui adanya perubahan keterampilan berpikir tingkat tinggi peserta didik melalui penerapan model pembelajaran problem based learning, serta mengetahui seberapa besar peningkatan keterampilan berpikir tingkat tinggi peserta didik dengan menggunakan model pembelajaran problem based learning. Penelitian tindakan kelas ini dilakukan dalam dua siklus kegiatan dengan masing-masing siklus terdiri dari dua pertemuan pembelajaran. Adapun teknik pengumpulan data yang digunakan dalam penelitian ini adalah teknik observasi dan tes. Berdasarkan hasil penelitian tindakan kelas yang telah dilaksanakan diperoleh kesimpulan bahwa pemanfaatan model pembelajaran problem based learning dapat digunakan sebagai salah satu upaya untuk meningkatkan Higher Order Thinking Skills (HOTS) peserta didik pada mata pelajaran IPS kelas IX.9 SMP Negeri 2 Singaraja tahun pelajaran 2022/2023. Berdasarkan hasil analisis data yang dilakukan diketahui bahwa setelah diberikan tindakan terjadi peningkatan HOTS yang cukup signifikan pada peserta didik dari yang sebelumnya hanya 46,4% peserta didik meningkat menjadi 71,4% peserta didik yang berada pada keterampilan berpikir tingkat tinggi.

The purpose of this literature studies is to gain knowledge in designing straight line equation material in middle school oriented to higher order thinking skills. The theory used in this study is constructivism in mathematics learning and the concept of higher order thinking skills. The presentation design of straight line equation material is designed through a presentation in the form of four problem situations are gradient, straight line equations, characteristics of straight line equations and applications of straight line equations. The four problem situations, based on theoretical studies, can be said to have fulfilled the three basic principles in constructing mathematical knowledge and three aspects of higher order thinking skills. The three basic principles in constructing mathematical knowledge are active student construction of mathematical knowledge, students construct new mathematical knowledge from the results of a physical and mental reflection and mathematical knowledge is formed by students through discussion and dialogue in their social learning environment. The three aspects of higher order thinking skills are deep understanding, reasoning and problem solving. The results of this literature studies can be concluded that the presentation design of straight line equations material in middle school in this study can be said to be oriented to higher order thinking skills. This is because theoretically able to generate activities that are oriented towards higher-order thinking skills, so that there is a great opportunity to equip students with the thoughts needed to form quality human resources in the 21st century.

Study aimed to analyze the effect of discovery learning model toward student’s higher order thinking skill. The type of this research was quasi experimental, with experiment class used discovery learning and control class used conventional learning. The population was all of the tenth class of SMA Raksana Medan academic year 2014/1015 which consist of seven classes. Sample was taken with a simple random sampling technique. The data in higher order thinking skill was collected by essay tests. Data analyzed with t test. The result of the study showed that there was positive effect of discovery learning model toward student’s higher order thinking skill in experiment class or given by discovery model. It proved from posttest result in experiment class was higher than control class or there was significant difference of post test score, although in higher order thinking level, both of class still in less level, but student who given discovery learning had higher value than control class. Keyword : Conventional Learning; Discovery Learning Model; Higher Order Thinking Skill

Background: This research aims to improve students Higher Order Thinking Skills by using the SelfDirected Learning Models (SDL).Methods: This research uses an exploratory research model. Qualitative data was obtained throughinterviews and questionnaires. Quantitative data was obtained through pretest and posttest data. Theresearch subjects were Biology students at FKIP Pattimura University which offered teacherprofessional development courses. The research instrument used was a test. Quantitative dataanalysis uses descriptive statistics and test scores, while qualitative data analysis uses data collectionprocedures, data reduction, data presentation, and building a conclusion.Results: The results of calculating the implementation of the Self Directed Learning models (SDL) toimprove students higher order thinking skills in teacher professional development courses show anaverage value of 97.36 with a significant value of 0.000 which is smaller than 0.05 (0.000<0.05) sothat the hypothesis can be accepted.Conclusion: The application of the Self Directed Learning models (SDL) is very effective in improvingthe higher order thinking skills of prospective biology teacher students.