Assessing the Influence of AI-Generated Responses on Academic Achievement: An Ethical Perspective and Self-Efficacy of Delta State Secondary School Students, Nigeria

Source abstract

This study examined the influence of AI-generated responses on students’ mathematics achievement and self-efficacy. Using a quasi-experimental design with two control groups and two experimental groups, the study employed three research questions and three hypotheses. 1,369 Senior Secondary School I (SSS I) students from public schools in Ughelli North Local Government Area of Delta State made up the population. A sample of 115 students, consisting of two intact classes chosen by simple random sampling, was drawn from two randomly selected coeducational schools. School A served as the experimental group with 62 students (43 males and 19 females), while School B served as the control group with 53 students. Data were gathered using two instruments: the “Students’ Questionnaire on Ethical Impacts of AI-Generated Responses on Students’ Achievement in Solving Quadratic Equations” (SQEIAIGRASQ) and the Quadratic Equation Achievement Test (QEAT). Both instruments were validated by mathematics teachers and measurement and evaluation experts, and the required corrections were made. Reliability testing showed a high reliability index. The mean and standard deviation were used to answer the research questions, while independent-samples t-tests were employed to test the null hypotheses at a 0.05 level of significance. The findings revealed that students exposed to AI-generated responses achieved higher performance than those taught through conventional teaching methods. Furthermore, AI-generated responses positively influenced the self-efficacy of students in solving mathematics problems. The practical implication of these findings is that teachers should integrate AI-generated responses into instruction while providing their own input, and students should also be encouraged to engage with these tools responsibly. Based on the findings, it was recommended that students be encouraged to use AI-generated responses while observing ethical guidelines in their use and contribution to AI-supported learning outcomes.