Exploring the Efficacy of GenAI in Grading SQL Query Tasks: A Case Study
Numerous techniques, including problem-solving, seeking clarification, and creating questions, have been employed to utilize generative Artificial Intelligence (AI) in education. This study investigates the possibility of using Generate AI (GenAI) to grade Structured Query Language (SQL) queries aut...
Saved in:
| Published in: | Cybernetics and information technologies : CIT Vol. 24; no. 3; pp. 102 - 111 |
|---|---|
| Main Authors: | , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Sciendo
01-09-2024
|
| Subjects: | |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Numerous techniques, including problem-solving, seeking clarification, and creating questions, have been employed to utilize generative Artificial Intelligence (AI) in education. This study investigates the possibility of using Generate AI (GenAI) to grade Structured Query Language (SQL) queries automatically. Three models were used which are ChatGPT, Gemini, and Copilot. The study uses an experimental approach to assess how well the models perform in evaluating student responses by comparing the models’ accuracy with those of human experts. The results showed that despite some inconsistencies, GenAI holds great promise for streamlining. Thus, further research is required in light of inconsistent GenAI performance. If these issues were resolved, GenAI can be utilized in education. However, human oversight and ethical issues must always come first. |
|---|---|
| ISSN: | 1314-4081 1314-4081 |
| DOI: | 10.2478/cait-2024-0027 |