White paper urges governance for AI school grading technologies

Automated grading technologies could soon be rolled out in Australian schools but without robust national guidelines and an independent advisory body, some schools could be left behind.

"Machine marking" or "automated essay scoring" (AES) is increasingly used internationally, especially in the United States, in a range of high-stakes testing contexts where results determine student progression and school funding. The technology is highly likely to come to Australian schools in the coming years and could cause controversy without careful governance and consultation with the education community, the white paper says.

The white paper says Automated Essay Scoring (AES) could potentially alleviate aspects of teachers' workload at a time when teacher attrition is historically high and teacher recruitment historically low. But the technology also generates new demands on teachers and administrators, including financial pressure on schools that must procure these proprietary technology packages without advice.

Professor Kalervo Gulson in the School of Education and Social Work, is a researcher in education policy and advances in artificial intelligence. He studies how schools can grapple with and respond to rapid changes in technology in the education sector, which are known as EdTech.

"We know teachers are already experiencing heavy workloads and this new technology could help ease the pressure, so long as the implementation doesn't create even more work," said Professor Gulson.

"We don't recommend automated grading in high stakes testing where the results might impact the student's future or the school's funding," Professor Gulson said. "And like all types of artificial intelligence in schools, it is important that the people impacted by it understand what it will do, and have a say in its introduction."

Co-author Professor Greg Thompson, from Queensland University of Technology, is a former high school teacher and an expert in education assessments. He reinforced that: "We should continue to be cautious about any technology that relies on opaqueness being used to make consequential decisions in schools. More time and effort is needed to be spent on opening these systems up to improve both scrutiny and understanding."

NAPLAN and robo-marking

In 2018, the Department of Education, Skills and Employment attempted to implement a form of AES into NAPLAN. However, this "robo-marking" attempt proved politically unpopular and was scrapped by the Minister. The concerns from teachers, teachers' unions, principals and parents included:

• de-professionalization of teachers,
• inequitable infrastructure in Australian schools, and
• a lack of transparency from examination authorities as to how marking decisions were made.

AI in classrooms

The researchers say: The use of artificial intelligence in classrooms can be of great benefit to both teachers and students but it is crucial to have guidelines to safeguard our schools.

"Without political leadership in this area, it is ultimately up to educational institutions and agencies, policymakers, and school communities to work collaboratively to assess the benefits and pitfalls of AES and map the way forward," said Professor Gulson, who is a researcher in Sydney Social Sciences and Humanities Advanced Research Center (SSSHARC). "Our recommendations will assist the emergence of good governance in this area."

"Technology like AES can bring benefits but our schools need urgent guidance, as well as making sure all schools have the necessary digital infrastructure and human skills," said Professor Gulson.

Recommendations:

• Establish uniform, ethical guidelines for schools purchasing AES systems from commercial Edtech companies
• Ensure all schools, including rural and regional, have the necessary digital and human infrastructure to support implementation
• Build transparent best practice guidelines for the use of artificial intelligence in schools
• Initiate an independent advisory body for large-scale assessment in Australia
• Establish a risk-based framework that ranks the potential harm of AES adoption in specific assessment contexts and school settings
• Learn from large-scale roll-outs of AES in the US and other jurisdictions, including ethical, legal and financial implications and the impact on school, department and regional decision-making
• Utilize stakeholder expertise across multiple locations and decision-making levels, including educators in schools and classrooms, prior to roll-out.
• Do not use AES in high-stakes testing where outcomes are consequential to individuals or to school.
• If AES is to be widely adopted, Australia must lead the way in the collaborative development of AES guidance, policy, and regulation.

This white paper was developed by the Education Futures Studio and the Education Innovations research program.