Category: my research Page 1 of 20

So very tired of predictions about AI in education…

By people who aren’t AIEd experts, education technology experts, education experts, and the like.

Case in point: “AI likely to spell end of traditional school classroom, leading [computer science] expert says.”

I appreciate cross disciplinary engagement as much as I love guacamole (which is to say, a lot), but I’d also appreciate that we stop wasting our time on these same unfulfilled prophecies year after year, decade after decade.

Will AI impact education? In some ways it will, and in others it won’t. Will education shape the ways AI comes to be used in classrooms? In some ways it will, and in others it won’t.

Truth be told, this negotiated relationship isn’t as appealing as DISRUPTION, AVALANCHE, MIND-READING ROBO-TUTOR IN THE SKY, etc, which are words that readers of the history of edtech will recognize.

Are cohort-based course platforms “universities of the future?”

The edtech industry includes numerous learning providers and platforms providing tools, technologies, and resources for course creators to create and sell online courses. These platforms are interesting for very many reasons. What roles do they play in the learning and development ecosystem? How do they measure effectiveness and learning outcomes? What kinds of pedagogical and instructional design practices do they support and advocate for? What education-related claims do they make?

two people working on five laptops. They sit at a table littered with other devices, like phones, headset, and ipads. Photo by Marvin Meyer on Unsplash

In a paper we published a few months ago, we examined one such platform because it describes itself as building ‘the university of the future’ and has recently received significant attention and funding. This makes it a compelling case study to better understand the potential roles and risks associated with education platforms operating outside of and alongside more traditional higher education institutions.

We highlight specific concerns about cohort-based platforms. These include lack of transparency, risk of surveillance, lack of adequate financial support for learners, and over-reliance on social media networks as signifiers of educator/instructor qualification (this last one is a big one). Suggested benefits include adaptability, suitability to changing skills needs, and responsiveness to changing environmental scenarios.

The published version of the paper is here, but here’s a pre-print pdf: Veletsianos, G., & Houlden, S. (in press). On the “university of the future”: A critical analysis of cohort-based course platform Maven. Learning, Media, & Technology. 

 

Public version: Making ChatGPT detectors part of our education system prioritizes surveillance over trust

The Globe and Mail published an op-ed I wrote. As a condition of being featured in the publication, the paper has first publication rights for the first 48 hours. Since it’s been more than 48 hours, and for posterity, I’m making a copy available below.

Making ChatGPT detectors part of our education system prioritizes surveillance over trust

George Veletsianos is a professor of education and Canada Research Chair in Innovative Learning and Technology at Royal Roads University.

Imagine a world where surveillance technologies monitor and scrutinize your behaviour. Imagine a report that you write at work being compared with myriads of others and flagged for additional inspection when an algorithm deems it to be “very similar” to others.

Students don’t have to imagine this world. They are already living in it, in the form of plagiarism detection software, remote proctoring technologies, and now, tools aimed at detecting whether the students used ChatGPT – including new software that promises to catch students who use ChatGPT to cheat.

While taking online exams, students’ webcams scan their surroundings; their microphones monitor sounds and background noise, and their body and eye movements are tracked. Unexpected movements may indicate something as innocuous as stretching a tight neck or as problematic as catching a glimpse of Post-it notes on the wall, while unexpected sounds may indicate a child playing in the background or a roommate whispering answers. The essay assignments students submit are compared to a vast amount of writing by others. And a battery of scores might indicate plagiarizing from Wikipedia, passing off text created by ChatGPT as one’s own, or simply using common expressions. Any of this will get students flagged as potential cheaters.

That there are technologies to identify text written by artificial intelligence shouldn’t come as a surprise. What is surprising is that educators, administrators, students, and parents put up with surveillance technologies like these.

These technologies are harmful to education for two main reasons. First, they formalize mistrust. As a professor and researcher who has been studying the use of emerging technologies in education for nearly two decades, I am well aware that educational technology produces unintended consequences. In this case, these technologies take on a policing role and cultivate a culture of suspicion. The ever-present microscope of surveillance technology casts a suspicious eye on all learners, subjecting them all to an unwarranted level of scrutiny.

Second, these technologies introduce a host of other problems. Researchers note that these tools often flag innocent students and exacerbate student anxiety. This is something I’ve personally experienced as well when I took my Canadian citizenship exam online. Even though I knew the material and was confident in my abilities, my webcam’s bright green light was a constant reminder that I was being watched and that I should be wary of my every move.

To be certain, such tools may deter some students from intentionally plagiarizing. They may also improve efficiency, since they algorithmically check student work on behalf of educators.

But these reasons don’t justify surveillance.

A different world is possible when schools and universities dare to imagine richer and more hospitable learning environments that aren’t grounded in suspicion and policing. Schools and universities can begin to achieve this by developing more trusting relationships with their students and emphasizing the importance of honesty, original work, and creativity. They need to think of education in terms of relationships, and not in terms of control, monitoring, and policing. Students should be viewed as colleagues and partners.

Educators also need to come to terms with the fact that our assessments generally suffer from a poverty of imagination. Essays, tests, and quizzes have an important role to play in the learning process, but there are other ways to check for student achievement. We can design assessments that ask students to collect original data and draw inferences, or write and publish op-eds like this one; we can invite them to develop business and marketing plans for real-world businesses in their cities; we can ask them to reflect on their own unique experiences; we can require them to provide constructive peer-review and feedback to fellow students, or have them engage in live debates. In this light, ChatGPT is not a threat, but an opportunity for the education system to renew itself, to imagine a better world for its students.

Educators and administrators should stop using surveillance technologies like ChatGPT detectors, and parents and students should demand that schools and universities abolish them – not because cheating should be tolerated, but because rejecting the culture of suspicion that surveillance technologies foster and capitalize upon is a necessary step toward an education system that cares for its learners.

EdTech, magic mushrooms, and magic bullets

In my inbox, an email says:

Alberta’s new regulations on psychedelics to treat mental health issues come into effect today, making it the first province to regulate the use of hallucinogens in therapy.

Today in The Conversation Canada, Erika Dyck of the University of Saskatchewan walks readers through the new regulations, as well as the history, potential and pitfalls of hallucinogens both inside and outside clinical settings.

Psychedelics — from magic mushrooms and ayahuasca to LSD — are having a moment in the spotlight, with celebrity endorsements and a new generation of research on potential clinical uses. There is certainly a need for therapeutics to treat mental health issues, the growing prevalence of which could place a strain on the health-care system.

“Psychedelics are being held up as a potential solution,” Dyck writes. “But, magic mushrooms are not magic bullets.

That last line captures so much of what is happening in our field, and education more broadly, that it is worth repeating.

  • AI is being held up as a potential solution, but it is not a magic bullet.
  • A return to in-person learning is being held up as a potential solution, but it is not a magic bullet.
  • Online learning is being held up as a potential solution, but it is not a magic bullet.
  • Microcredentials are being held up as a potential solution, but they are not a magic bullet.
  • … and so on

These things – and others – can be solutions to some problems, but they consider them to be part of a Swiss army knife, part of a toolkit. And while sometimes your Swiss army knife will work, this isn’t always going to be the case, especially when we’re considering some of the most major challenges facing higher ed, the kinds of things that we’re not talking about (e.g., precarious employment and and external regulations that encourage and foster conservatism, etc).

And perhaps, that’s the crux of the issue: That these solutions are used to respond to the symptoms of larger problems, of the things we’re not talking about, rather than the root causes of them.

Image credit: Wall-e output in response to the prompt “a magic bullet in the style of salvador dali”

Critical Digital Pedagogy in Higher Education & collaborating with Suzan and Chris

Critical Digital Pedagogy in Higher Education will be published in January 2023. Suzan Köseoğlu, Chris Rowell, and I started working on this open access book <checks notes> around October 2019. It’s an edited volume that includes research and scholarship from many wonderful colleagues from around the world who have stuck with us and entrusted us with the process of trying to publish a book during a pandemic. I’ll be posting about each chapter in January, but here I wanted to share a note of appreciation for my co-editors.

It takes some perseverance to publish a book. But it takes a special of dedication and patience to edit and publish a book consisting of thirteen chapters written by more than 20 colleagues, while in a pandemic, while navigating life, while switching institutions, like both Cover for the book critical digital pedagogy in higher educationSuzan and Chris did.

Suzan is sharp, thoughtful, supportive, and approaches this work with the critical mindset it deserves. She read through every single manuscript (and countless submissions that did not end up being included in the final version of the book) with an eye to detail and in consideration of the broader work that is being done in the area.

Chris is equally sharp and reliable. He approaches this work with a keen understanding of practice, and that lens adds volumes to this work. He is equally dedicated to critical pedagogy, as well as to mobilizing knowledge in diverse ways (including through a podcast he’s been experimenting with for the book).

While working with them I appreciated their kindness and dedication. I knew I could rely on them, and I know that this work is better because of them.

Editing a book is a lot of hard work, and I don’t know of any academics who do it for the money, because frankly, there’s very little of it in scholarly publishing. Perhaps you might consider inviting Suzan or Chris to speak at your next event?

A Synthesis of Research on Mental Health and Remote Learning: How Pandemic Grief Haunts Claims of Causality

Stephanie Moore, Michael Barbour and I have published a paper synthesizing the results of all the research we could find relating to remote/online learning and mental health. Full paper and abstract below:

Moore, S., Veletsianos, G., & Barbour, M. (2022). A synthesis of research on mental health and remote learning: How pandemic grief haunts claims of causality. The Open/Technology in Education, Society, and Scholarship Association Journal, 2(1), 1-19. https://doi.org/10.18357/otessaj.2022.1.1.36

Abstract

While there has been a lot of debate over the impact of online and remote learning on mental health and well-being, there has been no systematic syntheses or reviews of the research on this particular issue. In this paper, we review the research on the relationship between mental health/well-being and online or remote learning. Our review shows that little scholarship existed prior to 2020 with most studies conducted during the COVID-19 pandemic. We report four findings: (1) pandemic effects are not well-controlled in most studies; (2) studies present a very mixed picture, with variability around how mental health and well- being are measured and how/whether any causal inferences are made in relation to online and remote learning, (3) there are some indications that certain populations of students may struggle more in an online context, and (4) research that does not assume a direct relationship between mental health and online provides the best insight into both confounding factors and possible strategies to address mental health concerns. Our review shows that 75.5% of published research on this topic either commits the correlation does not equal causation error or asserts a causal relationship even when it fails to establish correlations. Based on this study, we suggest that researchers, policymakers, practitioners, and administrators exercise extreme caution around making generalizable assertions with respect to the impacts of online/remote learning and mental health. We encourage further research to better understand effects on specific learner sub- populations and on course—and institution—level strategies to support mental health.

Keywords: mental health, online learning, remote education, anxiety, stress, well-being, wellness

The business case for edtech startups engaging education research

If you’ve been following my work for a while, you may have noticed that I’ve been advocating for edtech companies to collaborate with education researchers for a long while now. At the 2014 SXSW EDU  conference for example, my colleagues and I organized a panel titled Startups Should Talk with Researchers and Educators to highlight mutually beneficial relationships. Much has changed since then, but I often come across startups that can’t seem to grasp that the histories of online, distance, and digital learning can be informative and beneficial.

There are lots of reasons for this – and to be sure universities and researchers aren’t blameless, as a variety of factors limit the reach and impact of our scholarship.

Many have made the pedagogical case for education startups to  use the research available. In this post I want to make the business case for edtech startups to engage education research. Because it’s a win-win. And it’s simple.

By consulting with academics and/or learning designers, reading the research literature, exploring various pedagogical and learning design models, and understanding the relationships between teaching/learning and technology, you (i.e. startups) can save money and time.

How can you save money and time?

By identifying potential pain points and what education research has to say about your value proposition early on, you’d be able to develop minimum viable products that are at the very least  reflective of what we know about teaching and learning.

I’ve seen many startups fail because they took too long to understand the space. And too many startups accidentally stumbling upon what is common knowledge in education research after they’ve burned through initial investment rounds.

You (i.e. startups) do not need to start at 0 to get to 10. You can start at 3, 5, 7 even by engaging education research.

To make this example concrete, below is an excerpt of an email from an edtech startup that I received yesterday. This is a startup that’s been around for 2+ years and raised 2 rounds of funding.

Something unexpected keeps happening in our post-course surveys.

As you might guess, we regularly hear about the quality of [our company’s] instructors and the knowledge they pass on.

But we didn’t expect to hear so often of the value of the other course participants, of taking courses live, alongside other ambitious, generous professionals.

Turns out—it’s the other students in each cohort that make it special.

The power of peer learning and community isn’t a secret. Really, it’s common knowledge. All that post-course surveys do here is confirm what those of us who have been studying distance and online learning for decades already know. Only when startups fail to engage with the rich and long history of this field do they call the realization that motivated and knowledgeable peers working in community foster powerful learning experiences an unexpected discovery.

What if this realization came 18 months ago?

Page 1 of 20

Powered by WordPress & Theme by Anders Norén