Tag: open scholarship Page 2 of 7

Emerging Practices in Open Online Learning Environments

I joined Audrey Watters, Philipp Schmidt, Stephen Downes, and Jeremy Friedberg in Toronto last week, to give a talk at Digital Learning Reimagined, an event hosted and organized by Ryerson University’s Chang School. I presented some of our latest research, and tried to highlight research findings and big ideas in 15 minutes. Below are my slides and a draft of my talk.

Welcome everyone! It’s a pleasure and an honor to be here. Even though I’m the person giving this talk, I’d like to acknowledge my collaborators. A lot of the work that I am going to present is collaborative and it  wouldn’t have been possible without such amazing colleagues. These are: Royce Kimmons from the University of Idaho, Amy Collier and Emily Schneider from Stanford University, and Peter Shepherdson from the University of Zurich. The Canada Research Chairs program, the National Science Foundation and Royal Roads University have funded this work.

I want to start my talk by telling a story.

This castle that you see here is one of the most recognizable parts of Royal Roads University (RRU). But, don’t let the castle fool you. RRU was created in 1985. It’s purpose was to serve the needs of a changing society by serving working professionals through graduate digital education and multidisciplinary degrees. It has grown since 1985. It has matured, developed a social learning model that is now infused in all courses, developed new areas of focus, forged global partnerships, and continues to explore how to improve what it does through pedagogical and technological approaches.

Why am I sharing this short story about RRU?

Because this story, minus the specific details, is a common story. It’s also a Ryerson story, a story that is played out at the University of Southern New Hampshire, a story that Open Universities around that world have gone through. It is a story that repeats itself over and over for years and years.

What is the essence of the story?

It is often assumed that universities have been static, unchanging since the dawn of time. The short story I shared illustrates that universities are, and have always been, part of the society that houses them, and as societies change, universities change to reflect those societies. The economic, sociocultural, and technological pressures that universities are facing are sizable, and for better or for worse, usually for both, there’s a continuous re-imagination of education throughout time. Throughout time. Universities have always been changing.

As universities are changing and exploring different ways to offer education, faculty, researchers, and administrators engage in a number of practices that I like to describe as emerging. Emerging practices & emerging technologies are those that are not necessarily new, not yet fully researched, but appear promising.

Online learning and openness are example of emerging practices.

Online learning has a long history. But it also has a new history, with the development of multimedia platforms, media that can be embedded across platforms, syndication technologies that enable learners to use their own platforms for learning and so on. So, even though some of the problems that online learners are facing in contenmporary situations are not new (eg dropout), learners abilities’ to congregate in online communities is expanded through newer technologies and that poses different sorts of challenges and opportunities.

Another emerging practice is openness. Openness refers to liberal policies for the use, re-use, adaptation, and redistribution of content. Openness is also a value: It refers to adopting an ethos of transparency with regards to access to information. And this ethos ranges from academics publishing their work in open formats, to teaching open courses, to creating open textbooks. And it doesn’t stop at individual academics or institutions. In 2014 the Premiers of Alberta, British Columbia, and Saskatchewan signed a Memorandum of Understanding to facilitate creation, sharing, and use of Open Educational Resources. In the same year, SSHRC, NSERC, and CIHR have drafted a tri-agency open access policy to improve access to and dissemination of research results (NSERC, 2014);

There is a growing interest in and exploration of online learning and openness, practices which are still emerging. Next, I will share four recent results from our research into these practices that I believe are interesting to consider because they reveal the tensions that exist when dealing with emerging topics.

First, research into online learning is becoming more interdisciplinary

Interdisciplinary research into online learning means that individuals from a diverse range of disciplines, not just education, are interested in making sense of online learning. It is hoped that more research into online learning and more research from multidisciplinary groups will help us learn more about online learning and about learning in general.

We have evidence to show that research into online learning is becoming more interdisciplinary. I won’t bore you with the statistics, but we measure diversity in published research using a nifty measure and found that the period 2013-2014 can be described as more interdisciplinary than the period 2008-2012.

This is a positive trend, but before I explain its significance, let me explain to you how I view technology.

My perspective on online learning centers around the idea that technology is socially shaped . That means that technology always embeds its developers’ worldviews, beliefs, and assumptions into its design and the activities it supports and encourages.

What does this mean for interdisciplinarity? This means that we have both an opportunity and a challenge.

Our opportunity: to use our respective expertise to improve education.

Our challenge: to actually do interdisciplinary thinking and to go into the study and design of future educational systems with an open mind and the realization that our own personal experiences of education may not be generalizable. A lot of educational technology is produced by people of privilege and to develop educational technology that matters and makes societal difference, we need diversity in thinking and experience.

Our second finding refers to the increasing desire to collect, mine, and analyze data trails to make inferences about human behavior and learning. This practice is often referred to as learning analytics and educational data mining. This practice is a reflection of a larger societal trend toward big data analytics. The idea is that by looking at what people do online one can understand how to improve education.

A couple of things that researchers discovered for example are:

-Students generally stop watching online videos after 4-5 minutes. This then encourages the creation of 4-5 minute lecture videos
-Students fall in discrete categories when they are in MOOCs. For example students who are just sampling content, students who are disengaged,  or they are on track for completing. Once you identify categories you can identify and support learner needs

Data trails. Nearly everything that learners do online is tracked. Can we understand learners and improve learning by analyzing their data trails?

While these approaches can help us explain what people do, they often don’t tell us why they do they things they do nor how they actually experience online education.

My colleagues and I are interviewing MOOC students to learn about their experiences in MOOCs.

I am now going to tell you about our third result. We find that learners schedule their learning, use of resources, and participation to fit their daily life. This is in stark contrast to the idea of undergraduate education situated at a university and happening at particular time periods.

One retired individual in Panama that we interviewed works on his class early in the morning every day. Why does he do that? He does that because at that time his daughter is asleep. She is homeschooled and once she wakes up she needs access to the 1 computer that they have in the household to do her own schoolwork. In this case a lack of resources necessitates this scheduling.

One individual that we interviewed moved from the UK to the USA to be with her partner. She is currently waiting for her work permit, driver’s license, and so on, and she was enrolled in multiple MOOCs at the same time. She would work on her courses on Monday because she just “wanted them out of the way,” and so she would work on these courses straight throughout the day.

The fourth and final finding that I have for you today, is that MOOC platforms to date have not offered learners the ability to keep notes, so that particular activity, by virtue of being unsupported by the platform goes undetected when researchers only look at data trails.

Unsurprisingly, learners keep notes. A number of students that we talked to described that they keep notes on paper, frequently keeping a notebook for particular courses and returning to them during exams or during times that they needed them. Learners of course also keep notes in digital format. Usually in word documents, but again documents are dedicated to particular courses, but sometimes they are dedicated to particular topics across courses.

To give you an example, of how we believe this activity could be supported in the future and how we believe innovations  can contribute to learning, we recommend designers support this practice by pedagogical innovations such as scaffolding notetaking, but also by technological innovations, by developing online systems for notetaking. What is important here is that such systems should support learning by being interoperable, by allow learners full and unrestricted access to their notes, supporting them to be able to import & export their notes between platforms. Such a design is in line with emerging ideas in the field which call for learners to own their data.

To summarize:

1. Online learning is becoming more interdisciplinary, but we need to work together and address our assumptions
2. There is excitement about learning analytics, but we also need to understand why people do the things that they do
3. For example, we see that online education needs to accommodate lives as opposed to the other way round
4. And we see that by interviewing people we can get a better sense of the things that they do that don’t get captured by the digital trails they leave behind.

Thank you for being a great audience. I am really excited to hear the speakers that follow me, as I am sure you are!

visual

A visualization of my talk, created by Giulia Forsythe

On peer-review

My colleague Amy Collier wrote a thoughtful and reflective post on peer-review. Peer review has been a topic of conversation at a number of other spaces recently, including the Chronicle of Higher Education advice columns and Inside Higher Ed.

One of the most thoughtful writings on the topic that I have read is a conversational series of articles initiated by Kevin Kumashiro, called Thinking Collaboratively about the Peer-Review Process for Journal- Article Publication and published with Harvard Educational Review. This is an excellent piece of writing and even though it was published in 2005 it is as relevant today as it ever was. For example, here’s a sample from one of my favorite authors, William Pinar, that appears in this paper:

For professors of education, working pedagogically should structure all that we do, not just what happens in our classrooms or in our offices. Working pedagogically should structure our research as we labor to teach our students and our colleagues what we have understood from study and inquiry. It must also structure our professional relations with each other, especially during those moments of anonymity when we are called upon to critique research and inquiry that is under consideration for publication in our field’s scholarly journals. When we are anonymous, we are called upon to perform that pedagogy of care and concern to which we claim to be committed. The ethical conduct of our professional practice demands no less.

Peer-review will continue to receive attention and interest, as higher education is facing formidable technological and socio-cultural pressures. We wrote about this issue in the past in one of our papers (p. 770-771), and I am going to quote it at length here because of its relevance: 

“Peer review is the first example of how seemingly non-negotiable scholarly artifacts are currently being questioned: while peer review is an indispensable tool intended to evaluate scholarly contributions, empirical evidence questions the value and contributions of peer review (Cole, Cole, & Simon,1981; Rothwell & Martyn, 2000), while its historical roots suggest that it has served functions other than quality control (Fitzpatrick, 2011). On the one hand, Neylon and Wu (2009, p. 1) eloquently point out that “the intentions of traditional peer review are certainly noble: to ensure methodological integrity and to comment on potential significance of experimental studies through examination by a panel of objective, expert colleagues”, while Scardamalia and Bereiter (2008, p. 9) recognize that “like democracy, it [peer-review] is recognized to have many faults but is judged to be better than the alternatives”. Yet, peer review’s harshest critics consider it an anathema. Casadevall and Fang (2009) for instance, question whether peer review is in fact a subtle cousin of censorship that relies heavily upon linguistic negotiation or grammatical “courtship rituals” to determine value, instead of scientific validity or value to the field, while Boshier (2009) argues that the current, widespread acceptance of peer review as a valid litmus test for scholarly value is a “faith-” rather than “science-based” approach to scholarship, citing studies in which peer review was found to fail in identifying shoddy work and to succeed in censoring originality… The challenge for scholarly practice is to devise review frameworks that are not just better than the status quo, but systems that take into consideration the cultural norms of scholarly activity, for if they don’t, they might be doomed from their inception. A recent experiment with public peer review online at Nature, for example, revealed that scholars exhibited minimal interest in online commenting and informal discussions with findings suggesting that scholars “are too busy, and lack sufficient career incentive, to venture onto a venue such as Nature’s website and post public, critical assessments of their peers’ work” (Nature, 2006, { 9). Shakespeare Quarterly, a peer-reviewed scholarly journal founded in 1950 conducted a similar experiment in 2010 (Rowe, 2010). While the trial elicited more interest than the one in Nature with more than 40 individuals contributing who, along with the authors, posted more than 300 comments, the experiment further illuminated the fact that tenure considerations impact scholarly contributions. Cohen (2010) reported that “the first question that Alan Galey, a junior faculty member at the University of Toronto, asked when deciding to participate in The Shakespeare Quarterly’s experiment was whether his essay would ultimately count toward tenure”. Considering the reevaluation of such an entrenched and centripetal structure of scholarly practice as peer review, along with calls for recognizing the value of diverse scholarly activities (Pellino et al., 1984), such as faculty engagement in K–12 education (Foster et al., 2010), we find that the internal values of the scholarly community are shifting in a direction that may be completely incompatible with some of the seemingly non-negotiable elements of 20th century scholarship.”

Open, Social, Networked scholarship panel at social media and society conference

smsocconf

 

I am organizing a panel for the Social Media & Society conference entitled Networked Participatory Scholarship: Empirical perspectives on scholars use of social media. If you are attending the conference and are interested in the changing nature of scholarship, we’d love to see you there!  Below is a short description of the panel

Panel Members:

George Veletsianos, Associate Professor, Canada Research Chair, Royal Roads University, @veletsianos

Anatoliy Gruzd, Associate Professor, Ryerson University, @gruzd

Royce Kimmons, Director of the Doceo Center for Innovation + Learning, Assistant Professor, University of Idaho, @roycekimmons

Christine Greenhow, Assistant Professor, Michigan State University, @chrisgreenhow

Bonnie Stewart, Doctoral Candidate, University of Prince Edward Island, @bonstewart

 Panel Objectives:

The overarching objective of this panel is to examine the concept of Networked Participatory Scholarship, which refers to academics’ use of digital and social technologies to “share, reflect upon, critique, improve, validate, and further their scholarship” (Veletsianos & Kimmons, 2012). The five researchers participating in the panel are making significant contributions to our enhanced understanding of how and why academics are engaging in digital, social, networked, and social scholarship via the use of social media. Panelists will  make 7 minute presentations which will be followed by an interactive conversation. Each panelist’s contribution is summarized below.  

Scholars from disparate fields have discussed social media use in scholarship. However, such discussions are often disconnected. Kimmons will disambiguate several terms describing emergent scholarship, including open, social, digital, and networked participatory scholarship and identify bridges between disciplines.

Gruzd will discuss results from a recently-completed SSHRC award that examined if, how, and why Canadian scholars and their international counterparts are using social media in their research.

Greenhow will discuss social scholarship and trends and challenges experienced by educational researchers in the United States based on a recent survey and interviews with PhD students, and early- and mid-career scholars.

Stewart will discuss the different ways and purposes scholars engage in networked participatory scholarship, based on a recent ethnographic study. She will examine changing identity roles for academics and scholars.

 

Veletsianos will discuss a framework he developed summarizing empirical research in the field. In this framework scholars’ social media participation is seen to exist in networks of (a) knowledge creation and dissemination, (b) tension, (c) care and vulnerability, (d) fragmentation, and (e) transparency.

Networks of tension and conflict

One of the chapters in my upcoming book, Networked Scholars, and one of the modules in my open online course on Networked Scholars, focuses on describing social media as networks of tension and conflict.  In participating online, academics face and experience a wide range of tensions and conflicts that have to do with values, beliefs, academic freedom, institutional oversight, and societal expectations. These tensions aren’t just experienced by academics. Teachers face similar tensions as well.

The developing story regarding Dr. Salaita’s revoked job offer is an example of this, and, as numerous others have pointed out, of so much more. The area around academic freedom, social media, and public intellectuals is one that educational institutions need to seriously address. It’s also an area that we need to introduce to our PhD students… not just to show them examples of messy situations, but to help them investigate and understand the role and significance of digital and networked technologies in academics’ day to day lives (hence the reason for the free online class linked above!).

 

Assumptions underpinning open scholarship

Fecher and Friesike reviewed the literature relevant to open science and found that “open science is an umbrella term that encompasses a multitude of different assumptions about the future of knowledge creation and dissemination; an umbrella term however that comprises five more or less distinct schools of thought with different assumptions about what exact aspect of research should be ‘open’ and ‘open’ to whom.”

One of these schools of thought is the “public school” whose advocates appear to believe that “the social web and Web 2.0 technologies allow and urge scientists on the one hand to open up their research processes and on the other hand to prepare research products for interested non-experts.” 

There’s a number of interesting results here, lending  support to, and further defining, the following assumptions and themes of open scholarship we identified in Veletsianos & Kimmons (2012):

  • Open scholarship has a strong ideological basis rooted in an ethical pursuit for democratization, fundamental human rights, equality, and justice
  • Open scholarship emphasizes the importance of digital participation for enhanced scholarly outcomes
  • Open scholarship is treated as an emergent scholarly phenomenon that is co-evolutionary with technological advancements in the larger culture
  • Open scholarship is seen as a practical and effective means for achieving scholarly aims that are socially valuable

 

Veletsianos, G. & Kimmons, R. (2012). Assumptions and Challenges of Open Scholarship. The International Review Of Research In Open And Distance Learning,13(4), 166-189. 

Networked Scholars open course

NetworkedImage courtesy of NetWork

In the Fall, I will be teaching an open course entitled Networked Scholars. We are having our first design meeting this week, and in preparation for that, I have written up a course description (see below). The course is my response to the fact that Research Methods courses in the social sciences rarely examine scholarly practices in the digital age. Digital, networked, and open scholarship are topics that students and academics discover and examine on their own. These topics are too important to ignore. I believe that we should be teaching them in research methods courses. I am creating this course to help introduce individuals to these topics and to create an open online resource to help those who want to integrate these topics into their research methods courses. If you are interested in integrating aspects of this course with your (on campus or online) research methods course, I’d love to talk to you!

Course Description

In this course, we will examine the tools and practices associated with networked, open, and digital scholarship. In particular we will investigate the emergent practice of scholars’ use of social media and online social networks for sharing, critiquing, improving, furthering, and reflecting upon their scholarship. Recent reports indicate that social media are at an early stage of adoption in academia, even though mindful participation in digital spaces is a significant skill for today’s academic and knowledge worker.

Participants will study scholarly presence online. They will examine how particular tools and practices may enhance the impact and reach of scholarship, and will explore the challenges and tensions associated with emerging forms of scholarship. By gaining an understanding of modern forms of scholarship, participants will be better equipped to use digital technologies and networked practices in their own work.

This course will be of immediate relevance to doctoral students, academics, and knowledge workers. Faculty members who teach research methods courses and faculty development professionals may also find this course valuable.

August 20, 2014 update

The course will run on the Canvas network (and concurrently on social media via the #scholar14 hashtag). The course registration page is live.

June 4, 2014 update

Course hashtag: #scholar14

If you’d like to be informed about the start of course or if you’d like to give feedback on the content and design of the course, please fill in the short survey below (also found here).

MITx and HarvardX make some of their MOOC data publicly available

MITx and HarvardX deserve huge congratulations for making data associated with a number of their MOOCs publicly available. Four months ago, I wrote that the “community would benefit from access to the data that HarvardX and MITx have, as other individuals/groups could run additional analyses. Granted, I imagine this might require quite a lot of effort, not least in the development of procedures for data sharing.” It seems that the researchers at MITx and HarvardX have tackled the issues involved to make the data available, and have developed thoughtful procedures to ensure de-identification. While some of the steps taken may limit analyses (e.g., the de-identification process document notes that “rows with 60 or more forum posts were deleted,” thus eliminating highly active users), this is a big step in the right direction and it should be celebrated.

Now… can we have some qualitative data? If any institutions are interested in making those available, I’d love talk to you, give you input, and work with you toward that goal.

 

Page 2 of 7

Powered by WordPress & Theme by Anders Norén