Canada Research Chair in Innovative Learning and Technology & Associate Professor at Royal Roads University

Tag: online learning

Emerging Practices in Open Online Learning Environments

Posted on February 23rd, by George Veletsianos in emerging technologies, moocs, my research, NPS, online learning, open, scholarship. 33 comments

I joined Audrey Watters, Philipp Schmidt, Stephen Downes, and Jeremy Friedberg in Toronto last week, to give a talk at Digital Learning Reimagined, an event hosted and organized by Ryerson University’s Chang School. I presented some of our latest research, and tried to highlight research findings and big ideas in 15 minutes. Below are my slides and a draft of my talk.

Welcome everyone! It’s a pleasure and an honor to be here. Even though I’m the person giving this talk, I’d like to acknowledge my collaborators. A lot of the work that I am going to present is collaborative and it  wouldn’t have been possible without such amazing colleagues. These are: Royce Kimmons from the University of Idaho, Amy Collier and Emily Schneider from Stanford University, and Peter Shepherdson from the University of Zurich. The Canada Research Chairs program, the National Science Foundation and Royal Roads University have funded this work.

I want to start my talk by telling a story.

This castle that you see here is one of the most recognizable parts of Royal Roads University (RRU). But, don’t let the castle fool you. RRU was created in 1985. It’s purpose was to serve the needs of a changing society by serving working professionals through graduate digital education and multidisciplinary degrees. It has grown since 1985. It has matured, developed a social learning model that is now infused in all courses, developed new areas of focus, forged global partnerships, and continues to explore how to improve what it does through pedagogical and technological approaches.

Why am I sharing this short story about RRU?

Because this story, minus the specific details, is a common story. It’s also a Ryerson story, a story that is played out at the University of Southern New Hampshire, a story that Open Universities around that world have gone through. It is a story that repeats itself over and over for years and years.

What is the essence of the story?

It is often assumed that universities have been static, unchanging since the dawn of time. The short story I shared illustrates that universities are, and have always been, part of the society that houses them, and as societies change, universities change to reflect those societies. The economic, sociocultural, and technological pressures that universities are facing are sizable, and for better or for worse, usually for both, there’s a continuous re-imagination of education throughout time. Throughout time. Universities have always been changing.

As universities are changing and exploring different ways to offer education, faculty, researchers, and administrators engage in a number of practices that I like to describe as emerging. Emerging practices & emerging technologies are those that are not necessarily new, not yet fully researched, but appear promising.

Online learning and openness are example of emerging practices.

Online learning has a long history. But it also has a new history, with the development of multimedia platforms, media that can be embedded across platforms, syndication technologies that enable learners to use their own platforms for learning and so on. So, even though some of the problems that online learners are facing in contenmporary situations are not new (eg dropout), learners abilities’ to congregate in online communities is expanded through newer technologies and that poses different sorts of challenges and opportunities.

Another emerging practice is openness. Openness refers to liberal policies for the use, re-use, adaptation, and redistribution of content. Openness is also a value: It refers to adopting an ethos of transparency with regards to access to information. And this ethos ranges from academics publishing their work in open formats, to teaching open courses, to creating open textbooks. And it doesn’t stop at individual academics or institutions. In 2014 the Premiers of Alberta, British Columbia, and Saskatchewan signed a Memorandum of Understanding to facilitate creation, sharing, and use of Open Educational Resources. In the same year, SSHRC, NSERC, and CIHR have drafted a tri-agency open access policy to improve access to and dissemination of research results (NSERC, 2014);

There is a growing interest in and exploration of online learning and openness, practices which are still emerging. Next, I will share four recent results from our research into these practices that I believe are interesting to consider because they reveal the tensions that exist when dealing with emerging topics.

First, research into online learning is becoming more interdisciplinary

Interdisciplinary research into online learning means that individuals from a diverse range of disciplines, not just education, are interested in making sense of online learning. It is hoped that more research into online learning and more research from multidisciplinary groups will help us learn more about online learning and about learning in general.

We have evidence to show that research into online learning is becoming more interdisciplinary. I won’t bore you with the statistics, but we measure diversity in published research using a nifty measure and found that the period 2013-2014 can be described as more interdisciplinary than the period 2008-2012.

This is a positive trend, but before I explain its significance, let me explain to you how I view technology.

My perspective on online learning centers around the idea that technology is socially shaped . That means that technology always embeds its developers’ worldviews, beliefs, and assumptions into its design and the activities it supports and encourages.

What does this mean for interdisciplinarity? This means that we have both an opportunity and a challenge.

Our opportunity: to use our respective expertise to improve education.

Our challenge: to actually do interdisciplinary thinking and to go into the study and design of future educational systems with an open mind and the realization that our own personal experiences of education may not be generalizable. A lot of educational technology is produced by people of privilege and to develop educational technology that matters and makes societal difference, we need diversity in thinking and experience.

Our second finding refers to the increasing desire to collect, mine, and analyze data trails to make inferences about human behavior and learning. This practice is often referred to as learning analytics and educational data mining. This practice is a reflection of a larger societal trend toward big data analytics. The idea is that by looking at what people do online one can understand how to improve education.

A couple of things that researchers discovered for example are:

-Students generally stop watching online videos after 4-5 minutes. This then encourages the creation of 4-5 minute lecture videos
-Students fall in discrete categories when they are in MOOCs. For example students who are just sampling content, students who are disengaged,  or they are on track for completing. Once you identify categories you can identify and support learner needs

Data trails. Nearly everything that learners do online is tracked. Can we understand learners and improve learning by analyzing their data trails?

While these approaches can help us explain what people do, they often don’t tell us why they do they things they do nor how they actually experience online education.

My colleagues and I are interviewing MOOC students to learn about their experiences in MOOCs.

I am now going to tell you about our third result. We find that learners schedule their learning, use of resources, and participation to fit their daily life. This is in stark contrast to the idea of undergraduate education situated at a university and happening at particular time periods.

One retired individual in Panama that we interviewed works on his class early in the morning every day. Why does he do that? He does that because at that time his daughter is asleep. She is homeschooled and once she wakes up she needs access to the 1 computer that they have in the household to do her own schoolwork. In this case a lack of resources necessitates this scheduling.

One individual that we interviewed moved from the UK to the USA to be with her partner. She is currently waiting for her work permit, driver’s license, and so on, and she was enrolled in multiple MOOCs at the same time. She would work on her courses on Monday because she just “wanted them out of the way,” and so she would work on these courses straight throughout the day.

The fourth and final finding that I have for you today, is that MOOC platforms to date have not offered learners the ability to keep notes, so that particular activity, by virtue of being unsupported by the platform goes undetected when researchers only look at data trails.

Unsurprisingly, learners keep notes. A number of students that we talked to described that they keep notes on paper, frequently keeping a notebook for particular courses and returning to them during exams or during times that they needed them. Learners of course also keep notes in digital format. Usually in word documents, but again documents are dedicated to particular courses, but sometimes they are dedicated to particular topics across courses.

To give you an example, of how we believe this activity could be supported in the future and how we believe innovations  can contribute to learning, we recommend designers support this practice by pedagogical innovations such as scaffolding notetaking, but also by technological innovations, by developing online systems for notetaking. What is important here is that such systems should support learning by being interoperable, by allow learners full and unrestricted access to their notes, supporting them to be able to import & export their notes between platforms. Such a design is in line with emerging ideas in the field which call for learners to own their data.

To summarize:

1. Online learning is becoming more interdisciplinary, but we need to work together and address our assumptions
2. There is excitement about learning analytics, but we also need to understand why people do the things that they do
3. For example, we see that online education needs to accommodate lives as opposed to the other way round
4. And we see that by interviewing people we can get a better sense of the things that they do that don’t get captured by the digital trails they leave behind.

Thank you for being a great audience. I am really excited to hear the speakers that follow me, as I am sure you are!

visual

A visualization of my talk, created by Giulia Forsythe

Dissertations on MOOCs published in 2014

Posted on January 27th, by George Veletsianos in moocs, open, papers, scholarship. 32 comments

1. Congratulations to the following seven individuals who completed a doctoral degree in 2014.

2. It’s always interesting to explore literature outside of peer-reviewed journals to explore how early career colleagues are thinking about a topic.

3. The doctoral dissertations that follow were all published in 2014 and they focus on various aspects of MOOCs. Undoubtedly, some of the findings reported below will make it into the peer-reviewed literature. As far as I can tell, findings from Kassabian, Kellogg, and Moe have already been published.

3. I believe that it would have been more valuable if these were already published as a series of shorter articles instead of being published as volumes that then need additional effort to be revised/refined for submission to professional journals, a practice that is both frequent and encouraged. My dissertation in 2008 was a 3-paper series. There’s ways to do this, and really good reasons to do so. I’ve discussed this option with 3-4 doctoral students recently that are exploring the option, but institutions need policies and frameworks in place to support such efforts.

4. I digress. Below you can find the citation and abstracts for these seven dissertations. Enjoy!

Gerber, J. (2014). MOOCs: Innovation, Disruption and Instructional Leadership in Higher Education. ProQuest, UMI Dissertations Publishing.

In the beginning rush of attention surrounding MOOCs (Massive Open Online Courses), there was considerable speculation regarding the ideal use and potential impact of this new innovation on teaching, learning, and traditional higher educational structures. Yet universities and colleges were rushing to implement MOOCs despite neither data nor clear understanding regarding their potential disruptive force on the educational landscape. To examine the MOOC phenomenon more closely, I conducted qualitative research that examined MOOCs integration at higher education institutions identified to be at the forefront of the MOOC movement. Framed using Everett Rogers’ model of innovation diffusion (Rogers, 1962), MOOC early adopters were defined as faculty members from US institutions who offered MOOCs between April 2012 and December 2013. This study researched initial MOOC implementation efforts in order to better determine motivations, implications and future impact on higher education, which will provide greater context to this rapidly shifting innovation. My findings indicate that the primary institutional motivation to sponsor MOOCs was to raise and/or enhance their institutional brand. The findings also indicated that faculty that self-selected to participate in MOOCs at the early stage was open to experimentation as well as to the inherent risks associated with the trial of a new educational innovation. This study uncovered important implications on the main pedagogical mission of the university and its professors as a result of instructor and institutional involvement with MOOCs. More specifically, this study revealed that MOOCs have pushed pedagogical issues to the forefront, and faculty early adopters have shifted their classroom teaching in ways believed to improve the classroom experience and create more interactive learning opportunities for students as a result of MOOCs.

Kassabian, D. (2014). Massive Open Online Courses (MOOCs) at elite, early-adopter universities: Goals, progress, and value proposition. ProQuest, UMI Dissertations Publishing.

Massive Open Online Courses (MOOCs) have become a hot topic in higher education and have undergone rapid growth. More than 800 MOOCs have been offered to the public from more than 200 of the most well known universities in the world, with millions of learners taking them. While many elite universities have developed MOOCs, their motivations have not been entirely clear. This qualitative case study research explores what three early adopter universities, Columbia University, Duke University, and Harvard University, hope to achieve by becoming involved and investing in MOOCs, how they are assessing progress toward goals, and what value proposition they seek as a return on their investment. The findings of this research suggest that the studied universities have several goals in common and a few that differ, and importantly, that several of their goals do not directly align with the public narrative around MOOCs in the press. In particular, while the goals of the studied universities do include expanded access to education, their goals may have even more to do with promoting teaching innovation and providing benefits for their residential education. None of the studied universities were focused on improvements to higher education completion challenges through pursuit of MOOC credit, or the use of MOOCs as a way to control higher education costs–both of which are major elements of the public dialogue on MOOCs. Other goals of the early adopters studied included providing more visibility for some of their educational programs and their faculty, and enabling more evidence-based education research. This study concludes that the value proposition for early adopter universities is the ability to simultaneously pursue the goal of improving on-campus teaching and learning while also promoting the university and its faculty and connecting through educational outreach with the public–all while showing leadership in an emerging higher education learning technology.

Kellogg, S. (2014). Patterns of Peer Interaction and Mechanisms Governing Social Network Structure in Three Massively Open Online Courses for Educators. North Carolina State University.

MOOCs, or Massively Open Online Courses, have gained extensive media attention for their vast enrollment numbers and the alliance of prestigious universities collectively offering free courses to learners worldwide. For many, MOOCs are filling the role of continuous education and ongoing professional development, serving to satisfy personal intellectual curiosity or enhance the workplace skills of post-graduates. A recent development in the MOOC space has been courses tailored to educators serving in K-12 settings. MOOCs, particularly as a form of educator professional development, face a number of challenges. Academics as well as pundits from traditional and new media have raised a number of concerns about MOOCs, including the lack of instructional and social supports. It is an assumption of this study that many of the challenges facing MOOCs can be addressed by leveraging the massive number of learners to develop robust online learning communities. Despite the potential benefits for educators, however, building and sustaining online learning communities has generally proved problematic. This study attempts address critical gaps in the literature and address issues of community engagement in MOOCs by examining factors that influence peer interaction among educators. Specifically, this quantitative case study is framed by the social network perspective and utilizes recent advancements in Social Network Analysis to describe the peer discussion networks that develop and model the mechanisms that govern their structure.

Moe, R. (2014). The evolution and impact of the massive open online course. ProQuest, UMI Dissertations Publishing.

An online learning phenomenon emanated 2½ years ago from three courses taught at Stanford University, promising an opportunity for high-quality instruction from elite institutions and professors for no cost to the student. This phenomenon, which came to be known as the MOOC, catalyzed sweeping changes in both higher education’s relationship with distance education, as well as the discussion of higher education in society, in a remarkably short period of time. While people have questioned the effectiveness of MOOC learning and the potential negative consequences of adopting MOOC systems either in support of or to replace existing educational infrastructure, the MOOC movement has continued to grow at a rapid pace. This research study sought to define the characteristics of the MOOC on the terms of learning theory, pedagogy, history, society and policy through the use of an expert-based Delphi study, where participants engaged in a phenomenological dialogue about what constitutes a MOOC in practice, the present state of higher education in the wake of the MOOC movement, the effect the phenomenon has had on education both structurally as well as socially, and visions of the future of the institution of higher education as affected by the MOOC. In summary, panelists focused their agreement on cognitive and pragmatic aspects of the MOOC debate, such as a hope for learning analytics to offer solutions to educational problems as well as the opportunity for the MOOC system to offer tier-based education services to consumers. The Delphi discussion showcased the importance of cognitive theory in MOOC design as well as the relationship between MOOCs and economics, and highlighted the difficulty education experts have in agreeing on how to define educational terminology.

Outland, J. C. (2014). Examining the Market Positioning of Massive Open Online Courses to Maximize Employer Acceptance. ProQuest, UMI Dissertations Publishing.

Massive Open Online Courses (MOOCs) are a new instructional method utilizing many delivery methods common to online academic courses that are being offered in greater frequency as learner interest has increased. Learners may be attending these courses due to a lack of cost and perception that completion of this training may offer some benefit to them as they seek employment. Unfortunately, due to both the relatively recent development of MOOCs and the corresponding variety in delivery and documentation methods, little research had been completed on the acceptability of this instructional method by potential employers. Without this information, learners would be completing training that has little applicable benefit to them as they seek positions or advancement. Additionally, institutions would be offering courses in formats that do not fully benefit students, resulting in a sub-optimal use of institutional resources. The purpose of this qualitative study was to examine the perceptions of U.S.-based employers on instruction using variations of the MOOC model, and to identify traits in this delivery method that make completion of this training advantageous to potential applicants. Human resources and hiring managers were interviewed to determine their preferences using a focus group model. The data collected indicates MOOCS are positively perceived by employers, but not optimally positioned due to a lack of understanding and documentation. Employer perceptions of MOOCs can be enhanced by the consideration and inclusion of industry required skillsets to ensure that learners are focused on employer desired abilities that allow them to meet minimum and preferred job requirements. Additionally, by providing accurate and detailed documentation of the contents of a MOOC, institutions can ensure that a course is readily measurable by employers. This documentation can take many forms, but credentials that detail the topics covered, time spent, and completion evaluation method are preferred. By adopting these identified key requirements of employers, institutions may be able to better position their MOOC offerings into categories that are more easily understood and evaluated during the hiring process. These changes would then enhance the perceived benefits of these classes, and generate additional advantages for job seekers who have completed these courses.

Schulze, A. S. (2014). Massive open online courses (MOOCs) and completion rates: are self-directed adult learners the most successful at MOOCs?. ProQuest, UMI Dissertations Publishing.

Millions of adults have registered for massive open online courses, known as MOOCs, yet little research exists on how effective MOOCs are at meeting the needs of these learners. Critics of MOOCs highlight that their completion rates can average fewer than 5% of those registered. Such low completion rates raise questions about the effectiveness of MOOCs and whether adults enrolling in them have the skills and abilities needed for success. MOOCs have the potential to be powerful change agents for universities and students, but it has previously been unknown whether these online courses serve more than just the most persistent, self-directed learners. This study explored the relationship between self-directed learning readiness and MOOC completion percents among adults taking a single Coursera MOOC. By examining self-directed learning – the ability to take responsibility for one’s own educational experiences – and MOOC completion rates, this research may assist in improving the quality of MOOCs. A statistically significant relationship was found between self-directed learning and MOOC completion percentages. Those stronger in self-directed learning tended to complete a greater percent of the MOOC examined. In addition, English speaking ability demonstrated a mediating effect between self-directed learning and MOOC completion. Learners indicating a strong ability in speaking English were more likely to be ready for self-directed learning and completed a higher percentage of the MOOC. Compared with those that did not complete MOOCs, however, few additional differences in demographics of adult learners that completed MOOCs were found. To better understand the skills and experiences needed to be successful in a MOOC, additional research on factors that influence MOOC completion is warranted. If only a minority of strongly self-directed learners can successfully complete MOOCs, then more resources should be invested into the design and development of MOOCs to meet the needs of many learners. If this does not occur, then MOOC completion rates could continue to suffer and new open education solutions of higher quality may appear, making MOOCs a short-lived phenomenon.

Stefanic, N. M. (2014). Creativity-Based Music Learning: Modeling the Process and Learning Outcomes in a Massive Open Online Course. ProQuest, UMI Dissertations Publishing.

While developing creativity is an important goal of many educational endeavors, creating music, from a music education perspective, is a powerful pedagogical tool. Beyond comparing the relative creativity of individuals’ musical creative products (e.g., melodies, songs, lyrics, beats, etc.), research in musical creativity must consider how engaging in the creative process can be an effective teaching tool, what I have termed creativity-based music learning. If music teachers are to develop students’ abilities “to experience music as meaningful, informed by sensitive discernments and broad understandings, in each particular musical role engagement in which one becomes involved” (Reimer, 2003, p.214), then we must gain a better understanding of how different aspects of the person and context interact during the creative process. Based on the available literature, Webster (1987a, 2002) conceived the Model of Creative Thinking in Music as a conceptual model for understanding the importance of various components that are at work in the musical creative process. Since, generally speaking, learning results from thinking of some sort, Webster’s model represents a reasonable starting point from which to examine how musical creative thinking leads to musical learning. There is much research in music education and the general creativity literature that has investigated how these various component parts (e.g., music aptitude, personality, motivation, previous experience, context) relate to creativity, but there has yet to be any substantive attempt to understand how all of these various elements simultaneously interrelate during a given musical creative process. More importantly, there is limited research on how creativity-based music learning contributes to important learning outcomes such as students’ perceptions of learning from the process, students’ self-evaluations of creative products (e.g., songs they have written), the development of conceptual understandings, and the development of musical creative self-efficacy. The initial primary purpose of this study was to develop and identify a statistical model that best represents the nature of the various interrelationships of components of the musical creative process, as identified in Webster’s (2002) model, and as they relate to learning outcomes. Understanding how all of these components relate and ultimately impact various learning outcomes has important implications for how we educate our music students. Data were collected from students taking a Massive Open Online Course entitled “What is Music?: Finding Your Song,” which was designed, developed, and taught by the researcher, and offered in January 2014 through the Canvas Network. In the course, the question “what is music?” was approached from several perspectives, including Music as Human Activity, Music as Emotion, Music as Physics, and Music as Form. While learning about each perspective, students were encouraged to engage with and complete various musical creative projects (e.g., creating a representative playlist, writing lyrics, writing a melody, writing a song). Such an educational context in which creativity is used as a pedagogical tool provided an opportunity for studying the educational outcomes of such an approach. Embedded within the course were measures of several predictors of learning (based on Webster’s model), including past experience in music, personality, music aptitude, contextual support, musical creative self-efficacy, motivation, and situational engagement. Initial analysis plans included the use of structural equation modeling to (1) compare and contrast the statistical fit of competing models; and (2) examine how each of these constructs not only relate to each other, but also how they each contribute (uniquely and in combination) to various learning outcomes, including perceptions of learning, self-evaluations of creative products, and musical creative self-efficacy. However, a sufficient number of students did not engage in and complete the creative projects, nor did a sufficient number of students complete all of the research items, in order to examine the full structural model. When it became apparent that sufficient data would not be available, the study was re-envisioned to examine questions about why students chose to participate or not participate in the creative music-making projects. Data were collected from 281 students, and although missing data was quite extreme for variables measured late in the course (e.g., motivation), large amounts of data were available regarding students’ past experience in music, their expectations regarding participation as MOOC learners, and demographic information (e.g., age, gender, education, language, geographic region). The available data were used in an exploratory manner to derive a model for predicting creative project participation in the course. The sole important predictor of project participation was whether students identified themselves as an “active participant” at the beginning of the course, although this variable explained only a small amount of variability in project participation. Follow-up analyses for group differences in Active Participant (individuals who identified themselves as “active participants” versus all other Types of Learners) found that “active participants” had significantly higher levels of Musical Creative Self-Efficacy, greater perceptions of the learning context as challenge-supportive, and higher scores on the Openness personality factor. Notably, students’ Past Experience in Music appeared to be unrelated to both whether they intended to participate in the creative music-making projects and whether they actually participated in the projects. In addition to the primary MOOC study, the development and initial validation procedures and results for two new research instruments utilized in the MOOC study, the Past Experience in Music Inventory (PEMI) and the Musical Creative Self-Efficacy Scale (MCSES), are described in detail. The latent class measurement model utilized for measuring Past Experience in Music is a unique and potentially valuable approach for measuring this important variable in music research of all kinds. Finally, an exploratory analysis of all zero-order rank-order intercorrelations of all non-nominal variables indicated some initial support for the General Specified Model of Creativity-Based Learning. It was not possible to take the next step with the model: to prune it, alter it, or reject it altogether, but when viewed as a very large-scale pilot study, this study did provide enough evidence to warrant investing the considerable amount of resources necessary to take that next step. Implications for creativity-based music learning and the significance of MOOCs and MOOC research are discussed. In particular, music MOOCs represent an opportunity to fill in some much needed space for lifelong learning. However, if we are to promote lifelong musical engagement, then the pedagogy within a MOOC should also promote engagement. As such, questions and further research regarding such engagement, especially within a creativity-based learning framework, are central to better understanding how to promote and facilitate lifelong musical engagement and musical learning.

Institutional MOOC reports. Are we missing any?

Posted on January 5th, by George Veletsianos in moocs, my research, open. 2 comments

As part of our ongoing investigation into learning experiences and practices with openness and open courses, we are gathering institutional reports describing MOOC initiatives and outcomes. So far, we were able to locate the reports listed below. Do you know of any we are missing? If so, could you please share your links with us by posting a comment below?

Firmin, R., Schiorring, E., Whitmer, J., & Sujitparapitaya, S. (2013). Preliminary Summary: SJSU +Augmented online learning environment pilot project. Retrieved from http://www.sjsu.edu/chemistry/People/Faculty/Collins_Research_Page/AOLE Report -September 10 2013 final.pdf

Harrison, L. (2013). Open UToronto MOOC Initiative: Report on First Year of Activity. http://www.ocw.utoronto.ca/open-utoronto-mooc-initiative/

Ho, A. D., Reich, J., Nesterko, S., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2013). HarvardX and MITx : The First Year of Open Online Courses.

University of London. (2013). Massive Open Online Course (MOOC) Report 2013. Retrieved from http://www.londoninternational.ac.uk/sites/default/files/documents/mooc_report-2013.pdf

MOOC STRATEGY ADVISORY COMMITTEE FALL 2013 INTERIM REPORT – University of Illiniois at Urbana-Champaign. (2013). Retrieved from http://mooc.illinois.edu/docs/MSAC-Interim-Report-2013-11-11.pdf

Ithaca S+R. (2013). Interim Report : A Collaborative Effort to Test MOOCs and Other Online Learning Platforms on Campuses of the University System of Maryland, (October). Retrieved from http://www.sr.ithaka.org/sites/default/files/reports/S-R_Moocs_InterimReport_20131024.pdf

University Edinburgh. (2013). MOOCs @ Edinburgh 2013 – Report # 1 (p. 42). Edinburgh. Retrieved from http://www.era.lib.ed.ac.uk/bitstream/1842/6683/1/Edinburgh MOOCs Report 2013 #1.pdf

CFP special issue: What is it like to learn and participate in MOOCs?

Posted on November 24th, by George Veletsianos in cfp, moocs, online learning, open, scholarship. 48 comments

Update #1: This special issue will include an “experiences from the trenches” section for individual learners to tell their own stories about their experiences with MOOCs. You can find the requirements for those papers here.

What is it like to learn and participate in MOOCs?

Special Issue – Call for papers 

Educational Media International

Scholarly Peer-Reviewed Journal published by Taylor & Francis

 

Overview

While during 2011-2012 the mass media were largely exuberant about MOOCs (Massive Open Online Courses), claiming that these courses will revolutionize and democratize access to education, in 2013-2014 anti-MOOC sentiment rose amidst concerns pertaining to completion rates, sustainable business models, and pedagogical effectiveness. Heated debates on the status quo and future of higher education have ensued since then, and even though there is “no shortage of prophecies about [MOOC’s] potential impact” (Breslow et al., 2013, pp. 23), the academic community has yet to develop an in-depth understanding of learner experiences in MOOCs. The aim of the special issue is to add to our understanding of learner experiences in MOOCs by providing answers to the question: What is it like to learn and participate in MOOCs?

Learner experiences arise from the ways learners interact with and respond to content, activities, instructional methods, instructors, and the context within which learning and instruction happen (Parrish, 2005). At a time when researchers and online learning providers are embracing the use of learning analytics and big data to examine learner behaviors, activities, and actions, very few researchers have sought to gain a deep, qualitative, and multidimensional understanding of learner experiences with open forms of learning. A nuanced appreciation of how users experience open learning, including the successes and obstacles they face, will assist learning designers, researchers, and providers in making greater sense of the open course phenomenon as well as enable them to improve open online learning.

This CFP arises has its foundations on a 2013 call in which Veletsianos argued that “we only have small pieces of an incomplete mosaic of students’ learning experiences with open online learning” (Veletsianos, 2013). While there’s been an expansive amount of research on MOOCs, the existing literature predominantly focuses on learner behaviors and practices, while investigations of learners’ lived experiences are largely absent (Adams et al., 2014). The availability of large-scale data sets also appears to have shaped the research questions that are being asked about MOOCs, and, while significant insights are developed via that research route, the field will benefit tremendously by gaining a better understanding and appreciation of learners’ experiences.

To address these issues and to support the development of the field, we invite authors to submit manuscripts investigating the learner experience in massive open online courses.  Manuscripts can be of three types:

  • Empirical. Such manuscripts should follow rigor guidelines appropriate for the research methods used.
  • Systematic reviews of the literature and literature meta-syntheses.
  • Theoretical manuscripts, contributing to the development of theory pertaining to learner experiences in open courses.

We are interested in hosting a forum for leading edge contributions to the nascent field that help us make sense of learner experiences, and allow practitioners and researchers to benefit from these contributions. Towards this aim, recommended topics of interest for this special issue include, but are not limited to, the following research questions:

  • What is it like to learn in massive open online courses?
  • What are learners’ experiences in open courses?
  • Why are learners participating in open courses in the ways that they do?
  • What are learner-learner and learner-instructor interactions like?
  • How do learners respond to various instructional design decisions and instructor roles?
  • How do learners perceive their relationships with each other, content, instructors, institutions, and MOOC providers?

Submission Process

Interested authors should submit 500-word abstracts and 200-word bios by December 19 at moocs@cardet.org. Submissions should include short descriptions of the following:

  • Identified gap/problem addressed
  • Methods or modes of inquiry
  • Data sources
  • (in-progress or final) results

Invitations to submit full papers will be send on or before January 9, 2014. Manuscripts should be formatted using APA style and should be 6,000 words, including references. The process to be followed thereafter is as follows:

  • March 1, 2015: Full-length papers due via email at moocs@cardet.org
  • May 1, 2015:  Notification of acceptance/rejections
  • June 30, 2015: Final papers with revisions due
  • 2015: Special issue is published

Special Issue Editors

Dr. George Veletsianos
Canada Research Chair in Innovative Learning and Technology
Associate Professor
Royal Roads University, Victoria, BC, Canada.

Dr. Vrasidas Charalambos
Executive Director, CARDET (www.cardet.org)
Associate Professor of Learning Innovations & Associate Dean for e-learning, University of Nicosia, Cyprus.

References

Adams, C., Yin, Y., Vargas Madriz, L.F., & Mullen, S. (2014). A phenomenology of learning large: The tutorial sphere of xMOOC video lectures. Distance Education, 35, 202-216.

Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom: Research into edX’s first MOOC. Research & Practice in Assessment, 8, 13-25.

Parrish, P. (2005). Embracing the aesthetics of instructional design. Educational Technology, 45(2), 16-25.

Veletsianos, G. (2013). Learner Experiences with MOOCs and Open Online Learning. Madison, WI: Hybrid Pedagogy Publications. Retrieved from http://learnerexperiences.hybridpedagogy.com.

 

 

MOOCs, automation, artificial intelligence seminar

I will be visiting my colleagues at the University of Edinburgh in mid-June to give a seminar on MOOCs, automation, artificial intelligence and pedagogical agents. This is a free event organized by the Moray House School of Education at the U of Edinburgh and supported by the Digital Cultures and Education research group and DigitalHSS. Please feel free to join us face-to-face or online (Date: 18 June 2014; Time: 1-3pm) by registering here.

This seminar will bring together some of my current and past research. A lot of my work in the past examined learners’ experiences with conversational and (semi)intelligent agents. In that research, we discovered that the experience of interacting with intelligent technologies was engrossing (pdf). Yet, learners often verbally abused the pedagogical agents (pdf). We also discovered that appearance (pdf) may be a significant mediating factor in learning. Importanly, this research indicated that “learners both humanized the agents and expected them to abide by social norms, but also identified the agents as programmed tools, resisting and rejecting their lifelike behaviors.”

A lot of my current work examines experiences with open online courses and online social networks, but what exactly does pedagogical agents and MOOCs have to do with each other? Ideas associated with Artificial Intelligence are present in both the emergence of xMOOCs (EdX, Udacity, and Coursera emanated from AI labs) and certain practices associated with them – e.g., see Balfour (2013) on automated essay scoring. Audrey Watters highlighted these issues in the past. While I haven’t yet seen discussions on the integration of lifelike characters and pedagogical agents in MOOCs, the use of lifelike robots for education and the role of the faculty member in MOOCs are areas of  debate and investigation in both the popular press and the scholarly literature.  The quest to automate instruction has a long history, and lives within the sociocultural context of particular time periods. For example, the Second World War found US soldiers and cilvilians unprepared for the war effort, and audiovisual devices were extensively used to efficiently train individuals at a massive scale. Nowadays, similar efforts at achieving scale and efficiencies reflect problems, issues, and cultural beliefs of our time.

I’m working on my presentation, but if you have any questions or thoughts to share, I’d love to hear them!

 

The Beautiful, Messy, Inspiring, and Harrowing World of Online Learning

Posted on May 1st, by George Veletsianos in my research, NPS, online learning, open, scholarship. 20 comments

BCNET is a not-for-profit, shared information technology services organization focusing on British Columbia’s higher education system. The organization aims to to explore and evaluate shared IT solutions and hosts an annual conference. I  delivered one of the keynote talks for this year’s conference, and shared examples and stories of online learning initiatives. I framed these examples in terms of research on online learning and the context of the historic realities of educational technology practice. These stories illustrate the multiple realities that exist in online education and highlight how emerging technologies and open practices have (a) broadened access to education, (b) reinforced privilege, and (c) re-imagined the ways that academics enact and share scholarship.  I am including my slides below.

The Beautiful, Messy, Inspiring, and Harrowing World of Online Learning from George Veletsianos

 

SXSWedu 2014 events

Posted on February 28th, by George Veletsianos in sharing. 12 comments

I’ll be at SXSWedu 2014, and I’m hoping that the event has matured a bit since last year’s “learning outcomes come second” suggestion. Austin is probably the best US city to host this event as the city itself is undergoing massive change.

I’ll be on two panels this year, and I’m really excited to participate in both. The first panel is one organized with my colleagues Tanya Joosten, Amy Collier, and Audrey Watters:

Startups Should Talk with Researchers and Educators
George Veletsianos (Royal Roads University)
Amy Collier (Stanford University)
Audrey Watters (Hack Education)
Tanya Joosten (University of Wisconsin – Milwaukee)

Educational technology startups seem to ignore the knowledge that educators and researchers have amassed that can help startups succeed. Last year’s SXSWedu event felt more like a vendor gathering than a space for “meaningful conversation.” If we want to change how we do education, these groups must converse. In this panel, we will discuss how educators/researchers can help startups improve products and answer questions pertaining to education research, how people learn, and classroom practice.

The second panel is a meetup organized by Coursetalk:

Karen Francis, Chairman and CEO of AcademixDirect, parent company to CourseTalk
Dr. Anant Agarwal, President, edX
Jason Palmer, Deputy Director, Bill and Melinda Gates Foundation
Dr. George Veletsianos, Canada Research Chair/Associate Professor, Royal Roads University
Stephanie Banchero, National Education Writer, The Wall Street Journal
Jane Swift, CEO, Middlebury Interactive Languages
Education, Training, and Professional Development technology innovations have disrupted the way we learn across the globe. Some are calling online education and MOOCs the pathway to solve the skills and knowledge gaps of today’s global workforce. Others are predicting these technology innovations are the road map to an influx of loss of jobs as more things become automated. Many are collaborating and developing models to improve student outcomes and to connect students with the resources needed to grow and succeed in a global and competitive job market.

On Noam Chomsky and technology’s neutrality

Posted on January 23rd, by George Veletsianos in E-learning, emerging technologies, my research, online learning, scholarship. 21 comments

In a recent interview, Noam Chomsky commented on the relationship between technology and education and one of his thoughts was the following:

As far as technology itself and education is concerned, technology is basically neutral. It’s like a hammer. The hammer doesn’t care whether you use it to build a house or whether on torture, using it to crush somebody’s skull, the hammer can do either.

Hammer – CC Photo by Birmingham Museum and Arts Gallery

I admire Noam Chomsky and his brilliance. I agree with this perspective, but this perspective does not paint the whole picture of what happens when we use technology in education. I’d like to unpack this just a little bit because there is a more accurate picture of technology use in education available to us. The broader picture I describe below helps us understand how technologies are used, why they succeed/fail, and how we can design better learning environments. From my observations of technology use in education, my research, my colleagues’ research, and my reading of the field’s research, here’s what I understand:

  • Technologies can be as neutral as described above. For example, Twitter can be used as a broadcasting medium, a conversational medium, or even a 1-1 support tool. YouTube can replace the VCR used in class. Or, it can bring together people from different locations to discuss topics of common interest. In this sense, technologies are neutral in that they can serve various needs and can be used in different ways.
  • Technologies themselves are rarely neutral. How can that be, you ask, when the bullet point above stated the opposite? Technology is not created in a vacuum. When technology is created, it is built with the developers’ worldviews, values, beliefs, and assumptions embedded into the technology and revealed through the activities supported and encouraged when individuals use the technology. For example, social networking sites (SNS) structure relationships in specific ways (e.g., followers, friends) and perceive privacy in different ways. Technologies hold particular views of the world, and in this way, they are not neutral. This is true for technologies that we repurpose for educational means (e.g., Twitter, YouTube, Ning, Elgg, Facebook, Flickr, and so on) as well as for technologies created specifically for educational purposes. For example, Learning Management Systems (LMS) espouse certain beliefs about the educational process and their default settings and suggestions may shape how they are used. Whn introduced in educational settings, said technologies tend to introduce tensions and conundrums (e.g., The way the LMS or SNS structured instructor-learner relationships vs. the way faculty envisioned instructor-learner relationships may be in conflict, leading to low uptake, rejection of the tool, etc).
  • Technologies can be put to different uses, but not all uses are productive or effective. A hammer doesn’t care whether you use it to “build a house… or crush somebody’s skull,” but it will do a poor job if you try to use it in lieu of a screwdriver. The problem arises when entrepreneurs, designers, instructors, etc treating the hammer as a tool that can help them address all needs. A recent example of this is Udacity treating its product as a solution in search of a problem.

The ways that technology is used on the ground are complex and negotiated. In preparing instructors to use technology in education and designers to envision ways that technology can support/enhance education, we need to expose them to skills and mindsets that allow them to use tools in creative and inspirational ways. We also need to help them understand the assumptions and beliefs that technologies espouse and remain cognizant of the pressures and tensions that these may introduce.

 

* References pertaining to technology being not-neutral:

Whitworth, A., & Benson, A. (2010). Learning, Design, and Emergence: Two case studies of Moodle in distance education. In G. Veletsianos (Ed.), Emerging Technologies in Distance Education (pp. 195-213). Edmonton, AB: Athabasca University Press.

Hall, R. (2011). Revealing the transformatory moment of learning technology: the place of critical social theory. Research in Learning Technology, 19(3), 273-284.

Lane, L. (2009). Insidious pedagogy: How course management systems impact teaching. First Monday, 14(10).

Crook, C. (2012). The “ digital native ” in context: tensions associated with importing Web 2.0 practices into the school setting. Oxford Review of Education, 38(1), 63-80.