Fecher and Friesike reviewed the literature relevant to open science and found that “open science is an umbrella term that encompasses a multitude of different assumptions about the future of knowledge creation and dissemination; an umbrella term however that comprises five more or less distinct schools of thought with different assumptions about what exact aspect of research should be ‘open’ and ‘open’ to whom.”
One of these schools of thought is the “public school” whose advocates appear to believe that “the social web and Web 2.0 technologies allow and urge scientists on the one hand to open up their research processes and on the other hand to prepare research products for interested non-experts.”
There’s a number of interesting results here, lending support to, and further defining, the following assumptions and themes of open scholarship we identified in Veletsianos & Kimmons (2012):
- Open scholarship has a strong ideological basis rooted in an ethical pursuit for democratization, fundamental human rights, equality, and justice
- Open scholarship emphasizes the importance of digital participation for enhanced scholarly outcomes
- Open scholarship is treated as an emergent scholarly phenomenon that is co-evolutionary with technological advancements in the larger culture
- Open scholarship is seen as a practical and effective means for achieving scholarly aims that are socially valuable
Veletsianos, G. & Kimmons, R. (2012). Assumptions and Challenges of Open Scholarship. The International Review Of Research In Open And Distance Learning,13(4), 166-189.
I will be visiting my colleagues at the University of Edinburgh in mid-June to give a seminar on MOOCs, automation, artificial intelligence and pedagogical agents. This is a free event organized by the Moray House School of Education at the U of Edinburgh and supported by the Digital Cultures and Education research group and DigitalHSS. Please feel free to join us face-to-face or online (Date: 18 June 2014; Time: 1-3pm) by registering here.
This seminar will bring together some of my current and past research. A lot of my work in the past examined learners’ experiences with conversational and (semi)intelligent agents. In that research, we discovered that the experience of interacting with intelligent technologies was engrossing (pdf). Yet, learners often verbally abused the pedagogical agents (pdf). We also discovered that appearance (pdf) may be a significant mediating factor in learning. Importanly, this research indicated that “learners both humanized the agents and expected them to abide by social norms, but also identified the agents as programmed tools, resisting and rejecting their lifelike behaviors.”
A lot of my current work examines experiences with open online courses and online social networks, but what exactly does pedagogical agents and MOOCs have to do with each other? Ideas associated with Artificial Intelligence are present in both the emergence of xMOOCs (EdX, Udacity, and Coursera emanated from AI labs) and certain practices associated with them – e.g., see Balfour (2013) on automated essay scoring. Audrey Watters highlighted these issues in the past. While I haven’t yet seen discussions on the integration of lifelike characters and pedagogical agents in MOOCs, the use of lifelike robots for education and the role of the faculty member in MOOCs are areas of debate and investigation in both the popular press and the scholarly literature. The quest to automate instruction has a long history, and lives within the sociocultural context of particular time periods. For example, the Second World War found US soldiers and cilvilians unprepared for the war effort, and audiovisual devices were extensively used to efficiently train individuals at a massive scale. Nowadays, similar efforts at achieving scale and efficiencies reflect problems, issues, and cultural beliefs of our time.
I’m working on my presentation, but if you have any questions or thoughts to share, I’d love to hear them!
Image courtesy of NetWork
In the Fall, I will be teaching an open course entitled Networked Scholars. We are having our first design meeting this week, and in preparation for that, I have written up a course description (see below). The course is my response to the fact that Research Methods courses in the social sciences rarely examine scholarly practices in the digital age. Digital, networked, and open scholarship are topics that students and academics discover and examine on their own. These topics are too important to ignore. I believe that we should be teaching them in research methods courses. I am creating this course to help introduce individuals to these topics and to create an open online resource to help those who want to integrate these topics into their research methods courses. If you are interested in integrating aspects of this course with your (on campus or online) research methods course, I’d love to talk to you!
In this course, we will examine the tools and practices associated with networked, open, and digital scholarship. In particular we will investigate the emergent practice of scholars’ use of social media and online social networks for sharing, critiquing, improving, furthering, and reflecting upon their scholarship. Recent reports indicate that social media are at an early stage of adoption in academia, even though mindful participation in digital spaces is a significant skill for today’s academic and knowledge worker.
Participants will study scholarly presence online. They will examine how particular tools and practices may enhance the impact and reach of scholarship, and will explore the challenges and tensions associated with emerging forms of scholarship. By gaining an understanding of modern forms of scholarship, participants will be better equipped to use digital technologies and networked practices in their own work.
This course will be of immediate relevance to doctoral students, academics, and knowledge workers. Faculty members who teach research methods courses and faculty development professionals may also find this course valuable.
June 4, 2014 update
Course hashtag: #scholar14
If you’d like to be informed about the start of course or if you’d like to give feedback on the content and design of the course, please fill in the short survey below (also found here).
MITx and HarvardX deserve huge congratulations for making data associated with a number of their MOOCs publicly available. Four months ago, I wrote that the “community would benefit from access to the data that HarvardX and MITx have, as other individuals/groups could run additional analyses. Granted, I imagine this might require quite a lot of effort, not least in the development of procedures for data sharing.” It seems that the researchers at MITx and HarvardX have tackled the issues involved to make the data available, and have developed thoughtful procedures to ensure de-identification. While some of the steps taken may limit analyses (e.g., the de-identification process document notes that “rows with 60 or more forum posts were deleted,” thus eliminating highly active users), this is a big step in the right direction and it should be celebrated.
Now… can we have some qualitative data? If any institutions are interested in making those available, I’d love talk to you, give you input, and work with you toward that goal.
One of the highlights of academia is working closely with students and seeing them grow, take on challenges, struggle, and create meaningful change in the world. This happens in classrooms, on the web, in design/development projects, in research endeavors, and so on. Kasey Ford, who was one of my advisees, recently completed her MA thesis examining #PhDChat, an online social network, and we have published a study out of that work in the Journal of Interactive Media in Education. I’m excited to share the abstract below:
#PhDChat is an online network of individuals that has its roots to a group of UK doctoral students who began using Twitter in 2010 to hold discussions. Since then, the network around #PhDchat has evolved and grown. In this study, we examine this network using a mixed methods analysis of the tweets that were labeled with the hashtag over a one-month period. Our goal is to understand the structure and characteristics of this network, to draw conclusions about who belongs to this network, and to explore what the network achieves for the users and as an entity of its own. We find that #PhDchat is a legitimate organizational structure situated around a core group of users that share resources, offer advice, and provide social and emotional support to each other. Core users are involved in other online networks related to higher education that use similar hashtags to congregate. #PhDchat demonstrates that (a) the network is in a continuous state of emergence and change, and (b) disparate users can come together with little central authority in order to create their own communal space.
Ford, K., Veletsianos, G., & Resta, P. (2014). The Structure and Characteristics of #PhDChat, an Emergent Online Social Network. Journal Of Interactive Media In Education, 18(1). Retrieved April 16, 2014, from http://www-jime.open.ac.uk/jime/article/view/2014-08
Below is a visualization of users mentioning #PhDChat, with users grouped into clusters. Users with frequent or exclusive ties, represented in this study as replies and mentions, are clustered together. Thus, each cluster represents users that are most closely associated to one another based on their frequency of interactions.
BCNET is a not-for-profit, shared information technology services organization focusing on British Columbia’s higher education system. The organization aims to to explore and evaluate shared IT solutions and hosts an annual conference. I delivered one of the keynote talks for this year’s conference, and shared examples and stories of online learning initiatives. I framed these examples in terms of research on online learning and the context of the historic realities of educational technology practice. These stories illustrate the multiple realities that exist in online education and highlight how emerging technologies and open practices have (a) broadened access to education, (b) reinforced privilege, and (c) re-imagined the ways that academics enact and share scholarship. I am including my slides below.
I gave a presentation at the annual Emerging Technologies for Online Learning conference last week focusing on aspects of networked participatory scholarship. I kept track of other sessions of interest here.
The concept of networked scholarship is expressed in different ways in the literature, ranging from digital scholarship to social scholarship to open scholarship. In my presentation, I discussed two themes that have arisen from my 3+ years of qualitative and ethnographic studies into the practices of higher education scholars.
Both of these themes help us make better sense of scholars’ digital participation and networked scholarship. They also help us better describe online scholarly networks and the lives and practices of digital scholars.
The first theme refers to the notion of scholars using networks to enact digital/open scholarship and circumvent restrictions to the sharing of knowledge. I have a recent publication on this that you can read here.
The second theme is one that I am still developing. Specifically, in my research I found that social media and online social networks function as places where some academics express and experience care. While debates about the use of digital scholarship and social media use in education have so far largely focused on the professional experiences of scholars, with frequent suggestions to limit personal sharing, professional and personal identity are difficult to separate, and academics frequently collapse the boundaries between personal and professional sharing. Academics demonstrate vulnerability and express care online in many forms. In my presentation, I showed and discussed examples of what these very personal and intimate instances of sharing look like. A version of my slides appear below:
Below are my notes from the AERA 2014 session Rigor and Realism: Doing Educational Science in the Real World. The ideas are significant for learning technologies researchers focused on impacting practice and developing real-world innovations/interventions. While I share many of these values and discussed a number of them in past work (e.g, here and here), what appears below are Catherine Snow’s ideas.
Rigor and Realism: Doing Educational Science in the Real World
The Wallace Foundation Distinguished Lecture: Catherine Snow, Henry Lee Shattuck Professor of Education, Harvard University
Some educational researchers are adopting new models for doing educational research, models that start from problems of practice, prioritize the challenge of utility to educators, and presuppose partnership relationships between researchers and practitioners. In attempting to implement such approaches, we often find that attention to the conditions of real-world practice may compete with attention to the constraints of rigorous design. That familiar problem can be exacerbated by the conflicting epistemologies of real-world decision-making vs. rigorous scientific knowledge-building. This conflict, in its multiple forms only some of which will be discussed, is a dilemma rather than a problem; it demands careful consideration of approaches to balancing the desirable features of rigor and of realism when they conflict.
Notes from the presentation and twitter feed
A conflict exists between rigorous research and the demands of educational systems. Educators and researcher must work together as partners.
Researchers have to acknowledge the realities of practice.
Researchers should start with urgent problems of practice – not simply gaps that exist in the literature
Education research/science can be highly rigorous, but it needs to be relevant. If it’s not impacting students in schools, it doesn’t matter. Focus of ed research is often quality, but we have to make the case for utility. It should be about utility and relevance.
Education research should move from questions of “whether” to questions of “how” ( GV side note: especially relevant to learning technologies, as noted by past research – e.g., don’t ask whether online learning works, but ask how does it work, how do we make it better, under what conditions, for whom, etc).
Recruiting the next generation of scholars into this work may endanger their potential to publish and get grants
We need to modify practitioner preparation to provide guidance about the challenges of collaboration with researchers (e.g., teach value/limitations of research)
Numerous colleagues are invested in this model (e.g., WT Grant, iterative design work, design-based implementation)
Progress is slow. Are there really exciting initiatives that would make a huge difference that might change both edu research and practice?
- Build the partnership model into the preparation of doctoral students by institutionalizing and acknowledging relationships and acknowledging relationships. Schools of education need to embrace this approach and faculty members need to be supported even if it doesn’t have immediate payoff in journal articles. A way for schools of education to become relevant and keeping us from the constant danger of becoming second rate departments of Arts and Sciences rather than 1st grade institutions of social change
- Promote accountability by developing reliable and feasible measures of classroom practice that might eventually take the place of student outcome measures
- Take the wisdom of practice seriously and develop a mechanism for systematizing and curating it. Journal review process is elegant and effective in maintaining standards for a certain kind of knowledge, but why do we dismiss anecdotes that teachers tell us? Because there is no epistemological structure for evaluating and curating that knowledge. What does that structure look like? Even though practitioners generate knowledge, it disappears. Developing a mechanism to capture and curate knowledge would be a hugely powerful mechanism. We acknowledge wisdom of practice but don’t take it seriously. We need to raise the level of the wisdom of practice to a more respectable level, by making it indeed more respectable. Urgent agenda because of internet sharing of uncurated practices. There currently isn’t a way to curate teacher knowledge ( GV side note: Curation of internet resources is prevalent, and a number of individuals are arguing for a system of publish then filter – lots of connections to openness, digital participation, and digital/media literacies re: curation)
As a field we need an exciting agenda of research that is cumulative, rigorous and realistic