Some cool stuff from the VR Book

This article was first published by the Australian Association for Research in Education (29 June, 2020). I’m sharing it here because it highlights some interesting findings from the book.

Virtual Reality in school education: Australia leads the way with groundbreaking research

By Erica Southgate

In 2016, I attended a meeting and fortuitously sat next to the (now retired) principal of Callaghan College who asked me what type of research I’d like to do in schools. At the time a new high-end, highly immersive type of virtual reality (VR) hardware called the Oculus Rift had been released. This type of VR equipment was costly and needed an expensive computer to run but offered entry into amazing worlds. It provided high fidelity environments to be explored through gestural interaction via controllers that allowed you to use your virtual hands to interact with virtual objects and avatars (either other people or computer characters) and navigate in ways that felt incredibly embodied (I am addicted to flying and jumping off clouds in VR).

 I made a gentle pitch that I’d like to work with teachers to embed this technology into classrooms to see how it could be used for learning but that I had no idea what we might find. And so began the VR School Study, a collaboration with Callaghan College and later, Dungog High School, both government high schools in NSW, Australia.  It became the first research internationally to embed high-end VR in school classrooms.

VR School Study

The VR School Study is ongoing participatory research that aims to explore the use of immersive virtual reality in real classrooms. We focus on how VR can be used to enhance learning, its relationship to curriculum, and its implications for pedagogy. And we examine all the practical, ethical and safety issues that come with integrating emerging technology in classrooms. At the end 2018, the study reached a major milestone with the completion of two major case studies into the use of the technology in secondary schools.

An ‘arduous’ adventure in emerging technology

IN 2018, on the last day of research at Callaghan College, I interviewed two teachers about what it was like to embed an emerging technology in the classroom. The response was, ‘Arduous comes to mind.’ While we did have a laugh, the comment summed up a range of issues encountered during the research.

Space to accommodate VR and safety concerns

Trying to find an available classroom space large enough to accommodate the play areas needed for this VR, which is best used standing and moving around, proved difficult. On one campus we managed to get a room with a small storeroom off it that squeezed in three sets of VR equipment with play areas while at the other we had a larger former lab-preparation room attached to a classroom. Both VR rooms were beyond the immediate supervisory gaze of the teacher and so required me or a student to act as a safety ‘spotter’ to ensure there were no collisions with walls, furniture or peers. Even though there is a built in ‘Guardian System’ (a pop-up virtual cage mapped to the real environment you should stay within), some students became so immersed that they ignored it and needed intervention. Even now with ‘pass through’ cameras in some VR headsets (these allow the user to see the outside environment when they go beyond the Guardian System) some people become so immersed and are interacting with such speed that they can run into objects. Engineered safety solutions are not always enough to maintain safety.

Network and server issues

Getting the tech to work within the confines of the school internet network proved difficult. Game stores that allow multiplayer environments were blocked and internet work-arounds required. Teachers had to set-up individual student accounts which was time-consuming and often update applications in their own time. Our screen capture video, which showed a first-person view of what the student was seeing and doing in a virtual environment, indicated that the technology failed 15% of the time due to network, server and VR tracking drop-out. One of my favourite moments in student humour and resilience was when I heard one boy say to another as they who were fixing a server issue for the third time, “Aren’t you glad you signed up for this?”.

Content mastery and creativity through collaboration

Students were given the highest quality VR and ‘sandbox’ applications, such as Minecraft VR and Tilt Brush which allowed them to create in virtual environments without needing to code. Combined with clever curriculum design they undertook self-directed formative assessment tasks.

In Year 9 science this involved groups researching and developing a model of a body organ in Minecraft VR. The results were an astounding mix of scientific knowledge melded with creative endeavour developed through group problem-solving and collaboration inside and outside of VR.

Brain from up high

One group produced an anatomically correct, labelled eyeball which was toured by via a rollercoaster while another built a skyscraper of a brain sitting atop a spinal cord which you flew up to interact with engineered components representing neurons. While in VR, students narrated from memory the parts and function of the brain. Analysis of the screen capture video using a framework adapted from  work by Assistant Professor in Learning and Learning Processes the University of Oulu, Jonna Malmberg, indicated that the majority of students used the creative properties of VR to engage in highly collaborative science learning.

Inside the brain

At Dungog High School a senior drama class used single-player 3-D sculpting program Tilt Brush, as an infinite virtual design studio to explore symbolism in set design at real life scale and beyond. Students worked in groups to quickly prototype symbolic elements of their directorial vision with peers and the teacher moving in and out of VR to offer feedback. Mistakes were erased or changes made at the press of a button. The virtual studio of Tilt Brush melded with the drama studio to offer students an opportunity to view their design in 3D from the perspective of an audience member, director, designer or actor. All they needed to do was teleport round the virtual environment to do this.

Let’s leave behind the EdTech evangelism

An admission – I’m not a fan of the type of innovation discourse which permeates university managerial-speak and is associated with EdTech (educational technology) evangelism. This type of talk conjures up images of momentous leaps in ways of doing and knowing with the trope of the lone (male, yes it is a gendered) genius leading the charge with their vision of the future.

Innovation is incorrectly depicted as a development shortcut detached from contexts and the years of work that yield incremental improvements and insights, as Stanford University Director, Christian Seelos, and colleague Johanna Mair, argue. They warn against evaluating innovation only on positive outcomes as this can stifle experimentation required to progress an initiative in difficult or unpredictable environments.

This aligns with critical studies in EdTech where research is on the ‘state-of-the-actual’ rather than the ‘state-of-the-art’, as Distinguished Research Professor in the Faculty of Education, Monash University, Neil Selwyn reminds us. It entails moving away from trying to ‘prove’ a technology works for learning to scrutinizing what actually takes place especially in contexts that are not the ‘model’ well-resourced schools where technologies are often tested.

Teleporting away for now

As I have argued elsewhere, to get the best ethical and educational outcomes with emerging technologies we must carefully incubate these in schools (and not just resource-rich ones) in collaboration with willing teachers so that we can document incremental ‘innovation’ through ‘state-of-the-actual’ reporting. This can be an arduous project but one full of authentic and valuable insights for those willing to go on a research and pedagogical adventure. It’s this type of evidence, not EdTech evangelism, that we need.

For those who want more. In May 2020, I published findings from the study in Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms (Routledge). As co-researchers, teachers from Callaghan College and Dungog High School contributed to their respective chapters in this book. The book offers new pedagogical frameworks for understanding how to best use the properties of VR for deeper learning as well as a ‘state-of-the-actual’ account of the ethical, practical and technical aspects of using VR in low-income school communities.

Erica Southgate (PhD) is Associate Professor of Emerging Technologies for Education at the University of Newcastle, Australia. She is lead author of the recent Australian Government commissioned report, Artificial intelligence and emerging technologies (virtual, augmented and mixed reality) in schools research report, and a maker of computer games for literacy learning. Erica is always looking for brave teachers to collaborate with on research and can be contacted at Erica.southgate@newcastle.edu.au. Erica is on Twitter@EricaSouthgate

This article was originally published on EduResearch Matters. Read the original article.AARE

NEW book from the VR School Study

Out of three years of co-research with teachers comes the first book (of many I hope) from the VR School Study. The book, Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms (2020 Routledge) provides a brand new pedagogical framework with scaffolds for educators on how to use the technology for deeper learning. Case studies from Callaghan College and Dungog High School are included with a focus on metacognition, collaboration and creativity.

Blog SS

Virtual Reality for Deeper Learning

How can we expand our understanding of learning in/through virtual reality in ways that move beyond training scenarios or simple ‘facts and figures’ knowledge acquisition?

In our latest paper we take a deep dive into how VR can help students develop elusive 21st century thinking skills. We apply the Deeper Learning framework and the Revised Bloom’s Taxonomy (featured image above) to explore student collaborative and higher order thinking.

 

Q & A on teaching drama through VR

In our previous post we introduced a project at Dungog High School where they are using the 3D drawing program Tilt Brush in drama class. In this post, Head Teacher Louise Rowley responds to 4 key questions on her learning journey and how to use VR in drama in a curriculum-aligned way.

What is the VR project about?

The Year 11 students were creating a Director’s Folio for a contemporary Australian play called Ruby Moon. They traditionally have to create a director’s vision and explore this in their set box and costume designs. [Syllabus outcome P1.4: understands, manages and manipulates theatrical elements and elements of production, using them perceptively and creatively.] For this project, we included the VR and the program Tilt Brush for them to explore and create an audience experience of their Director’s vision. This really led to more engagement with the atmosphere and audience experience. [Drama Stage 6 Syllabus outcome P2.1: understands the dynamics of actor-audience relationship.]

They were working in groups to create their designs and needed to understand, manage and manipulate theatrical elements and elements of production. They were charged with the task of using them perceptively and creatively and this was taken to a new level of creativity in the VR space. We had been inspired by the National Theatre in the UK who created an immersive experience for their audience based on their director’s vision. This takes the audience to a completely new place and extended the idea of theatre as an immersive art form. [Syllabus outcome P1.4: understands, manages and manipulates theatrical elements and elements of production, using them perceptively and creatively.] The process of taking their Director’s vision into the VR space allowed them to think more about the audience’s experience and really immerse themselves in the director’s role. It allowed them to demonstrate their directorial vision in the immersive virtual world as well as in the physical world. [Syllabus outcomes P2.2: understands the contributions to a production of the playwright, director, dramaturg, designers, front-of-house staff, technical staff and producers; P2.3: demonstrates directorial and acting skills to communicate meaning through dramatic action.]

The project also aligns with key competencies in Drama with students collecting, analysing, organising information, and communicating ideas and information in new and creative ways their Director’s folio and in the VR space. Students were also planning and organising activities and working with others and in teams. The level of collaboration, which developed throughout the project, was a key achievement. Students were discussing ideas like Directors and helping each other to master the new software. They had no experience with the technology before they started and were able to unleash their creativity and I saw students who were less confident really growing in their confidence and ability to take a role in the group.

Using the VR deeply engaged the students in their learning. The project involved enquiry, research, analysis, experimentation and reflection contributing to the development of the key competency solving problems. Students had the opportunity to develop the key competency using technology in the study of new approaches to Drama and Theatre and dramatic forms. VR is a completely new technology and we are already exploring more ideas on how to link more programs together within the Tilt Brush software.

Why use this technology?

In the design process there is a lot of experimentation and collaboration required. Tilt brush has endless features that allow this to occur. Sketches could be saved, videoed, gifs made and photographed, and this process of documenting their ideas helped the students reflect on their ideas more. The quality of their ideas developed further. The Tilt Brush program was an endless space, which incorporated many amazing creative features. Designs could be instantly erased and then re-created quickly. It was not messy and did not waste materials. It had many resources that we do not usually have in the Drama room. Endless colours and brushes, backgrounds, models to be imported and guides to draw around. Sketches could be made smaller or bigger in an instant. It allowed all students to be equal. Once in the technology they were able to each contribute in a very really and tangible way to the group idea. It also allowed our rural students to have access to quality programs, which can sometimes not be available to them because of location.

Student 2

What is the biggest learning curve?

We had to learn how to use the technology and how to program the classwork to make sure other tasks were being completed at the same time. This was fairly painless and the students were great. As the teacher, I had to take a risk with new technology and not be frightened of not knowing absolutely everything about the software. After a while, the students were teaching each other and me.

What advice would you give to teachers?

Just do it! It isn’t scary and you don’t have to know everything. I have given advice to others in my school about trying new technology. There is so much to learn is can be quite overwhelming but is can be a lot of fun. I am now helping other teachers try a few new technologies. So the effect has been good.

 

Feature Image: Head Teacher Louise Rowley experimenting in Tilt Brush

Picture in text: Students discussing virtual set design features.

The joy of high school science through virtual reality

The VR School Study has been a two year journey in school-university collaboration. Throughout this time there have been many moments of frustration but also of an excitement that can only be sparked by collective intellectual endeavour. Among students there has also been frustration when the technology fails but these times are in contrast to what can only be be described as moments of pure learning joy.

Sadly, joy is not something that is spoken about enough in relation to schooling, and especially in regard to high school science classes. The joy of discovery is, of course, a central feature of the discipline of science, especially after the trials and tribulations of long periods of hard thought and experimentation. This quote from a lecture published in the journal Science back in 1936 captures the delight of scientific inquiry:

“While it is true that scientific men (sic) must make an impersonal study of the laws of Nature, there is ample evidence from historical records of the joy they have felt on achieving their goal. Newton, it was said, was so agitated when his work on the law of gravitation approached completion that he had to beg a friend to complete his calculation. …Harvey (the first to describe how the heart pumps blood around the body) said that ‘the pains of discovery are amply compensated by the joys of discovery.’ …The joy of the creative intellect, whether in art, literature or science, is one of the most exalted human emotions.”

How often do students experience the joy of scientific inquiry in high school science classrooms? This is a question worth asking because learning through discovery should be serious fun. How have technologies, across the ages, been instrumental in producing feelings of curiosity, wonder, excitement and that ‘exalted’ human emotion, joy? These emotions are intrinsic to the ‘creative intellect’ and they lay at the very heart of ideas in broader educational discourses about student engagement, school climate and motivation for learning.

During the VR School Study there have been moments of pure joy. As part of a unit of work in science, Year 9 students (14-15 years old) were asked to research an organ of the body, model and label it in desktop PC Minecraft Win 10 or Pocket Edition on mobile devices, and then import it into Win 10 Minecraft VR run on networked Oculus Rifts. There, they continued collaboratively building and refining the model in preparation for presenting what they had learnt about that body part to an audience.

Some examples of the pure joy of learning stand out. For instance, the first time a group of girls imported the levitating eyeball they had built in desktop computer Minecraft into Minecraft VR, there were squeals of excitement, raucous laughter, and a rapid flow of ideas about how to refine the model. They flew under and around the eyeball which was as large as a house and then into its interior via the eye’s lens. When they met inside the eye, and started lighting it up with torches, the amazement of the experience was palpable. A screenshot of the eyeball is below and the scale of it is discernible by the box on the ground which represents 1m x 1m. The square gap on the top of the eyeball was  used by the girls who would fly high and then dive into it.

floating eye from above2

A group of boys had built an eyeball with an optical nerve attached to it which the player could run through until they reached the internal part of the eye. They then began to make a rollercoaster for others to tour the eye with plans for it to extend through the optical nerve. The sheer fun of running up and through a nerve while discussing the function of it was wonderful to observe.

One group of girls had built an artery and they had labelled the various layers of the artery wall after researching the correct biological terms. As they refined their model in VR, the girls excitedly discussed how they would take peers on a tour of it, travelling through the artery ‘like a platelet in the bloodstream.’ Below is a screenshot of a side view of the artery with a pig in front of it and below this is a screenshot of a cross-sectional view of the artery with the key identifying its part.

Artery from side

Artery with legend

A group of boys took great care in building a spinal column with nerve endings, spinal fluid (or spinal juice as one fellow called it) attached to a detailed brain in cross-section. In VR, the structure was as high as a skyscraper and flying up and around it as they commentated on what work was still required was an astounding experience. They had provided, at ground level, an informative key to parts of the model. To hear students talk authoritatively and with great energy about how they went about selecting materials to try to accurately reflect the biological components of the spine, nerves and brain, while simultaneously working to improve the representation, provided a glimpse into the power of virtual reality for learning. Below is a screenshot looking up at the spinal cord with nerves and the brain; the floating white cubes are lanterns to illuminate it at night, although one boy did remark they might be thought of as electrical impulses emitting from the brain.  The feature image for this blog post is a screenshot looking down at the brain at night.

Brain looking up

While the study is not all smooth sailing, with the technological hitches demotivating some students, it has yielded insights into how collaborative inquiry using immersive VR can promote deep, authentic learning. The discovery component is twofold. Firstly there is a visceral discovery in how much more wondrous 3D models and cross-sections can look and feel in a truly immersive environment; the uniquely embodied and affective qualities of an experience that it is all around you compared with looking at or generating something on a computer screen. Secondly, there is discovery in researching and applying what is often fairly dry theoretical scientific knowledge in a process of collective creative intellect stemming from collaborative experimentation with the learning affordances of VR such as manipulation of size or unique navigation techniques (flying or diving).

The study provides a tantalizing glimpse into the (near) future of immersive education.

 

Keeping it real – A/Prof Erica Southgate (who is still recovering from flying around that skyscraper of a brain!)

 

Immersive VR: A literature review and infographic for teachers

I was recently commissioned to write a literature review on immersive virtual reality for teachers by the New South Wales Department of Education. The Department kindly distilled the literature review into an infographic to guide teacher practice

The report is: ‘Immersive virtual reality, children and school education: A literature review for teachers.’

I welcome dialogue on the literature review from teachers, researchers and developers – A/Prof Erica Southgate

An update from the VR School Study

As we move into Phase 2 of the VR School Study, the team thought that we would give you a quick video update on what we have learnt so far and what we hope to achieve over the next few months. Here is Associate Professor Erica Southgate with the low down!

And how cool is the featured picture (top). It is a student work sample from Phase 1 of the study. On the left is a bluebell that the student created in Minecraft VR and on the right is how he labelled the cross-section of the flower by drawing on his research on the different parts and functions of a plant.  He took Erica on an amazing guided tour of his creation where they both flew around the flower (like bees) while he explained the meaning of the labelled cross-section to her. It was a thoroughly researched scientific experience and great fun to boot!

A new research article from the VR School Study

This is the second article we have published from phase 1 of the VR School Study. This article reviews the literature on immersive virtual reality and children, and examines ethics and safety, technical issues, and the role of play when learning in highly immersive virtual reality.  It is co-authored with teachers from Callaghan College, Newcastle, Australia.

To cite this article in APA:

Southgate, E., Buchanan, R., Cividino, C., Saxby, S., Eather, G., Smith, S.P., Bergin, C., Kilham., Summerville, D. & Scevak, J. (2018). What teachers should know about highly immersive virtual reality: Insights from the VR School Study. Scan37(4). Retrieved https://education.nsw.gov.au/teaching-and-learning/professional-learning/scan/past-issues/vol-37/research-highly-immersive-virtual-reality

Students speak out about using immersive VR for learning

What do high school students say about using immersive virtual reality (VR) for learning? Student reflections from the VR School Project provide unique insights into the educational potential and problems of using immersive VR in real classrooms.

‘VR is really cool because different types of learners are able to effectively absorb the information they need to be taught. It’s also fun, and has a reputation for being fun.’

Fifty four students aged 13-15 years participated in phase 1 of the research. As the quote above indicates, the majority students were excited to be given the opportunity to use Minecraft with the Oculus Rift to do their science or ICT lessons. Some talked about the experience as being ‘FUN, FUN, FUN’, saying they ‘would recommend it to anyone.’

Other students thought that immersive VR had the potential to transform learning in the classroom:

‘I personally think learning with Virtual Reality will change students perspective of learning in a majorly good way as it gives the student a whole new way to learn and interact with the stuff they are learning.’

Some were more equivocal, observing that ‘Although it (VR) removes distractions, it also adds them’ and it ‘was easier to get distracted by VR (version of Minecraft) than computer (version)’. The distraction factor may be a result of the novelty of the experience, however it is worth investigating further how the intensity of the experience — the sense of presence and freedom of agency (autonomy of navigation, manipulation and creativity) which Minecraft VR allows — may interfere with on-task behaviour.

A few students also mentioned cybersickness as a ‘negative’:

‘Our virtual reality tasks are entertaining and more engaging than any other normal science class, although while engaging in this task I have motion sickness which causes me to finish earlier than I normally would. There aren’t really any downsides apart from motion sickness.’

The student perspective from Phase 1 of the VR School project has yielded several ‘leads’ to be explored during phase 2 of the study which will be conducted in the first half of 2018. Harnessing student enthusiasm for immersive VR for increased on-task learning is vital if the technology is to enhance education.

Furthermore, as part of the project we screened for potential susceptibility to cybersickness and educated students about the condition, actively checking on their well-being while they were in VR. Students themselves exhibited good awareness of cybersickness and appeared to monitor how they were feeling during the VR experience, with most opting to get out at the first signs of discomfort. While there were a very few cases of cybersickness witnessed by the team, we will more closely examine the phenomenon from the student perspective during phase 2 of the project.

 

Associate Professor Erica Southgate on behalf of the awesomeness which is VR School team.

 

Photo: m.i.m.i ‘Shout!’ https://flic.kr/p/aCcip5

Blog at WordPress.com.

Up ↑