Teachers reflect on 360° VR for language learning

This post reports on Athelstone School teachers’ views on using VRTY, a 360° content creation platform, for learning Italian with primary (elementary) school students. To catch-up on the research go here and here.

Language teachers Jo Romeo and Angelica Cardone provided extensive reflections in video and written form throughout the study. They noted that most students were engaged in the learning task of creating their virtual tour of Italy and incorporate the mandated Italian directional language and greetings. Teachers were particularly pleased to see less technologically confident students gain skills by collaborating with their peers either in pairs to create one virtual world or through peer-to-peer interaction more generally.

Teacher written reflections suggested that throughout the unit of work students were developing the Deeper Learning capacities of effective communication and problem solving through self-directed learning and an academic mindset featuring persistence when confronted with a range of difficulties:

“(The project) has enabled aspects of learning as they (students) have designed and created their own (virtual) worlds without too much teacher input. They have explored the platform on their own and used it to showcase their language and IT skills. Students did their own research on well-known landmarks as well as using their prior knowledge to include in their VR worlds. This has enabled them to learn factual historical information about different Italian landmarks and has also improved their vocabulary on directional language.… Students enjoyed recording their voices for the sound markers (that were embedded in the 360° scenes) and some students also researched how to pronounce particular words. They became independent workers as most of the time they problem solved on their own trying different strategies to see if they worked or didn’t. This displayed determination and commitment to successfully complete their (virtual worlds).”

Throughout the research, teachers learnt about the potential of immersive storytelling for language learning and students learnt about this too, guided by a mix of instructional strategies and creative processes. Instructional strategies included explicit teaching, scaffolding of student independent research and student production of different types of interactive media in Italian and English to be embedded in the scenes of their virtual Italian tour. After students had created several interconnected 360° scenes, teachers encouraged them to make audio files of themselves (sometimes with peers) orally using the directional language central to the curriculum. These voice recordings were then embedded in appropriate places in 360° scenes along with other media students had sourced or created such as photo and text information pop-ups providing historical or cultural facts related to the scene.

Students exhibited joy when experiencing their 360° creations through a VR headset, as the teachers explain:

“Most students reacted (to the immersive experience) with expressions such as ‘This is amazing’, ‘This is so cool!’. They were actually able to experience firsthand by being engaged in their virtual world. … (T)hey were able to interact more with the world they created using the headsets because for them it felt like they were in Italy and experiencing the tour around Italy rather than just seeing it on the screen.”

“The students were excited and eager to view their worlds in VR using the headsets. It was fantastic to see their enthusiasm and wonder at being able to view what they had created on a screen using the VRTY platform into what felt like ‘real life’.”

Longitudinal, deep teacher reflection is a key source of data for the VR School Study. Teacher reflections over time provide important insights in to growth in teacher professional learning, student learning and the success of different pedagogical strategies and curriculum planning approaches when using VR real classrooms.

Cover picture: Our last real-life team selfie before the Covid pandemic hit – Front: A/Prof Erica Southgate; Rear (Left to Right): Athelstone School language teachers Angelica Cardone and Jo Romeo, and Principal (and language teacher) Gyllian Godfrey. The study was funded through the South Australian Department for Education Innovative Language Program Grant.

State of eXtended Reality (XR) and Learning Report

The inaugural Immersive Learning Research Network ‘State of XR & Immersive Learning Outlook Report’ has recently been released. eXtended Reality (XR) is an umbrella term for virtual, augmented and mixed reality technologies and immersive learning is a concept used to cover education via these technologies. Associate Professor Erica Southgate, Lead Researcher on the VR School Study, was one of a hundred international experts consulted as part of the report. She is quoted several times on the pedagogical and ethical implications of using VR in schools. This free report is a must read for educators everywhere and can be downloaded here – https://immersivelrn.org/stateofxr_2021/

An interview about the VR School Study

The VR School Study has featured in an interview published by the Independent Schools Association of NSW (AISNSW). The interview covers areas such as leveraging the learning affordances of VR to develop deeper understanding, problem-solving and creativity with students. You can read the interview here.

Training children in 360° content creation

An essential part of scaffolding digital learning when using emerging technology in schools is the provision of developmentally appropriate training on using platforms to meet learning objectives. While there is a lot of talk about generations Y and Z being digital natives, there is great variability in the capability of children and young people in using digital tools for learning, especially when it is comes to creating rather than consuming products.

Throughout the Athelstone School project we have thought carefully about training and supporting primary school aged students (11 – 12years) in using the 360° VRTY platform or content creation.  In 2019 we did a pilot study using VRTY with Year 5 students which helped us hone the training approach. In this phase of the study student training was conducted via teleconference and lasted 40 minutes. VRTY personnel delivered the training, while the teachers and researcher were on hand to assist. This initial training involved a general introduction to using the platform to create virtual worlds in screen mode. We used a ‘sticky note’ exercise to evaluate the training where students writing down their comments on a post-it note about the training so that we could gauge the class’s training experience. This exercise revealed most students enjoyed the training but that some found it challenging as the examples below show.

Some student feedback from the first training exercise.

In 2020, we expanded the training and support approach to include an additional teleconference session on how to save and share virtual content with others in screen and immersive modes. VRTY designed a special handbook for students on this step-by-step process. This handbook was printed out and put on each desk for easy referral. This supplemented to in-platform tutorials and information, providing an option for students who might prefer more conventional reference material to support learning. This in-class training was undertaken via conference which we already had practice with before the necessity of conducting such sessions due to COVID restrictions.

Training in action from the student perspective.

One of the learning objectives for the unit of work was that students could use the on-desk training handbook effectively for assistance to trouble-shoot issues as they arose. The evaluation indicated that all students met this learning objective.

Our experience shows that primary school students may need different training and resource approaches to build confidence and scaffolding them towards competence in using 360° content creation tools. The training response included provision of in-platform instructions and tutorials with a back-up paper-based manual available on student desks. Once confidence was developed, students played and learnt through this process too. Multi-pronged training approaches coupled with practice and play makes perfect.

Training in progress 21st century style.

This post bought to you by A/Prof Erica Southgate, the VRTY team Kingston Lee-Young and Sarah Lee and the teachers of Athelstone School.

‘Persi in Citta’ unit of work for the Athelstone School VR project

Developing units of work that allow for student VR content creation involves: (a) sequencing and scaffolding learning for curriculum-mandated content and skill acquisition; and, (b) allowing time for students to develop new technology expertise via problem-solving, creative experimentation and collaboration.

In the Athelstone School VR project, primary (elementary) school students use the 360° VRTY platform to create a travel journey that demonstrates Italian language acquisition and knowledge of Italian culture. The learning objectives derive directly from the Australian Curriculum.

Below is the unit of work ‘Persi in Citta’ (Lost in the City), developed for the VR project by Athelstone language teacher Angelica Cardone and Jo Romeo. The unit of work was implemented this term with primary school students in Year 6 (11-12 years of age).

………………………………………………………………………………….

‘Persi in Citta’ (Lost in the City) unit of work

Learning Intention – to use and develop directional language in the VR platform whilst creating different scenes in Italian cities.

Lesson 1

  • Introduce the booklets and go through it as a class (VRTY student handbook)
  • Re – familiarize themselves with the platform and look at where students were in Term 1 in terms of importing 360 degree images, information markers, portal markers and importing pictures etc.
  • Allow time to work on their world.

Lesson 2

  • Students to work on their information markers, limit to at least 4 per picture or scene.
  • Information marker must have information about the landmark they have chosen to use, information must be in English and have the Italian translation.

Lesson 3

  • After information markers have been used and checked by the teacher students to use portal markers so they can move through scenes.
  • Once portal markers have been used to move in and out of scenes directions will need to be written in to allow others to use the world as a new traveller to Italy. E.g. – Excuse me where is the Colosseum? Scusa dov’e` il Colosseo?

Lesson 4

  • Use directional language learnt in lessons and put them in their scenes.
  • Portal markers will need to transport the visitors to the location.

Lesson 5

  • Proposal to use the headsets and phones to view the worlds they have created in the VRTY platform. Proposal to use the 360 camera for producing own images to import into the VRTY platform.

Australian Curriculum Achievement Standards

Communication

  • Informing – Gather information from a range of sources (ACLITC043) and represent information appropriately for different audiences using a variety of modes (ACLITC044).
  • Creating – Create imaginative texts for different audiences such as digital stories using characters, places, ideas and events (ACLITC046)
  • Translating – Create simple bi lingual texts and discuss what translates easily or not (ACLITC048)

Understanding

  • Systems of Language – Use grammatical knowledge to interpret and create meaning in Italian (ACLITU052)
  • Language variation and change – Recognise that language use varies according to the context of situation and culture (ACLITU054)

Success criteria

 YesDeveloping
Can student import a 360 degree image correctly.  
Can student import an information marker and use effectively.  
Student can import a portal marker and use effectively.  
Student can use directional language appropriately to navigate through the scene.  
Was able to work collaboratively in pairs or small groups.  
Used the student handbook effectively for assistance if required.  

In addition to the Languages Curriculum outcomes the unit of work develops the following Level 4 General Capabilities from the Australian Curriculum:

ICT CAPABILITY

Investigating with ICT

  • Locate generate and access data and information: locate, retrieve or generate information using search engines and simple search functions and classify information in meaningful ways

Creating with ICT

  • Generate ideas plans and processes: use ICT effectively to record ideas, represent thinking and plan solutions
  • Generate solutions to challenges and learning area tasks: independently or collaboratively create and modify digital solutions, creative outputs or data representation/transformation for articular audiences and purposes

Communicating with ICT

  • Collaborate share and exchange: select and use appropriate ICT tools safely to share and exchange information and to safely collaborate with others

CRITICAL AND CREATIVE THINKING CAPABILITY

Inquiring – identifying, exploring and organising information and ideas

  • Identify and clarify information and ideas: identify and clarify relevant information and prioritise ideas
  • Organise and process information: analyse, condense and combine relevant information from multiple sources

Generating ideas, possibilities and actions

  • Imagine possibilities and connect ideas: combine ideas in a variety of ways and from a range of sources to create new possibilities

PERSONAL AND SOCIAL CAPABILITY

Self-management

  • Work independently and show initiative: assess the value of working independently, and taking initiative to do so where appropriate
  • Become confident resilient and adaptable: devise strategies and formulate plans to assist in the completion of challenging tasks and the maintenance of personal safety

Social management

  • Communicate effectively: identify and explain factors that influence effective communication in a variety of situations
  • Work collaboratively: contribute to groups and teams, suggesting improvements in methods used for group investigations and projects
  • Make decisions: identify factors that influence decision making and consider the usefulness of these in making their own decisions

Using VRTY for language learning

In 2019, VRTY partnered with the Athelstone School and the VR School Study to investigate how primary school students could create 360° environments to enhance language learning, in this case Italian. VRTY was created in 2016 to help make virtual reality more accessible to educators and students. Its founders wanted to improve educational approaches by bringing-to-life 21st Century learning outcomes.

So what is it really? VRTY is a VR and interactive 360° content creation and sharing software platform. It lives in the cloud and its benefit is its ability to help anyone create their own virtual content. There’s no need to code because the platform provides its own easy-to-use tools to let the imagination run free, enact design thinking, problem-solve, prototype and create and share feedback with others.

Being cloud based, there are no specific hardware requirements to use the platform; all you need is a computer with Google or safari browsers and an internet connection. To share a newly created project, it can be shared via a QR code or unique web address (URL). When viewing a project, it can be viewed in 360°mode on any device with a google or safari browser; and to view in VR mode it can be viewed using a mobile and a VR cardboard or mobile headset.

Using VRTY 360° in education has the potential to

  • Increase student engagement;
  • Facilitate higher order thinking and collaboration;
  • Allow students to demonstrate content mastery through the creation of their own media-rich virtual environments;
  • Develop ICT capability area of the National Curriculum integrated across learning areas; and
  • Authentically share content that can be used across the education community.

VRTY provides online training on the platform and an in-class teleconference training session (which is pictured above). Founder, Kingston Lee-Young is enjoying the Athelstone School collaboration, offering the following insights:

“As software developers, we had a vision of creating something that would improve the learning environment and benefit both teachers and students. Partnering with the Athelstone School allows us to see our VRTY platform in action in the hands of Years 5 and 6 students learning Italian. Whilst the involvement of the VR School Study means we are being measured to see if we are truly adding value.”

The photo above shows Kingston and Sarah Lee (VR Producer at VRTY) providing online training to Athelstone School students.

For more information about VRTY or to see some of its shareable content please head to: https://vrty.io

New study on 360° VR for primary school language learning

The VR School Study is in a new partnership with Athelstone School, a South Australian primary (elementary) school. The Athelstone School research will investigate how 360° VR content creation can be used for learning Italian. Funded by the South Australian Department of Education’s Innovative Language Program Grants (ILPG) program, Year 5 and 6 students will use the VRTY platform to create and share their own virtual worlds guided by the Australian curriculum. This action research has already undergone a pilot phase that happened in the second half of 2019 and we are now entering into the first of  several research cycles in order to explore technical challenges, developmental appropriateness of 360° VR, and the efficacy and innovative potential of 360° VR content creation for learning another language.

The teacher co-researchers on the project are language teachers Angelica Cardone (far left behind) and Jo Romeo (left front on top image), and Principal Gyllian Godfrey (back centre) who is also a qualified language teacher.  Gyllian provided this reflection on the project:

“The ILPG has offered the opportunity to test the benefits of VR for students
learning languages at primary level and has also upped-the-ante by making
students the creators of their own content, by developing non-linear language
learning narratives for themselves and their peers.”

In our next blog, the folks from VRTY explain how students can use their platform for content creation and learning.  Stay tuned.

Bought to you by A/Prof Erica Southgate who is taking up a lot of room (right front) in the photo above.

Some cool stuff from the VR Book

This article was first published by the Australian Association for Research in Education (29 June, 2020). I’m sharing it here because it highlights some interesting findings from the book.

Virtual Reality in school education: Australia leads the way with groundbreaking research

By Erica Southgate

In 2016, I attended a meeting and fortuitously sat next to the (now retired) principal of Callaghan College who asked me what type of research I’d like to do in schools. At the time a new high-end, highly immersive type of virtual reality (VR) hardware called the Oculus Rift had been released. This type of VR equipment was costly and needed an expensive computer to run but offered entry into amazing worlds. It provided high fidelity environments to be explored through gestural interaction via controllers that allowed you to use your virtual hands to interact with virtual objects and avatars (either other people or computer characters) and navigate in ways that felt incredibly embodied (I am addicted to flying and jumping off clouds in VR).

 I made a gentle pitch that I’d like to work with teachers to embed this technology into classrooms to see how it could be used for learning but that I had no idea what we might find. And so began the VR School Study, a collaboration with Callaghan College and later, Dungog High School, both government high schools in NSW, Australia.  It became the first research internationally to embed high-end VR in school classrooms.

VR School Study

The VR School Study is ongoing participatory research that aims to explore the use of immersive virtual reality in real classrooms. We focus on how VR can be used to enhance learning, its relationship to curriculum, and its implications for pedagogy. And we examine all the practical, ethical and safety issues that come with integrating emerging technology in classrooms. At the end 2018, the study reached a major milestone with the completion of two major case studies into the use of the technology in secondary schools.

An ‘arduous’ adventure in emerging technology

IN 2018, on the last day of research at Callaghan College, I interviewed two teachers about what it was like to embed an emerging technology in the classroom. The response was, ‘Arduous comes to mind.’ While we did have a laugh, the comment summed up a range of issues encountered during the research.

Space to accommodate VR and safety concerns

Trying to find an available classroom space large enough to accommodate the play areas needed for this VR, which is best used standing and moving around, proved difficult. On one campus we managed to get a room with a small storeroom off it that squeezed in three sets of VR equipment with play areas while at the other we had a larger former lab-preparation room attached to a classroom. Both VR rooms were beyond the immediate supervisory gaze of the teacher and so required me or a student to act as a safety ‘spotter’ to ensure there were no collisions with walls, furniture or peers. Even though there is a built in ‘Guardian System’ (a pop-up virtual cage mapped to the real environment you should stay within), some students became so immersed that they ignored it and needed intervention. Even now with ‘pass through’ cameras in some VR headsets (these allow the user to see the outside environment when they go beyond the Guardian System) some people become so immersed and are interacting with such speed that they can run into objects. Engineered safety solutions are not always enough to maintain safety.

Network and server issues

Getting the tech to work within the confines of the school internet network proved difficult. Game stores that allow multiplayer environments were blocked and internet work-arounds required. Teachers had to set-up individual student accounts which was time-consuming and often update applications in their own time. Our screen capture video, which showed a first-person view of what the student was seeing and doing in a virtual environment, indicated that the technology failed 15% of the time due to network, server and VR tracking drop-out. One of my favourite moments in student humour and resilience was when I heard one boy say to another as they who were fixing a server issue for the third time, “Aren’t you glad you signed up for this?”.

Content mastery and creativity through collaboration

Students were given the highest quality VR and ‘sandbox’ applications, such as Minecraft VR and Tilt Brush which allowed them to create in virtual environments without needing to code. Combined with clever curriculum design they undertook self-directed formative assessment tasks.

In Year 9 science this involved groups researching and developing a model of a body organ in Minecraft VR. The results were an astounding mix of scientific knowledge melded with creative endeavour developed through group problem-solving and collaboration inside and outside of VR.

Brain from up high

One group produced an anatomically correct, labelled eyeball which was toured by via a rollercoaster while another built a skyscraper of a brain sitting atop a spinal cord which you flew up to interact with engineered components representing neurons. While in VR, students narrated from memory the parts and function of the brain. Analysis of the screen capture video using a framework adapted from  work by Assistant Professor in Learning and Learning Processes the University of Oulu, Jonna Malmberg, indicated that the majority of students used the creative properties of VR to engage in highly collaborative science learning.

Inside the brain

At Dungog High School a senior drama class used single-player 3-D sculpting program Tilt Brush, as an infinite virtual design studio to explore symbolism in set design at real life scale and beyond. Students worked in groups to quickly prototype symbolic elements of their directorial vision with peers and the teacher moving in and out of VR to offer feedback. Mistakes were erased or changes made at the press of a button. The virtual studio of Tilt Brush melded with the drama studio to offer students an opportunity to view their design in 3D from the perspective of an audience member, director, designer or actor. All they needed to do was teleport round the virtual environment to do this.

Let’s leave behind the EdTech evangelism

An admission – I’m not a fan of the type of innovation discourse which permeates university managerial-speak and is associated with EdTech (educational technology) evangelism. This type of talk conjures up images of momentous leaps in ways of doing and knowing with the trope of the lone (male, yes it is a gendered) genius leading the charge with their vision of the future.

Innovation is incorrectly depicted as a development shortcut detached from contexts and the years of work that yield incremental improvements and insights, as Stanford University Director, Christian Seelos, and colleague Johanna Mair, argue. They warn against evaluating innovation only on positive outcomes as this can stifle experimentation required to progress an initiative in difficult or unpredictable environments.

This aligns with critical studies in EdTech where research is on the ‘state-of-the-actual’ rather than the ‘state-of-the-art’, as Distinguished Research Professor in the Faculty of Education, Monash University, Neil Selwyn reminds us. It entails moving away from trying to ‘prove’ a technology works for learning to scrutinizing what actually takes place especially in contexts that are not the ‘model’ well-resourced schools where technologies are often tested.

Teleporting away for now

As I have argued elsewhere, to get the best ethical and educational outcomes with emerging technologies we must carefully incubate these in schools (and not just resource-rich ones) in collaboration with willing teachers so that we can document incremental ‘innovation’ through ‘state-of-the-actual’ reporting. This can be an arduous project but one full of authentic and valuable insights for those willing to go on a research and pedagogical adventure. It’s this type of evidence, not EdTech evangelism, that we need.

For those who want more. In May 2020, I published findings from the study in Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms (Routledge). As co-researchers, teachers from Callaghan College and Dungog High School contributed to their respective chapters in this book. The book offers new pedagogical frameworks for understanding how to best use the properties of VR for deeper learning as well as a ‘state-of-the-actual’ account of the ethical, practical and technical aspects of using VR in low-income school communities.

Erica Southgate (PhD) is Associate Professor of Emerging Technologies for Education at the University of Newcastle, Australia. She is lead author of the recent Australian Government commissioned report, Artificial intelligence and emerging technologies (virtual, augmented and mixed reality) in schools research report, and a maker of computer games for literacy learning. Erica is always looking for brave teachers to collaborate with on research and can be contacted at Erica.southgate@newcastle.edu.au. Erica is on Twitter@EricaSouthgate

This article was originally published on EduResearch Matters. Read the original article.AARE

NEW book from the VR School Study

Out of three years of co-research with teachers comes the first book (of many I hope) from the VR School Study. The book, Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms (2020 Routledge) provides a brand new pedagogical framework with scaffolds for educators on how to use the technology for deeper learning. Case studies from Callaghan College and Dungog High School are included with a focus on metacognition, collaboration and creativity.

Blog SS

Immerse + Imagine with Michelle Brown

Could you tell me about your professional background Michelle?

I studied Multimedia in the early 2000s and began to incorporate technology into my arts practice, I did a lot of computer design work for musicians, bands and venues back then. About this time I also started working and playing in the music industry. I ended up managing one of Australia’s iconic community radio stations, 4ZZZ in Brisbane, so I didn’t have much time to spend on my art, but I did manage to keep producing work occasionally! Being connected to an industry like music gave me a great bunch of opportunities but I decided to leave 4ZZZ in 2016 to concentrate on a career creating art and producing content.

When did you first get interested in VR and why?

In 2016 while I was finishing up my management role I saw some really cool stuff being created with augmented and virtual reality. I started to look into what I needed to get a VR set up and also started producing AR artwork, I already had the animation and illustration skills plus the tech knowledge so it all just kind of fell into place! The biggest barrier for VR is the expense of the equipment however things are getting cheaper with stand-alone headsets like the Quest available, at the time I had to invest in a PC (I was strictly a mac user for a long time!) and a HTC Vive. Some of the artists I saw producing VR artwork include Liz Edwards, a very cool 3D artist, which got me into a VR art app called Tilt Brush, which I’ve used ever since in my workflow, from music videos to large scale installation work.

How do you currently use VR?

I mainly work with some of the VR art apps/programs like Google’s Tilt Brush, Gravity Sketch and some of the animation programs like Tvori. I paint and create environments and worlds in VR that are the base for music videos, installation work and more. Just like a 3D modelling program, many of the VR apps allow you to export 3D creations that can be used in other apps, like Unity, or traditional film editing software like Premiere Pro.

I also teach workshops in using VR and AR in arts practice, so showing ways that you can integrate illustration and animation with mobile apps and teaching people about the art apps I’ve mentioned.

What are your thoughts on VR and the creative process?

For me I love it, it really cuts down on the amount of time I spend hand illustrating or animating. The same with 3D modelling, it would take me possibly 3 times the amount of time to create something in Cinema4D that I can model quickly in VR as it’s more attune to actual sculpting/painting.

I also feel that VR can create more of an impactful experience, when you are in a headset it’s easy to ignore everything else going on and just concentrate on the narrative or user experience, no social media distractions!

What advice would you give teachers and students who are thinking about using VR for creative projects?

Allow a bit of time for all students to have a play in VR, even if you only have one or two headsets! If you are showing students how to use some of the art programs like Tilt Brush, you need to let them have a little time to get comfortable and creative. But also keep in mind taking breaks if you’re in the headset for more than 30 minutes at a time. I also would recommend giving some direction so that students experimenting with VR art have something to focus on rather than just aimlessly painting swirls, for example; get them to paint a favourite animal or cartoon.

What is unique about creating in VR instead of some other medium?

It’s mainly the speed of which I can get an idea out plus the fact it’s in a three dimensional space, it’s just so much quicker for me to produce a visual story. It’s also a way that I can communicate a theme or an idea that links to a social issue that I can address with my installation work, as it allows for more intimacy and less distraction. Being immersed in a 3D environment by yourself in the headset provides a great opportunity to just focus.

Check out Michelle’s VR art and more on her website https://www.thebadlament.com/

MB

Blog at WordPress.com.

Up ↑