Tag: Curriculum

Pedagogical strategies for introducing 360° VR in class

Year 7 students at Trinity College are set the task of creating a vision of the school of the future using 360° VR as the medium of communication; these VR visions used to inform conversations in the school community from a student perspective. Before they begin the project, the class does an initial lesson to become familiar with the hardware and is guided through two brainstorming activities by teachers Jessica Simons and Steve Grant. These brainstorming activities are intended to get students thinking about safety in VR and have them identify engaging design feature of a 360° VR experience.

Students are asked to work in their small groups to use their desks which as whiteboards to write down a set of safety pointers for using VR. The teachers then guide a whole class discussion to come up with a set of safety guidelines that are synthesised by the teacher on a whiteboard. Here are some of the student’s safety ideas:

TRinity safety 2

Trinity safety 1

Trinity safety 4

This activity was followed by students experiencing a 360° tour using the headset and then having a whole class discussion about what made the tour engaging and what might have been improved. Here is a video except is from the whole group discussion on 360° design features guided by their teachers: 

These pedagogical strategies for first lessons with VR promote student agency and responsibility for safety and prime their imaginations and critical thinking skills through evaluation a user experience of the technology.

P.S. In case you want to put a face to the teachers in the video, Steve and Jessica are pictured below after the delivery of this lesson. To find out more about them go to the Team page of the VR School website.

0

Southern Montessori School joins the VR School Study

Southern Montessori Middle School is excited to launch our VR project. Southern Montessori’s VR project is part of an integrated Humanities and Science unit based on the inquiry question: ‘How can we secure food for our future?’ Students will be using VR to create their own biome, identify problems arising from human impact, and find solutions to these problems. Students will be challenged to demonstrate their learning in a creative and engaging manner.

Southern Montessori Middle School is a mixed age year 7-9 community located in the southern suburbs of Adelaide with a strong focus on academics. We combine our thirty six Year 7, 8 and 9 students together and work in small, ability-based groups following the Australian Curriculum but presented with Montessori principles. We are committed to innovative approaches to learning that are not only relevant and engaging, but also prepare our students for their future.

Teachers Siobhan Curran and Toni Maddock have developed this unit of work and series of activities designed for students to not only think critically and creatively about the content, but also think creatively about how VR technology can be used as a tool to assist their learning. Having not used VR in the past, students and teachers alike are excited to take part in this research and to see what the students can achieve.

This post bought to you by teacher and co-researcher Toni Maddock

0

The metaverse

Ever since Facebook announced its vision for their metaverse on 28 October 2021, including the company’s name change to Meta, there has been a buzz about what it might mean for the future of the internet and our digital (and real) lives.  

Of course, this announcement was set against the recent warnings from a reputable whistle-blower about the harm the social media company is doing including to children and young people through its algorithms that shape user beliefs and behaviour, and inadequate moderation of harmful content.  

This blog post unpacks the idea of the metaverse, taking into account Facebook’s vision but also extending beyond it, to understand its history and highlight some implications for teachers.

Where does the term metaverse come from?

English teachers – You Are Up!

The term metaverse was coined by Neal Stephenson in his 1992 cyber punk novel Snow Crash. It referred to a computer generated universe.

40651883._SY475_

Snow Crash is a rollicking sci fi read that has fired-up the imagination of those interested in possible technology futures with its fascinating portrayal of the persistent immersive 3D digital world of the metaverse that can be jacked into through a personal headset or public booths that produce a lower grade, glitchy avatar. In fact, the novel popularised the word avatar. It also highlighted the dangers of corporate and government control of knowledge and its infrastructures, dreamt up a devastating hybrid DNA and digital virus, and featured deadly semi-autonomous weapons called ‘rat things’.

An aside: For an earlier version of the metaverse, but this one was called the ‘matrix’, see William Gibson’s (1984) Neuromancer, a dazzling tale about a VR universe inhabited by mastermind AIs that influenced the Matrix film trilogy (soon to be quadrilogy).

What will the metaverse be?

The idea of the metaverse extends beyond Facebook’s (proprietary?) influence and has been described as a spatialised interoperable version of the internet. At the moment no one really knows what the metaverse might be like although there are current smart glasses, persistent VR spaces and gaming sites that provide a window into social, commercial, communication and creative aspects of it. Users will probably connect with the persistent interfaces, spaces and layers of the metaverse using a VR headset or smart glasses or on a screen (or with some type of yet-to-be-invented hardware that can integrate aspects of these). There is also a future vision, and investment into research, for direct human brain-computer interface. The metaverse will be populated with people in avatar form and by AI-powered virtual characters in human and other forms.

Here is a description of what the metaverse might be:

“The metaverse is the idea of a shared digital universe in the cloud created by merging virtual spaces that are physically persistent together with augmented reality (AR) layered over the real world. The metaverse is singular because the concept includes the sum of all virtual and online worlds along with all AR layers enhancing the physical world… Besides games and hangouts, it will include social media platforms, workplace tools, investing resources, online shops and much more. You’ll be able to immerse yourself completely in this spatial internet using virtual reality (VR) technology or just interact with bits of it that are layered over your physical space via AR. Instead of a profile picture, you’ll be represented by a complete digital avatar or persona. You’ll be able to meet up with your friends’ digital personas and wander around visiting virtual places and attending virtual events.” https://history-computer.com/metaverse-the-complete-guide/

For those interested in how Facebook’s metaverse might be designed in stages see this excellent article from Avi Bar-Zeev, veteran developer of and commentator on all things eXtended Reality (XR).

What does the metaverse mean for teachers and students?

1. Be curious but don’t believe the hype: There is a fair bit of publicity around the metaverse, and this will infiltrate the EdTech space – just remember that the metaverse isn’t here yet (at least in a scaled-up interoperable way), and some suggest it may never arrive. So, it’s good to be intrigued without buying into the hype.

2. Keep up with current research on immersive learning: We are still in the early days of building the evidence base for the effectiveness of immersive technologies for learning using headset-mediated VR and augmented reality experienced through glasses or via screen, especially in schools.  Results are promising but ongoing rigorous research is needed so that we can confidently embed immersive learning into school classrooms in ways that make pedagogical sense and align with curriculum across subject areas. Asking questions about the evidence base and keeping up with the research on immersive learning is vital as knowledge about this will allow us to ask the right educational questions as the metaverse evolves.  

3. Get interested in the (dry) but important areas of privacy law, digital legislation and regulation, and AI ethics: The idea of the metaverse only amplifies existing concerns regarding the automated harvesting, sharing and use of data without user consent including biometric data which is about and of the user body (facial recognition, pupil dilation, gaze and movement tracking etc.) and which can be highly identifying. There are many different forms of biometric data and plenty of biometric harvesting tools available and so we need to watch this space carefully. Automated nudging of behaviour and the affective moods of users will be diffused through the metaverse as current visions see this as a place to advertise and sell products to us as well as collect our personal data in ways which will be highly embodied and emotional. The inclusion of cameras in smart glasses and VR headsets adds another layer of complexity to maintenance of privacy. The Internet of Things will seamlessly fuse with the Internet of Bodies creating legal, ethical and social dilemmas for all of us, personally and professionally. Children and young people will be differently impacted at each stage of their physical, cognitive, moral, and social development. The teaching profession needs to ask who will regulate the metaverse, define its standards, and build and control its infrastructure and content, as this should inform decision making on procurement of technology for schools. No teacher wants to bring unethical technology into the classroom and so we need to start understanding and applying ethical frameworks now and into the future as the metaverse merges with aspects of our everyday lives in work, leisure and learning.

4. Empower children and young people to have a say in what the metaverse should be: Look for places in the curriculum where students can investigate and use the technologies related to the metaverse as well as explore public and industry discourse about its ethical and social implications. Such opportunities should expand the boundaries of digital literacy education to take in civics and citizenship, the environmental impacts of technology, ideas about human-machine relationships, and re-formed conceptions of learning, creativity and identity in the new machine age. Some industry doyens, such as the CEO of the child-targeted Roblox gaming platform which has 42 million daily users logins, suggest that children are already in a proto-metaverse and that one day such platforms will be pivotal to a metaverse providing everything from learning, shopping and business communication tools. Schooling systems rarely recognise the digital leisure life of children and youth, and yet industry is watching and factoring this into their plans for the metaverse. It is important that we as educators facilitate children’s critical engagement and agency in this space so that they are not viewed just as consumers or as data points. The voices and visions of children and young people should be integral to shaping a metaverse which upholds human rights including the rights of child.

The post bought to you by A/Prof Erica Southgate who is looking forward to having a snazzy Star Trek Borg avatar in the metaverse.

P.S. For those interested, here is the full Facebook Meta announcement.

Snow Crash novel cover featured in this post is from https://www.amazon.com/Snow-Crash-Neal-Stephenson/dp/0553380958

1

Student 360° content creation for learner agency

How do children go about planning the content and experiences of virtual environments that they are creating to demonstrate learning mastery? How do they think about creating virtual environments for their peers to learn in? What are the special learning outcomes related to this? Not much is known about these areas. 

The VR School Study is interested in students as virtual environment content creators. As part of the research, we collected data on the approaches students take when creating their own virtual worlds to demonstrate mastery of learning. This blog reports on interesting findings from the Athelstone School Innovative Languages project where primary (elementary) aged children are building their own 360° virtual tours to demonstrate mastery of the Italian language.

The students are using VRTY, a platform that allows them to plan and create their virtual worlds without needed to code. The platform provides easy-to-use tools with built in tutorials and a fun guide so that students can independently learn to use the platform after a couple of formal training sessions. Previous blog posts describe the VRTY platform and how it is leveraged through the teacher’s curriculum design. The first step, after training, is for students to research and plan their virtual tour. The planning involves storyboarding through VRTY. Students need to:

  1. Locate and choose the 360° photo scenes of Italy that best fit a tour narrative.
  2. Locate cultural and historical images that could be embedded in each scene.
  3. Create their own content to embed in the scene such as text and sound file that draw on the vocabulary mandated and reflect their research on cultural and historical information about Italy.
  4. Design a narrative through storyboarding in VRTY that reflects the story they want to tell and consider whether the tour experience should be linear or non-linear (the image below is of one student’s storyboard).
  5. Create each 360° scene and embed their content into it in an engaging way and place teleporter hotspots in the scenes so those experiencing the tour can move between scenes.  

Fourteen students from a mixed ability class chose to be part of the project with 11 virtual worlds in total created – some students chose to work in pairs. Equal numbers of boys and girls participated. On average student virtual worlds comprised six 360° scenes. Overall, students created 187 pieces of content to embed in scenes in their virtual worlds, including 50 sound files and 137 information markers. The cover image to this blog post is a screen shot from the student tour ‘Journey around Rome’ which shows student created information and sound markers embedded into the scene.

Interestingly, 7 of the 11 worlds were structured according to a non-linear narrative. Non-linear narratives allowed those experiencing the tour to move back and forth between all or most 360° scenes. Students who developed a non-linear narrative storyboard explained that this allowed have the freedom to go back and check out aspects of a scene they might have missed or enjoyed. The image below is of a non-linear narrative storyboard developed in VRTY. The virtual tour was created by a female student who called it ‘Journey around Rome’ and it allowed the traveler to move between a number of historic sites with all sorts of images, text and sound files in English and Italian embedded into them which used the mandated vocabulary and other Italian. Best still the traveler could return to a hotel room and decide which day trip they might take next or they could go back and visit somewhere they had already been.

The storyboard in VRTY for ‘Tour Around Rome’ illustrates the non-linear narrative created by the students with arrow indicating the direction of travel that was possible between 360° scenes.

This sophisticated non-linear narrative approach to constructing a user experience was premised on creating a sense of agency for those experiencing the tour (or other learners). In choosing non-linear narratives some children were tapping into the strength of developing learner agency when designing their virtual worlds. Non-linear narratives were not essential for developing agency but, in many cases, were important to this.

The significance of developing agency in learning cannot be underestimated, as Williams (2017) explains:

“Students with agency develop a self-perception that is based on their abilities as independent thinkers. Our task as educators is not to tell them what to think but to help reveal their thinking by reflecting back to them what we are observing and noticing and naming their acts of problem solving. This feedback builds a metacognitive awareness that reinforces their identities as capable thinkers who are able to construct their own understandings. This mode of learning shifts the locus of power from the teacher to the student, thus setting up students as the experts in their own learning.” (p. 11).

The Athelstone School VR project illustrates how many students themselves understand the significance of agency in creating engaging and efficacious 360° learning environments.

Reference

Williams, P. (2017). Student Agency for Powerful Learning. Knowledge Quest, 45(4), 8-15.

1

Researching VR for education

This post provides a snapshot of some of the ways the VR School Study researches the use of VR in schools, with the framework also applicable to other formal educational contexts. VR School is an ongoing multi-site study that employs a mixed-methodology (qualitative and quantitative) approach to research. The study is premised on a multi-perspectival conceptual of education with and in VR. The diagram below outlines some of the key areas that are explored in the research.

Each of these areas prompts a range of questions about virtual reality for education. The table below highlights some of these questions with associated methods for collecting data that might shed light on them.

AREARESEARCHQUESTIONSMETHOD
PedagogyHow can teachers leverage the signature pedagogies of their subject areas/disciplines to ensure deeper learning through VR for their students?
How can teachers leverage the learning affordances of VR for deeper learning?
What are the pedagogical principles or assumptions the are evident in VR applications?		Classroom observation
Teacher reflection
Surveys
CurriculumHow can VR be woven into a unit of work which includes the normal range of conventional learning activities in a curriculum-aligned way?
Can curriculum objectives be adapted to take advantage of the learning affordances of VR?		Classroom observation
Teacher written and verbal reflection
Document (curriculum) analysis
AssessmentHow can VR be used to develop novel, engaging and authentic types of formative and summative assessment?
How can student peer and self-assessment be built into VR projects?
How can VR be used to develop novel, engaging and authentic types of formative and summative assessment?
What are strengths and limitations of conventional assessment types in understanding learning?		Teacher and student written and verbal reflection
Document (curriculum) analysis
Achievement analysis
Student work sample analysis
Student learningHow can students use VR to demonstrate content mastery, collaboration and communication skills, new conceptual understandings, problem-solving skills, metacognition and an academic mindset?
What is the student experience of learning through and in VR?
How can students move beyond the novel effect of new technology to develop deeper learning?		Surveys
Student work sample analysis
Student and teacher written and verbal reflection
Achievement analysis
Student talk and behavioural analysis
Observation
Teacher professional learningWhat is the teacher experience of learning to use an emerging technology in the classroom?
What types of formal professional learning, expert and peer support do teachers require?
How do teachers learn from each other and students during VR projects?		Teacher written and verbal reflection
Observation
Survey
Ethics and safetyWhat are the ethical, legal, safety and child development issues related to using VR in classrooms?Document analysis
Observation and testing
Surveys and experiments (cross-sectional and longitudinal)
Organisational arrangements and cultureWhat are the technical, practical and organisational enablers and barriers to embedding VR in classrooms in a curriculum-aligned way?
What conditions are required for pedagogical risk taking using an emerging technology?
How does the culture of the school support or impede innovation?		Teacher and student written and verbal reflection
Observation
Survey
Document analysis

While these are only some of the questions and approaches to data collection that the VR School study is exploring across primary and secondary schools and in different subject areas, it is worth noting that there is a commitment to participatory research: That is research with teachers and students, not on them. Elevating the knowledges of teachers and students will be key to understanding where VR fits best in education and in scaling up immersive learning in schools.

Cover image from Pexel.

0

‘Persi in Citta’ unit of work for the Athelstone School VR project

Developing units of work that allow for student VR content creation involves: (a) sequencing and scaffolding learning for curriculum-mandated content and skill acquisition; and, (b) allowing time for students to develop new technology expertise via problem-solving, creative experimentation and collaboration.

In the Athelstone School VR project, primary (elementary) school students use the 360° VRTY platform to create a travel journey that demonstrates Italian language acquisition and knowledge of Italian culture. The learning objectives derive directly from the Australian Curriculum.

Below is the unit of work ‘Persi in Citta’ (Lost in the City), developed for the VR project by Athelstone language teacher Angelica Cardone and Jo Romeo. The unit of work was implemented this term with primary school students in Year 6 (11-12 years of age).

………………………………………………………………………………….

‘Persi in Citta’ (Lost in the City) unit of work

Learning Intention – to use and develop directional language in the VR platform whilst creating different scenes in Italian cities.

Lesson 1

  • Introduce the booklets and go through it as a class (VRTY student handbook)
  • Re – familiarize themselves with the platform and look at where students were in Term 1 in terms of importing 360 degree images, information markers, portal markers and importing pictures etc.
  • Allow time to work on their world.

Lesson 2

  • Students to work on their information markers, limit to at least 4 per picture or scene.
  • Information marker must have information about the landmark they have chosen to use, information must be in English and have the Italian translation.

Lesson 3

  • After information markers have been used and checked by the teacher students to use portal markers so they can move through scenes.
  • Once portal markers have been used to move in and out of scenes directions will need to be written in to allow others to use the world as a new traveller to Italy. E.g. – Excuse me where is the Colosseum? Scusa dov’e` il Colosseo?

Lesson 4

  • Use directional language learnt in lessons and put them in their scenes.
  • Portal markers will need to transport the visitors to the location.

Lesson 5

  • Proposal to use the headsets and phones to view the worlds they have created in the VRTY platform. Proposal to use the 360 camera for producing own images to import into the VRTY platform.

Australian Curriculum Achievement Standards

Communication

  • Informing – Gather information from a range of sources (ACLITC043) and represent information appropriately for different audiences using a variety of modes (ACLITC044).
  • Creating – Create imaginative texts for different audiences such as digital stories using characters, places, ideas and events (ACLITC046)
  • Translating – Create simple bi lingual texts and discuss what translates easily or not (ACLITC048)

Understanding

  • Systems of Language – Use grammatical knowledge to interpret and create meaning in Italian (ACLITU052)
  • Language variation and change – Recognise that language use varies according to the context of situation and culture (ACLITU054)

Success criteria

 YesDeveloping
Can student import a 360 degree image correctly.  
Can student import an information marker and use effectively.  
Student can import a portal marker and use effectively.  
Student can use directional language appropriately to navigate through the scene.  
Was able to work collaboratively in pairs or small groups.  
Used the student handbook effectively for assistance if required.  

In addition to the Languages Curriculum outcomes the unit of work develops the following Level 4 General Capabilities from the Australian Curriculum:

ICT CAPABILITY

Investigating with ICT

  • Locate generate and access data and information: locate, retrieve or generate information using search engines and simple search functions and classify information in meaningful ways

Creating with ICT

  • Generate ideas plans and processes: use ICT effectively to record ideas, represent thinking and plan solutions
  • Generate solutions to challenges and learning area tasks: independently or collaboratively create and modify digital solutions, creative outputs or data representation/transformation for articular audiences and purposes

Communicating with ICT

  • Collaborate share and exchange: select and use appropriate ICT tools safely to share and exchange information and to safely collaborate with others

CRITICAL AND CREATIVE THINKING CAPABILITY

Inquiring – identifying, exploring and organising information and ideas

  • Identify and clarify information and ideas: identify and clarify relevant information and prioritise ideas
  • Organise and process information: analyse, condense and combine relevant information from multiple sources

Generating ideas, possibilities and actions

  • Imagine possibilities and connect ideas: combine ideas in a variety of ways and from a range of sources to create new possibilities

PERSONAL AND SOCIAL CAPABILITY

Self-management

  • Work independently and show initiative: assess the value of working independently, and taking initiative to do so where appropriate
  • Become confident resilient and adaptable: devise strategies and formulate plans to assist in the completion of challenging tasks and the maintenance of personal safety

Social management

  • Communicate effectively: identify and explain factors that influence effective communication in a variety of situations
  • Work collaboratively: contribute to groups and teams, suggesting improvements in methods used for group investigations and projects
  • Make decisions: identify factors that influence decision making and consider the usefulness of these in making their own decisions
2

New study on 360° VR for primary school language learning

The VR School Study is in a new partnership with Athelstone School, a South Australian primary (elementary) school. The Athelstone School research will investigate how 360° VR content creation can be used for learning Italian. Funded by the South Australian Department of Education’s Innovative Language Program Grants (ILPG) program, Year 5 and 6 students will use the VRTY platform to create and share their own virtual worlds guided by the Australian curriculum. This action research has already undergone a pilot phase that happened in the second half of 2019 and we are now entering into the first of  several research cycles in order to explore technical challenges, developmental appropriateness of 360° VR, and the efficacy and innovative potential of 360° VR content creation for learning another language.

The teacher co-researchers on the project are language teachers Angelica Cardone (far left behind) and Jo Romeo (left front on top image), and Principal Gyllian Godfrey (back centre) who is also a qualified language teacher.  Gyllian provided this reflection on the project:

“The ILPG has offered the opportunity to test the benefits of VR for students
learning languages at primary level and has also upped-the-ante by making
students the creators of their own content, by developing non-linear language
learning narratives for themselves and their peers.”

In our next blog, the folks from VRTY explain how students can use their platform for content creation and learning.  Stay tuned.

Bought to you by A/Prof Erica Southgate who is taking up a lot of room (right front) in the photo above.

2

Some cool stuff from the VR Book

This article was first published by the Australian Association for Research in Education (29 June, 2020). I’m sharing it here because it highlights some interesting findings from the book.

Virtual Reality in school education: Australia leads the way with groundbreaking research

By Erica Southgate

In 2016, I attended a meeting and fortuitously sat next to the (now retired) principal of Callaghan College who asked me what type of research I’d like to do in schools. At the time a new high-end, highly immersive type of virtual reality (VR) hardware called the Oculus Rift had been released. This type of VR equipment was costly and needed an expensive computer to run but offered entry into amazing worlds. It provided high fidelity environments to be explored through gestural interaction via controllers that allowed you to use your virtual hands to interact with virtual objects and avatars (either other people or computer characters) and navigate in ways that felt incredibly embodied (I am addicted to flying and jumping off clouds in VR).

 I made a gentle pitch that I’d like to work with teachers to embed this technology into classrooms to see how it could be used for learning but that I had no idea what we might find. And so began the VR School Study, a collaboration with Callaghan College and later, Dungog High School, both government high schools in NSW, Australia.  It became the first research internationally to embed high-end VR in school classrooms.

VR School Study

The VR School Study is ongoing participatory research that aims to explore the use of immersive virtual reality in real classrooms. We focus on how VR can be used to enhance learning, its relationship to curriculum, and its implications for pedagogy. And we examine all the practical, ethical and safety issues that come with integrating emerging technology in classrooms. At the end 2018, the study reached a major milestone with the completion of two major case studies into the use of the technology in secondary schools.

An ‘arduous’ adventure in emerging technology

IN 2018, on the last day of research at Callaghan College, I interviewed two teachers about what it was like to embed an emerging technology in the classroom. The response was, ‘Arduous comes to mind.’ While we did have a laugh, the comment summed up a range of issues encountered during the research.

Space to accommodate VR and safety concerns

Trying to find an available classroom space large enough to accommodate the play areas needed for this VR, which is best used standing and moving around, proved difficult. On one campus we managed to get a room with a small storeroom off it that squeezed in three sets of VR equipment with play areas while at the other we had a larger former lab-preparation room attached to a classroom. Both VR rooms were beyond the immediate supervisory gaze of the teacher and so required me or a student to act as a safety ‘spotter’ to ensure there were no collisions with walls, furniture or peers. Even though there is a built in ‘Guardian System’ (a pop-up virtual cage mapped to the real environment you should stay within), some students became so immersed that they ignored it and needed intervention. Even now with ‘pass through’ cameras in some VR headsets (these allow the user to see the outside environment when they go beyond the Guardian System) some people become so immersed and are interacting with such speed that they can run into objects. Engineered safety solutions are not always enough to maintain safety.

Network and server issues

Getting the tech to work within the confines of the school internet network proved difficult. Game stores that allow multiplayer environments were blocked and internet work-arounds required. Teachers had to set-up individual student accounts which was time-consuming and often update applications in their own time. Our screen capture video, which showed a first-person view of what the student was seeing and doing in a virtual environment, indicated that the technology failed 15% of the time due to network, server and VR tracking drop-out. One of my favourite moments in student humour and resilience was when I heard one boy say to another as they who were fixing a server issue for the third time, “Aren’t you glad you signed up for this?”.

Content mastery and creativity through collaboration

Students were given the highest quality VR and ‘sandbox’ applications, such as Minecraft VR and Tilt Brush which allowed them to create in virtual environments without needing to code. Combined with clever curriculum design they undertook self-directed formative assessment tasks.

In Year 9 science this involved groups researching and developing a model of a body organ in Minecraft VR. The results were an astounding mix of scientific knowledge melded with creative endeavour developed through group problem-solving and collaboration inside and outside of VR.

Brain from up high

One group produced an anatomically correct, labelled eyeball which was toured by via a rollercoaster while another built a skyscraper of a brain sitting atop a spinal cord which you flew up to interact with engineered components representing neurons. While in VR, students narrated from memory the parts and function of the brain. Analysis of the screen capture video using a framework adapted from  work by Assistant Professor in Learning and Learning Processes the University of Oulu, Jonna Malmberg, indicated that the majority of students used the creative properties of VR to engage in highly collaborative science learning.

Inside the brain

At Dungog High School a senior drama class used single-player 3-D sculpting program Tilt Brush, as an infinite virtual design studio to explore symbolism in set design at real life scale and beyond. Students worked in groups to quickly prototype symbolic elements of their directorial vision with peers and the teacher moving in and out of VR to offer feedback. Mistakes were erased or changes made at the press of a button. The virtual studio of Tilt Brush melded with the drama studio to offer students an opportunity to view their design in 3D from the perspective of an audience member, director, designer or actor. All they needed to do was teleport round the virtual environment to do this.

Let’s leave behind the EdTech evangelism

An admission – I’m not a fan of the type of innovation discourse which permeates university managerial-speak and is associated with EdTech (educational technology) evangelism. This type of talk conjures up images of momentous leaps in ways of doing and knowing with the trope of the lone (male, yes it is a gendered) genius leading the charge with their vision of the future.

Innovation is incorrectly depicted as a development shortcut detached from contexts and the years of work that yield incremental improvements and insights, as Stanford University Director, Christian Seelos, and colleague Johanna Mair, argue. They warn against evaluating innovation only on positive outcomes as this can stifle experimentation required to progress an initiative in difficult or unpredictable environments.

This aligns with critical studies in EdTech where research is on the ‘state-of-the-actual’ rather than the ‘state-of-the-art’, as Distinguished Research Professor in the Faculty of Education, Monash University, Neil Selwyn reminds us. It entails moving away from trying to ‘prove’ a technology works for learning to scrutinizing what actually takes place especially in contexts that are not the ‘model’ well-resourced schools where technologies are often tested.

Teleporting away for now

As I have argued elsewhere, to get the best ethical and educational outcomes with emerging technologies we must carefully incubate these in schools (and not just resource-rich ones) in collaboration with willing teachers so that we can document incremental ‘innovation’ through ‘state-of-the-actual’ reporting. This can be an arduous project but one full of authentic and valuable insights for those willing to go on a research and pedagogical adventure. It’s this type of evidence, not EdTech evangelism, that we need.

For those who want more. In May 2020, I published findings from the study in Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms (Routledge). As co-researchers, teachers from Callaghan College and Dungog High School contributed to their respective chapters in this book. The book offers new pedagogical frameworks for understanding how to best use the properties of VR for deeper learning as well as a ‘state-of-the-actual’ account of the ethical, practical and technical aspects of using VR in low-income school communities.

Erica Southgate (PhD) is Associate Professor of Emerging Technologies for Education at the University of Newcastle, Australia. She is lead author of the recent Australian Government commissioned report, Artificial intelligence and emerging technologies (virtual, augmented and mixed reality) in schools research report, and a maker of computer games for literacy learning. Erica is always looking for brave teachers to collaborate with on research and can be contacted at Erica.southgate@newcastle.edu.au. Erica is on Twitter@EricaSouthgate

This article was originally published on EduResearch Matters. Read the original article.AARE

0

Immerse + Imagine with Michelle Brown

Could you tell me about your professional background Michelle?

I studied Multimedia in the early 2000s and began to incorporate technology into my arts practice, I did a lot of computer design work for musicians, bands and venues back then. About this time I also started working and playing in the music industry. I ended up managing one of Australia’s iconic community radio stations, 4ZZZ in Brisbane, so I didn’t have much time to spend on my art, but I did manage to keep producing work occasionally! Being connected to an industry like music gave me a great bunch of opportunities but I decided to leave 4ZZZ in 2016 to concentrate on a career creating art and producing content.

When did you first get interested in VR and why?

In 2016 while I was finishing up my management role I saw some really cool stuff being created with augmented and virtual reality. I started to look into what I needed to get a VR set up and also started producing AR artwork, I already had the animation and illustration skills plus the tech knowledge so it all just kind of fell into place! The biggest barrier for VR is the expense of the equipment however things are getting cheaper with stand-alone headsets like the Quest available, at the time I had to invest in a PC (I was strictly a mac user for a long time!) and a HTC Vive. Some of the artists I saw producing VR artwork include Liz Edwards, a very cool 3D artist, which got me into a VR art app called Tilt Brush, which I’ve used ever since in my workflow, from music videos to large scale installation work.

How do you currently use VR?

I mainly work with some of the VR art apps/programs like Google’s Tilt Brush, Gravity Sketch and some of the animation programs like Tvori. I paint and create environments and worlds in VR that are the base for music videos, installation work and more. Just like a 3D modelling program, many of the VR apps allow you to export 3D creations that can be used in other apps, like Unity, or traditional film editing software like Premiere Pro.

I also teach workshops in using VR and AR in arts practice, so showing ways that you can integrate illustration and animation with mobile apps and teaching people about the art apps I’ve mentioned.

What are your thoughts on VR and the creative process?

For me I love it, it really cuts down on the amount of time I spend hand illustrating or animating. The same with 3D modelling, it would take me possibly 3 times the amount of time to create something in Cinema4D that I can model quickly in VR as it’s more attune to actual sculpting/painting.

I also feel that VR can create more of an impactful experience, when you are in a headset it’s easy to ignore everything else going on and just concentrate on the narrative or user experience, no social media distractions!

What advice would you give teachers and students who are thinking about using VR for creative projects?

Allow a bit of time for all students to have a play in VR, even if you only have one or two headsets! If you are showing students how to use some of the art programs like Tilt Brush, you need to let them have a little time to get comfortable and creative. But also keep in mind taking breaks if you’re in the headset for more than 30 minutes at a time. I also would recommend giving some direction so that students experimenting with VR art have something to focus on rather than just aimlessly painting swirls, for example; get them to paint a favourite animal or cartoon.

What is unique about creating in VR instead of some other medium?

It’s mainly the speed of which I can get an idea out plus the fact it’s in a three dimensional space, it’s just so much quicker for me to produce a visual story. It’s also a way that I can communicate a theme or an idea that links to a social issue that I can address with my installation work, as it allows for more intimacy and less distraction. Being immersed in a 3D environment by yourself in the headset provides a great opportunity to just focus.

Check out Michelle’s VR art and more on her website https://www.thebadlament.com/

MB

0

Immerse + Imagine with Alex Bowles

Could you tell us about your professional background Alex?

I came to VR from a background in film and television production, mostly advertising. I got my start at Industrial Light + Magic (ILM) in their commercial production division. This is also where I got my introduction to a lot of the tools that have become central to VR development, like virtual cameras, 3D modelling, CG animation, and rendering pipelines.

At the time, I was less interested in the on-screen possibilities of digital effects and more interested in the ways that the tools and techniques used for effects work were changing the production process itself. Pre-visualization was especially attractive.

I loved the idea of creating virtual sets that allowed creative and production teams to explore their ideas in this relatively cheap, very elastic, and super forgiving design space. Everything about it was the exact opposite of physical production. To me, it was clear that decoupling design from execution was hugely liberating in creative terms, but also a great way to reduce a project’s risks. That’s a rare combination. The key was having a virtual production that offered enough detail, precision, and accuracy to reliably map decisions made there to the real world.

When did you first get interested in VR and why?

A few years ago I’d been researching a program for the full-dome theaters used in science centers, natural history museums, and planetariums. The story focused on the overlapping histories of astronomy and cartography. It revealed the ways that increasingly accurate models of the cosmos led to increasingly accurate maps of the world, and by extension, what people were capable of doing within the world. The goal was to make mathematics, science, and technology more accessible to middle-school and high-school students by providing them with a clear view of how they all worked together. This type of interdisciplinary understanding can make learning abstract concepts a lot easier. It can also be very hard to come by in educational systems based on strict compartmentalization of subjects. That’s where third-parties like public science institutions come in.

The problem I found was that the places with these immersive displays couldn’t offer the economic support that this particular program required. I also discovered that these institutions shared a somewhat Balkanized culture. This made co-productions especially difficult, at least for an outside producer like myself. When Oculus announced that it was going to be making full immersion available at consumer-electronics prices, I thought wow, here’s a way to get the program developed and distributed properly.

This proved less straightforward than I imagined. As a friend of mine likes to point out, you should never mistake a clear view for a short distance. It turned out that the technology was both more complex and more nascent than I initially guessed. That’s where I realized my background wasn’t serving me well. When you’re used to life in a very mature ecosystem, you take so much for granted that simply doesn’t exist in an ecosystem that’s just getting started. Even so, I was absolutely hooked. There’s a particular kind of engagement that you get in VR that I haven’t experienced anywhere else. And I think the ability to actually develop an ecosystem around that is a once-in-a-lifetime opportunity.

How do you currently use VR?

First and foremost, the best way to create VR is in VR. This is easier said than done, since so many of the tools, from 3D modeling software to game engines, were all developed with flat screens in mind. This makes it very easy to lose touch with the sense of presence in real space that’s key to the best experiences. The more of the process you can bring into an immersive display, the better.

I also use it for some things I never expected. One of them is fitness. I checked out games like Beat Saber and Pistol Whip just because they were getting a lot of buzz, but then I heard about people who were making them a part of regular workout routines, and getting really great results within 3-4 months and wow, yeah, they were right.

One of my favourite uses is bringing global and spatial context to news stories. Google Earth VR is fantastic for this. Simply being able to go to a place, even virtually, has this really remarkable effect on the way you understand stories, and connect them to other stories. This is due to the very different ways our brains encode spatial memories, as opposed to strictly visual memories. Once you’ve got a place-based component to your understanding, you have a much easier time absorbing retaining, and remembering everything else you learn about a topic. It’s amazing.

That phenomena is actually the basis for what I’m working on professionally, which is outreach programs for historical and culturally important sites. By giving people who haven’t visited these places in person the kinds of spatial memories shared by those who have, it becomes possible to expand the community of those who value a given place, who understand why it’s so important, and who are willing to put effort and resources into preservation.

What are your thoughts on VR and the creative process?

Let me start by narrowing that to the creative process used by film and television production, since that’s the one I know best. The biggest thing I’ve discovered is that you have to get your target audience involved a lot earlier than you would for a 2D medium. Partly, this is because immersive media doesn’t offer a century-plus of accumulated knowledge embedded in institutional structures, production tools, and so on. You can’t count on tried and true best practices to get you most of the way to a finished piece because at this stage, best practices are little more than well-educated guesses.

The other reason to make user testing an intrinsic part of the creative process is that audiences have so much more agency in immersive programs. Even game developers—who are used to having everything based on player input—have a ton of unfamiliar dynamics to manage when people are fully present in a scene, rather than interacting only via a controller and their thumbs. The more room you give people to surprise you, the more they will end up surprising you. This can be frustrating if you’re focused on a specific vision, so it’s helpful to remember that some of your most promising creative opportunities can come out of these unanticipated interactions. The sooner you can get a read, the better.

All this gets a lot easier if you recognize that the core of the medium isn’t what people see on a screen. The core is how they physically respond to events in three dimensional space. This is why it helps to get the basic physical interactions that are central to the experience prototyped and tested as early as you can, so you can use the feedback you get to determine the project’s final form.

This prototyping stage doesn’t need to be in VR, by the way. Some of the smartest studios I know rely heavily on brown-boxing, which is literally using cardboard boxes to work out where different elements should be placed in the space around users, and to make sure people can move around comfortably enough to enjoy the experience. Once that’s sorted, you can design the virtual experience on top of this real-world foundation.

What advice would you give teachers and students who are thinking about using VR for creative projects?

The first thing, and maybe most important thing to do is to experience as much of what’s already out there as you can. Paying close attention to what you do and don’t like should leave you with a general sense of direction.

One of the first things you’ll discover is that VR isn’t actually one technology so much as a bunch of different technologies that are being combined in new and interesting ways. These combinations are the source of a lot of excitement, but they can also be the source of a lot of frustration, especially since pipelines and interoperability standards are so nascent. As a friend of mine put it, in game development, everything takes three times longer than you think it will, and in VR, it takes three times longer than that. So do make a point of being kind to yourself. It’s very much a learning-by-doing effort, and you’re going to get it wrong, a lot. And don’t worry about feeling you don’t know everything about everything because you never will. It’s just too complex.

Eventually the field will deal with this complexity the same way that film and television production, and game development have. We’ll end up with armies of highly-specialised craftspeople who are deeply focused on specific details, and equipped with budgets and schedules to match. But at the moment, we’re nowhere close to that, and I suspect it’ll be many years before we are. For now, the field favours generalists. If this is attractive to you, the best thing is to start with something that seems super simple and purely exploratory, get others involved as early as you can, pay close attention to all the different ways they respond, then building the final product on whatever emerges. Keeping your mind open, especially at the outset, is going to be the most likely way to find your north star.

0

Blog at WordPress.com.

Up ↑