Category: Uncategorised

This week I decided to play around with swift/reality-composer and reality kit to try to feel a bit comfortable using it to create the app. I think I’ll plan to play around a bit more to try more complex things to feel more comfortable

This was an image target AR application made using reality composer when the camera comes into view with the image target the 3d model pops up, I’ve also added some behaviours where once you tap the screen the 3d object hops.

this was coded in swift using reality kit, here I was just trying to figure out tap gestures, so once you tap the 3d object it changes colour.

Time management

SMART GOALS

Specific 

I want to make an app that uses AR to augment alphabet flashcards to help make learning the alphabet for kids have dyslexia more enjoyable and engaging and exciting. 

Where: In London 

How:  I want to make an app using swift, reality kit and blender that works on alphabet cards. 

When: June 6th 2023 

With whom: alone 

Measurable: In order to evaluate my progress I’ve created goals to be met weekly to ensure I keep track of my progress. I’ve ensured these goals are attainable but also small and simple goals to prevent me from being too overwhelmed with a task. 

Achievable: In order to make my goals achievable, I have been practising using swift, reality kit, experimenting with AR, and practising using blender to create 3D models to be used in the experience.

Relevant: Dyslexia is a very common learning disability and many children are faced with the challenges that dyslexia can bring.

Time-bound: 3 months 

At this point, I don’t think I can do a full MoSoCow analysis just yet as I am still thinking about how the AR experience will work and what should be prioritised but I know the Mo(Must have) section should contain

• user-friendly navigation.

This week I’d like to focus on user research and developing the AR experience more specifically how it will work

AR experience

so far

• The experience will be an AR image target application in which users will use alphabet cards.
• The experience will include visuals
• After trying out both unity and swift arkit I have decided to use arkit with reality composer, I’m also familiar with the Xcode interface, unlike unity so I feel a bit more comfortable using this software.

what to figure out

• How to make the experience benefiting for teachers and children with dyslexia ( for example simple and user-friendly UI )
• Should I make my own alphabet cards or use pre-existing ones ( I may go for the second option due to timing )
• How to make the experience simple but effective I do not want too many complex features within the experience due to timing as there are 24 letters to get through and also my own personal abilities.
• ipad or iphone an AR experience may be better on an Ipad however I do not own one so it would be hard to test out the experience so it may be best to stick with Iphone.

User Research

• creating personas
• creating scenarios and storyboards

Initial idea- while the initial idea has remained the same I don’t think I was very clear on what learning disability I was focusing on as learning disability is a broad spectrum, so after some reflection, I will focus on children who are dyslexic as I found some research on how children who are dyslexic struggle with alphabet memorisation, so the initial idea will probably be best suited for this user group.

children and dyslexia

• Alphabets and dyslexia

Multisensory teaching

After some research I found children who have dyslexia respond very well to multisensory teaching, this may involve visual and auditory teaching methods, the article showed such use of teaching can enhance memory and learning of written language, so visual and auditory aspects should be a key feature of the AR experience.

• multisensory teaching for dyslexia
• Multisensory Games for Dyslexic Children

How the alphabet is taught in schools to children with dyslexia

While I am still thinking about how the AR experience will look like /work I thought it would be interesting to view how the alphabet is taught in schools for children with dyslexia and build from this, in some ways similar to the app Herstorys in which it builds its AR experience around existing history books.

A method I found was the alphabet flashcards, which inspired the initial idea. Furthermore, children with dyslexia are taught using sounds, specifically Letter-sound correspondence: Teachers may teach children the sounds associated with each letter of the alphabet and how to blend those sounds together to form words, teachers may also use images /objects that are associated with the letter being taught and Mnemonic devices can be used to help children remember the letters of the alphabet. For example, a teacher might use a song or a rhyme to help children remember the order of the letters.

The initial idea – An app that augments Alphabet cards to help increase engagement with children with learning disabilities. ( however, I may change to include a story with the alphabet cards to incorporate an element of storytelling but I’m not sure yet may, have to develop this a bit more)

After my first meeting with ken, we discussed looking into some examples of AR apps and what

worked well. I found a couple that I really liked.

AR app examples

• Herstory I liked how simple the UI is, I think it is very easy to navigate and the use of AR here is very effective
• Sixty-two tales liked the incorporation of animations and how the 3d models fit with the story being told
• Augmented reality in education this is a document of examples by apple showcasing how AR can be used in education, many of the examples here work only on Ipads, so this might be a consideration as I think many schools use Ipads within their teaching
• Pokemon Go – thought it would also be interesting to look into pokemon go
• Skyview

AR in education (academic papers)

AR books and preschool children’s engagement

User groups/ Beneficiaries

The meeting also had me thinking about the user group for this app and I think I see this app being used by parents/guardians and teachers to teach children in preschool so ages between 3-5 years old.

Technology to use

my initial plan was to use swift arkit but I might look into using unity, not 100% sure yet on what I will use but I will look into both to decide what I’ll probably feel comfortable using.

Things to add to the report from the in-class lecture

In the lecture, Anna talked about how we should think about how our projects may tie in with the CCI social mission I believe my project ties in with

Digital inclusion – creating opportunities for marginalised people to access creative technologies.