Audio
Using the smartphone hands-free
Talking Tech by
Vision Australia2 seasons
2 July 2024
14 mins
Low vision-assistive tech advice on hands-free smartphone use.
![The Arkon smartphone stand, spindly black gizmo with bendy neck and holder, side-on against a white background.](https://powered-media-prod.s3.ap-southeast-2.amazonaws.com/transformed/_bannerMedium/Arkon-smartphone-stand.jpg)
Vision Australia's Senior Adaptive Technology Consultant David Woodbridge talks with Stephen Jolley about latest technological developments from a blind and low vision perspective.
This edition, David notes:
Vision Store Product Minute: Arkon Smart Phone Desktop Stand. One of the main ways I can tell if a product I use is amazing, is if I keep using it over a number of years. Like the Arkon Smart phone Desktop Stand. I can put my smartphone at a range of heights, and positions. Whether I'm on a video call, demonstrating a product online, videoing a product demo or using the smartphone camera to do various things like OCR, this stand delivers what I need.
Smart AI Apps for use with Smart Phone Camera - both for Android and iOS.
Be My Eyes Assistant, Envision AI, Seeing AI
Camera for iOS gives scene info. Oddly, the Camera app on Android doesn’t have scene info.
Android
Look Out
Blind Shell Classic 2
Envision AI
IOS 18 VoiceOver Live Recognition: door detection, people, point and speak, text,
Obstacle Detecter app for checking distance of objects.
Summing Up: Challenge in using all of these solutions for smartphone, is using the device hands free, and still being able to control the apps.
Possible solutions: chest harness to hold phone in portrait mode, head set with mic for iOS voice control/listen to app, and a small keyboard that could be used with one hand: i.e. RIVO keyboard.
00:21 S1
Hello everyone. Welcome to Talking Tech. This edition available from July the 2nd, 2024. I'm Stephen Jolley. Great to have you with us listening maybe through Vision Australia Radio associated stations of RPH Australia or perhaps the Community Radio Network. There is also the podcast. To catch that, all you need to do is search for the two words talking tech and down. It can all come usually on a Tuesday afternoon just after it's been produced. Another option is to ask your Siri device or smart speaker to play Vision Australia Radio talking tech podcast Vision Australia Radio talking tech podcast.
With me, someone who can explain all this tech stuff really well. Vision Australia's national advisor on access technology, David Woodbridge. David, let's start with our Product Minute, a product from the vision store of Vision Australia.
01:11 S2
Indeed. So this is called the Arkon Desk Stand - and Arkon's actually [spells it]. It's an extremely adjustable stand for a smartphone. So you've got the base which is made out of metal. Then you've got this telescopic pole that actually extends out, I think, up to a metre if you pull it right out. Normally it's about 30cm. And then the arm that comes out which holds the smartphone, it's got these little articulated little arms that you can adjust in all different directions, because each little arm of which is three has got little ball joints. So you can sort of rotate them around. So in effect you can have your smartphone in any position you like, whether it's portrait, landscape, upside down, whatever you like.
So it's a really good stand for when you want to do things like video conferencing or optical character recognition and so on. My wife uses her one and her craft room on Facebook and so on. She uses it so that on her main laptop screen, on her Mac, she can see what she's doing on YouTube and Facebook, and then she just uses the camera on her smartphone to point down at what she's doing for crafting. So it does have multiple uses. It's a well known standard. It's been around for a long time, so if you're after a really good desktop, as in you put it on your table stand for a smartphone, it comes in really handy. So again, it's Arkon Desktop Smartphone Stand.
02:44 S1
How much does it cost?
02:45 S2
It's about $225. There is an attachment which we don't sell for an iPad, but you can always get them from a, you know, overseas or Amazon.
02:53 S1
The Arkon Desktop Stand from the Vision Store at Vision Australia. There was chatter last week about X. We used to call it Twitter. Its accessibility disappeared. It's come back. But tell us the story.
03:09 S2
This was actually quite bizarre. So early last week um, there was a shadow on Applevis saying, you know, you can't read tweets properly anymore. You only get the person who's tweeting his name or the handle, and you don't get anything else like the text of the actual tweet. So everybody started whinging about it and complaining about it on on Twitter, of course. And then everybody was thinking, I guess, or at least I wasn't like, Oh God, here we go again. It's going to be like this all over again. We're going to have to actually fight our battle. But lo and behold, 48 hours later...
So let's say from Wednesday to Friday last week, a new version popped up. So that was like a 0.01 release or whatever it was. And then the accessibility for VoiceOver came back. And again, I think it just said, you know, I release this for for bug fixes so you don't have to fix it, your typical sort of boilerplate statement. But it was fixed. So I don't know whether, you know, somebody saw it on Twitter and said, Oh dear, here's the blindness community rightly getting annoyed again. Or there's still some software engineers at Twitter or X, because remember when good old Elon Musk took over, he got rid of lots of people, including the accessibility team for Twitter X. So everybody thought, Well, here we go. This is going to be the End of Days as we know it.
But yeah, as I just said, lo and behold, it works again. So just make sure that your, your app is completely updated and then you should be fine with voice over again. But I think it was just remarkable about how fast that bug was fixed.
04:44 S1
So for those who use ECS, things are back to normal or as they were smart AI apps with the smartphone camera. Let's have a talk about that today. Explain what that is. And then we can go through the various products that are available.
05:02 S2
Yep. So you might remember last week we spoke about three main wearables. We spoke about AR, vision, OrCam and Envision AI. Now there's different sort of versions of that for your smartphone. So rather than wearing your, you know, your smart eye stuff, this stuff, as far as apps are concerned, are actually built into the smartphone, i.e. both Android and iPhone. So what we're really talking about is similar wearable hardware that is really apps running on your smartphone.
05:34 S1
Let's start then, with what's available through both iOS and Android.
05:40 S2
So the first one that I always love to mention, of course, is the Be My Eyes API function. And that's where you can take a photo. And for me it's a lot more extensive than these sort of automatic scene detection apps. This one really goes through extensively what it sees in the photo. And then of course, you can also interrogate and ask questions about the photo. It actually said my desk had coffee stains on it, which I was horrified by. So I went and quickly wiped it up. And then I ran it again and it said, Nope, nope. I didn't detect any coffee stains, so that was really good. But no, it actually does work really nicely. So, and as I said, for Be My Eyes, for both Android and iPhone, it works really nice. And also it's very, very quick.
06:26 S1
It's my go-to place for getting descriptions of photos.
06:30 S2
Yeah, absolutely. Same here.
S1
The next one, Envision I.
06:35 S2
Yeah. So this has the the similar functionality to what we talked about last week with the envision smart glasses. So you've got things like, you know, text detection, scene detection, currency detection, all that sort of normal stuff. It's a very robust app. Now, I also happen to see in a beta testing last week to there's a new one coming out besides the Envision AI app called Envision Assistant and what it is, it's a similar thing to what the Be My Eyes AI does. You take a photo and then you can use AI to interrogate the photo.
And I've been having a look at the Beta version of it, and it does work very nicely. And I think again, it's based on ChatGPT. So that's something else to look forward to, coming up in the next couple of months, or maybe even less.
07:25 S1
Tell us about seeing AI, which has been around a while.
07:28 S2
Yes. So this is a really famous one from Microsoft. And you'll remember that it does things like short text. So instant text, document reading, barcode scanning, scene detection, face detection, Handwriting detection. Color detection. Currency detection and also handwriting. So it does everything in the toolbox and actually works really well. So it does expand the functionality of both Android and iOS very dramatically. So that's almost my other one of my my favorite toolkit apps. When I'm talking about AI all the time.
08:02 S1
What about scene detection across both platforms?
08:06 S2
It really does get a bit wonky, because I think last week when we talked about the hardware, I did leave this to the end of the discussion when I was talking about all the features, because I did say scene detection is not robust enough. It's based on what the camera is seeing, it's based on light and everything else. And then it has to then, you know, put that image against other images that it's previously had a look at and then come out of result. And I always find it's about, oh, 85, 90% accurate.
But I noticed on an app that I haven't mentioned the program, it's not very stable. There was a warning on it. Please do not take the information that this app will give you as being true, because images are affected by lots of different processing issues. So I thought that was a really, really good warning and a good thing to keep in mind in general.
08:57 S1
And is that on both Android and iOS? Yes. Mhm. Tell us about an Android One called Lookout.
09:05 S2
So this is from Google itself. And it is almost like Google's versions of Microsoft Seeing AI app. So it basically does everything that their Seeing AI app does. Now there's one little thing that's a bit of an unknown feature in Seeing Eye that people might have forgotten about. You can say, I want to find something, and then you determine what you want to find, such as, you know, your keys and someone. So you're literally take a photo of your keys and then you say, These are my keys. And next time it's looking for your keys, it knows what your keys look like.
Well, there's sort of a similar version on the lookout app called Find, except it's a bit more generic. So when you say I want to find something, it brings up a list of things like door, chair, table, cup and so on. And then you choose one of those particular items so it knows it's got to look for a cup, and then it will tell you how far it's away when it sees that particular item, in this case a cup. So it's not as flexible as the CI1 where you can either choose generic ones or customise it, but it still works really well. So Lookout to me is, let's say 95% of what the AI app can do.
10:20 S1
Let's look forward to iOS 18, which comes to the public late September, probably. What have you been finding there with your Beta exploration?
10:32 S2
This stuff is actually pretty amazing what Apple is doing. So all the stuff I'm about to talk about was originally in the magnification app. It's now part of VoiceOver rotor, and the whole sort of menu on your radar is called Live Detection. And underneath live detection you've got things like door detection, scene detection, the point and speak function for using touch screens, people detection, and of course text detection. So what happens is you use the rotor to rotate around to life detection. You flick down to the one you want, such as door detection. You double tap it, it then turns it on.
But then what you've got is a four finger triple tap. That ten turns that voice detection on or off. So depending on what function you've got running in this case, you know, door or whatever else, it then only detects that particular function. The only one that's missing for me. And this is why I put it in the show notes for a list is object detection, where it actually uses the camera to tell you how far an object is away, whether it's in within, you know, arm's reach within about 1 or 2m away or further away. So I think if Apple added that to the live detection rater, they'd practically have everything covered.
And what I do find with the live detection very quickly is the scene detection on all these ones tends to babble a lot. So it keeps saying window blind, window blind, window blind, but because you can quickly toggle it on and off, you just turn it on when you want. As soon as you got the information you want, you turn it off again with that four finger triple tap and off you go. So it's getting very, very flexible in what VoiceOver can do in iOS 18 Beta.
12:17 S1
This is very nice, all this stuff, but ergonomically it can be a bit challenging. A lot of us walk along with only one hand available, because the other hand might be holding a cane or the harness of a dog. How do we get around this? Because you need to be able to manage the phone.
12:34 S2
The first thing is you've got to have a thing to put the phone in. So normally it's a chest harness. My chest harness that I've got for my smartphone does portrait. So up and down all landscape. So that's number one. Number two, which I haven't found to be that dramatically fantastic, is using voice control to use voice over to then navigate the smartphone screen and for iOS. So things like, you know, flick left flick right, magic double tap. That gets very laborious when you're trying to use an object recognition type app. The third one, which is what I always use on my one, is a little keyboard that I've had for a long time called the Revo Keyboard Revo. It's about the size of a credit card. Of course a little bit thicker because it's got keys on it and because I can use it one-handed.
All I really need to do with that keyboard is press four and six to go left and right. I press five to select and a few other little keys. So basically I can use about 5 or 6 keys to completely navigate voice over. Of course, the only thing it hasn't got for iOS beta yet is to turn that voice live recognition on and off toggle. But besides that, I can completely control my iPhone from this little keyboard.
13:46 S1
Well, there's a lot more with AI and the camera we'll talk about in the future, and I look forward to that. It's going to be interesting. Yep. Before we go, a reminder of where there are details of what we've been talking about in this and previous editions of the program.
14:00 S2
Indeed. So as always, you can check out my blog site which is David Woodbridge dot Podbean podbean Com.
14:06 S1
David Woodbridge Podbean podbean.com to write to the program.
14:12 S2
You can write to me at Vision Australia where I work, which is David Woodbridge - how it sounds - at Vision Australia dot org.
14:19 S1
davidwoodbridge@visionaustralia.org ... this has been Talking Tech, with me has been Vision Australia's national advisor on access technology David Woodbridge. I'm Stephen Jolley - take care. We'll talk more tech next week. See you.
Continue listening
Talking Tech looks at an accessible racing game, JAWS, Fusion, Zoomtext latest, the New Pixel Phone and Pixel Watch.
The New Pixel Phone
Talking Tech by Vision Australia
15 mins
Audio
The Royal Commission Report into Violence against People with a Disability; developments at Meta Connect; and more.
Meta Connect
Talking Tech by Vision Australia
15 mins
Audio
This episode covers: new Apple devices, iOS17, FaceTime integration with Apple TV, and more.
New Apple Devices and iOS17 Launch
Talking Tech by Vision Australia
15 mins
Audio
Apple Keynote event: iOS 17 - the main blind and low vision accessibility features.
Apple's iOS 17 Accessibility Features
Talking Tech by Vision Australia
15 mins
Audio
This episode: where to catch up with the new hardware announced by Apple in September 2023. And what exactly is Twit TV?
Catching up on Apple Keynote
Talking Tech by Vision Australia
15 mins
Audio
Warnings on the Deep Space Network, Space X launches iPhone Emergency SOS satellites, Nissan recycles car batteries, more.
Space X iPhone SOS Satellite Launch
Talking Tech by Vision Australia
15 mins
Audio
This edition: how the EU’S New Battery Rule could change your iPhone.
EU's New Battery Rule
Talking Tech by Vision Australia
15 mins
Audio
This episode: Be-My-Eyes AI Assistant; VO Starter for Teaching Voiceover on iOS is back; Mobile Phone 3D Screen Amplifier.
Be-My-Eyes AI Assistant Tech
Talking Tech by Vision Australia
15 mins
Audio
Assistive tech for people with low vision at home, school, work: VA Digital Access Assistive Tech Survey, Bindi Maps Navigation Survey.
Assistive Tech for Low Vision
Talking Tech by Vision Australia
14 mins
Audio
Latest assistive tech for home, school, and employment - for people who are blind.
Assistive Tech for People Who Are Blind
Talking Tech by Vision Australia
14 mins
Audio
This edition: Exploring Tech Webinar for accessing print, ASMR, MyNoise app, Now Shocks earbuds, new Samsung products.
Mindfulness - Intro to ASMR
Talking Tech by Vision Australia
14 mins
Audio
Talking Tech explores things you can still do offline - no Internet or wifi needed.
No Internet? No problem!
Talking Tech by Vision Australia
14 mins
Audio
Talking Tech looks at Monarch software, explores White Cane Safety Day, and more from the AT Guys.
Monarch, White Cane Day and AT Guys
Talking Tech by Vision Australia
17/10/2023
•15 mins
Audio
Some assistive tech we wish was still around or updated to suit today's tech.
I wish we still had this stuff...
Talking Tech by Vision Australia
24/10/2023
•14 mins
Audio
A non-scary from Apple, and latest moves to restrict kids' phone time.
Apple's tricky Hallowe'en treats
Talking Tech by Vision Australia
31/10/2023
•14 mins
Audio
We review new assistive Mac products, the Brailliant Bix, the All Terrain Cane and more!
All Terrain Cane
Talking Tech by Vision Australia
7/11/2023
•14 mins
Audio
We award 2023's Most Interesting Device - and more.
Most Interesting Device of 2023
Talking Tech by Vision Australia
14/11/2023
•14 mins
Audio
Assistive tech reviewed this week includes JAWS, Zoomtext and Fusion.
JAWS, Zoomtext and Fusion
Talking Tech by Vision Australia
21 November 2023
•14 mins
Audio
Latest in assistive tech for blind/low vision. This edition: Forza Motorsport Racing game and latest smartphone developments.
Motor racing game and smartphone developments
Talking Tech by Vision Australia
5/12/2023
•14 mins
Audio
Tech consultant David Woodbridge discusses latest blind-assistive tech including new O&M apps.
Interesting O&M apps to test listening and navigation skills
Talking Tech by Vision Australia
12 December 2023
•14 mins
Audio
Reviewing new assistive tech: iOS, Android, Mac, a telescopic cane and an online conference!
Telescopic canes, conferences and lots of new tech
Talking Tech by Vision Australia
19 December 2023
•14 mins
Audio
Vision Australia experts look at how Artificial Intelligence can best be used by blind/low vision people.
What is AI and how can I use it?
Talking Tech by Vision Australia
26 December 2023
•15 mins
Audio
Vision Australia tech expert reviews what worked well in 2023, and looks ahead to what 2024 promises.
2023 highlights and looking to 2024
Talking Tech by Vision Australia
2 January 2024
•15 mins
Audio
On World Braille Day, an update on latest assistive tech for people with blindness and low vision.
World Braille Day 2024
Talking Tech by Vision Australia
9 January 2024
•14 mins
Audio
New BLV-assistive smart glasses, cane, earplugs, radar and more are reviewed.
Smart glasses, canes, earplugs, radar and more
Talking Tech by Vision Australia
16 January 2024
•15 mins
Audio
Blind/low vision assistive tech expert reviews a screen reader survey and several new products.
New surveys, Braille, phones and more
Talking Tech by Vision Australia
23 January 2024
•15 mins
Audio
Vision Australia tech expert David Woodbridge runs though the assistive tech he uses personally.
Tech that I use myself
Talking Tech by Vision Australia
30 January 2024
•14 mins
Audio
Vision Australia's assistive tech expert reviews an industry conference and new tech from VA store and elsewhere.
ATIA Conference and more
Talking Tech by Vision Australia
6 February 2024
•15 mins
Audio
Blind-assistive tech expert discusses latest trends and products - and how we react to them.
AI, AR, VR and Grumpy Old Men
Talking Tech by Vision Australia
13 February 2024
•15 mins
Audio
Vision Australia's expert in blind-assistive tech reviews latest products from the Vision Store.
News from the Vision Store
Talking Tech by Vision Australia
20 February 2024
•15 mins
Audio
Blind-assistive technology expert reviews the Hable One, a new Braille keyboard, and more.
Hable One Braille keyboard and more
Talking Tech by Vision Australia
27 February 2024
•15 mins
Audio
Reviews of new blind-assistive tech including a colouring book, ear buds, echo pops and a speech-recognition mike.
Colouring books, earbuds and speech-recognition mikes
Talking Tech by Vision Australia
5 March 2024
•15 mins
Audio
Latest developments in blind-assistive technology, reviewed by a Vision Australia expert.
Code jumpers, JAWS, Braille puzzles and more
Talking Tech by Vision Australia
12 March 2024
•14 mins
Audio
Assistive tech expert's updates on Braille, stopwatch, Google, NBN and much more!
Braille labeller, stopwatch app, Google Gemini, NBN upgrade and more!
Talking Tech by Vision Australia
19 March 2024
•15 mins
Audio
Regular expert reviews a range of new blind-assistive tech developments - and a world conference.
Zoomax, Zoom H4 and zooming in on a world event
Talking Tech by Vision Australia
26 March 2024
•14 mins
Audio
Expert on blind-assistive tech updates digital clocks, wearables and more.
Clocks, conferences and wearables
Talking Tech by Vision Australia
2 April 2024
•14 mins
Audio
An expert discusses Artificial Intelligence and how it can help blind-low vision people.
AI
Studio 1 by Vision Australia
3 April 2024
•28 mins
Audio
Expert review latest blind-assistive technology including smart headphones and glasses.
Bone Conduction Headphones, BrailleDoodle, Smart Glasses and more
Talking Tech by Vision Australia
9 April 2024
•14 mins
Audio
Expert reviews new assistive tech including the Mini Guide Holder, various Microsoft and Apple updates.
Mini Guide Holder, MS and Apple updates
Talking Tech by Vision Australia
16 April 2024
•15 mins
Audio
Vision Australia expert reviews latest blind-assistive tech developments, including for better road safety.
Safer cars and connecting with the VA Library
Talking Tech by Vision Australia
23 April 2024
•15 mins
Audio
Assistive tech expert looks at AI, its use for blind/low vision people and relevant useful tech.
AI and its uses
Talking Tech by Vision Australia
30 April 2024
•14 mins
Audio
Vision Australia tech expert Sam Taylor discusses blind and low vision assistive tech developments.
Sam Taylor talks tech
Talking Tech by Vision Australia
7 May 2024
•15 mins
Audio
Tech expert updates on Apple, Sonos, Telstra, Braille pre-training and a big Awareness Day.
Global Accessibility Awareness Day and other news
Talking Tech by Vision Australia
14 May 2024
•15 mins
Audio
Latest blind-assistive tech including AI, Google, Apple and a world Braille conference
AI, GPT and NZ
Talking Tech by Vision Australia
21 May 2024
•15 mins
Audio
Vision Australia's expert reviews latest blind-assistive technology and opportunities.
A watch, a scholarship, an event... and more
Talking Tech by Vision Australia
28 May 2024
•15 mins
Audio
Expert reviews of latest blind-assistive tech - this week from Apple.
What's new with Apple
Talking Tech by Vision Australia
11 June 2024
•15 mins
Audio
Adaptive tech expert reviews latest developments for people with blindness and low vision.
OrCam, Apple, VoiceOver and much more
Talking Tech by Vision Australia
18 June 2024
•15 mins
Audio
Expert advice on blind and low vision-assistive tech - this week, wearable devices.
Wearable assistive devices
Talking Tech by Vision Australia
25 June 2024
•16 mins
Audio
Low vision-assistive tech advice on hands-free smartphone use.
Using the smartphone hands-free
Talking Tech by Vision Australia
2 July 2024
•14 mins
Audio
Expert reviews of new and developing technology to assist people with blindness and low vision.
Headbeams, bursary awards and more
Talking Tech by Vision Australia
9 July 2024
•15 mins
Audio
Expert reviews of blind and low vision-assistive events and products.
Accessible chat, info event and new product
Talkling Tech by Vision Australia
16 July 2024
•14 mins
Audio
Expert advice on a range of new tech to help people with blindness and low vision.
Tech for your eyes, avoiding obstacles, phoning one-handed and more
Talking Tech by Vision Australia
23 July 2024
•14 mins
Audio
Expert assistive tech reviews - this time Synapptic software for Android phone/tablet... and more
Synapptic for Android
Talking Tech by Vision Australia
30 July 2024
•15 mins
Audio
Latest low vision-assistive tech developments - expert news and reviews.
Big Purple Phone and David's podcast list
Talking Tech by Vision Australia
6 August 2024
•14 mins
Audio
More detail on the Big Purple Phone, with a special guest from the company.
More about the Big Purple Phone
Talking Tech by Vision Australia
13 August 2024
•15 mins
Audio
A recap of some major blind-assistive tech changes over the past three decades.
30 years of change in assistive tech
Talking Tech by Vision Australia
27 August 2024
•15 mins
Audio
Expert reviews of blind-assistive products from the Vision Store and elsewhere.
BT Speak, OrCam and the Toniebox
Talking Tech by Vision Australia
3 September 2024
•14 mins
Audio