Thursday, August 9, 2018

Seeing AI

Hi there. Anita here with you today. Accessible apps are becoming more and more common, and those of us who are blind and visually impaired are relying on them more and more. This week, we are going to explore the Seeing AI app.
Seeing Ai is from Microsoft. I hesitate to demo this app because most of you might already be familiar with it. But anyone new with it might enjoy this post along with anyone, like me, who has just discovered the color identifier channel. Practically all color identifiers I have used, including units specifically made for the purpose and apps do not do a good job at identifying color. One such unit I discovered that is very accurate is the one that comes with the Milestone, a sort of portable music player/recorder. And now, I present to you the one that is part of Seeing AI, and which is fairly accurate. 

Like all of the channels, the color channel has the menu, quick help, pause announcements, and channel preview  buttons. Some channels also have take picture buttons. To move to these buttons, simply flick left and right. Then double tap to activate a button, if using VoiceOver. When you take a picture or dive into the menu system, there is often a close button that you must double tap to reach the main screen again. 

What I like about Seeing AI is that it has a feature that causes it to automatically "see" what your camera is pointed at. If it does not, then I just touch the middle of the screen and it should work. So to figure out what color something is, navigate to the color channel by flicking right until you reach the channel selector  and then flick up.  Then just point your camera toward something. I tend to hold the phone about one or two inches above the surface of the item. If you are new to using your camera, I suggest you begin by learning where it is on your phone, a tip that helped me when I first began. If you hold your phone with the home button toward your tummy and the screen facing the ceiling, then the camera should be on its underside, at the opposite end of the home button, and in the right corner. Center the camera over your material or a printed page, if using a text channel. You might find it helpful to place the phone flat on a surface in front of you with the material beneath it. Place your elbows on the table, especially for reading text. Slowly lift your phone off the surface. This may help you with leveling the phone and with centering the camera. With practice, you will probably move away from this, but I still use it myself on occasion. If you find you still struggle, remember that the phone must be parallel with the material. If it slants, which it may do without your realizing it as a beginner, it will not see the whole page or perhaps any of it. Practice will help you, and finding someone who can help you with the feel of its position may be helpful as well. Note that any time you take a picture, you will need to double tap the close button to return to the main screen. 

Let's briefly return to the topic of color identification. Remember lighting plays a significant role in how well the identifier "sees", and thus,  can match the color with its database. Again, I will praise Seeing AI because it is doing good with different lighting, though brighter areas provide more accuracy. I highly recommend you test it by using items you already know the color of in different locations, lighting situations, and maybe even at different times of the day before you rely on it. And even then, you may find it isn't reliable for important color decisions. One negative I find is that it doesn't always agree with itself about the color of something. So ask someone with vision to play with it with you or ask someone the color of your "test" items. Have fun!

Now, I will briefly give you a tour of the rest of Seeing AI. When the app opens, you are in the Short Text channel. I love this channel. Use it to quickly read anything in print. It may not see all of the text. One time in a local pharmacy, I played with it and found it will be very useful for me in a store. If you flick all the way to the right, you can then flick up and down to the different channels. So if you do this  on short text, you must go up. 
You will land on the Document channel. This is one of the channels with the Take Picture choice. Use this channel to take a picture of text. If you hold the phone above the paper, the app will tell you to hold steady when it "sees" the page, which is nice because you know you aren't tilting it, and it will automatically snap the picture. Otherwise, double tap the Take Picture button. 

The next channel up is the product channel. Use it to identify products by their barcodes, for example, canned items, boxed items, CD's, bottles, and pretty much anything with a barcode on it. It is tricky to do this because you don't always know where the barcode is. If you find it, the app will cause a beeping sound, which gets faster the closer you are to the barcode, or so it claims. The beeping definitely means it sees a barcode. Barcodes are generally near the crease on a can. Ask someone with vision to show them to you so you can learn where they are. When searching for the barcode, I stand my phone on its end with the camera end closer to the ceiling and the home button end closer to the counter, if that makes sense. Again, it may be better to practice with someone's help at first.

Next is the person channel. Be warned; it may help you feel younger, but then again, it may tell you are much older and of the opposite gender, smiley. To use it, point it toward yourself or someone and flick left to the Take Picture button; then double tap. Be sure to ask before taking someone else's photo, and respect their decision. One neat thing about this channel is that you can teach it to recognize a person. To do this, flick left to Menu button. Double tap. Flick right to Face Recognition and double tap. This screen will provide you with an add button and also a list of recognizable people you have previously stored. Flick left and right to move among the choices. To add a new person's face, double tap add. Now, it will ask you to take three photos of the person. It recommends the person do this on their own. Follow the prompts, but after you take the pictures, I think it brings you to the screen where you type the person's name and then tap the save button. I cannot walk through it with you because I do not have anyone I can snap a photo of, except myself, but I already stored mine in there a while back. Anyhow, at any time, double tap the back or close button until you get back to the main screen, if you wish to cancel your choice.
It may automatically place  you here after adding your person. Now, if you point your phone toward them, it will call out their name the tell you where it sees them, for example, maybe straight in front of you.

Next, is the currency channel. Its purpose is obvious.
Next is scene preview. Instead of a person, you will take a picture of whatever is in front of you, and it will tell you what it thinks it sees. REMEMBER press the close button to return to the main screen.  

Next is color preview, which we have already discussed.

Next is handwriting preview. This is fun to play with, and can be accurate and useful.

Finally, there is the light channel. This provides tones to indicate how much light is present. I am not musically talented, but a very low tone seems to mean total darkness. I do have light perception, but if you don't, you may find this channel useful.

Outside Seeing AI, you can share photos with the app, and it  will describe them to you. To do this, just navigate to the share button and flick left or right until you hear "Recognize with Seeing AI", and then double tap. Flick left and right to hear the sceen preview and the description. If this choice is not available under share, then on the share screen, double tap more, the one all the way at the far right, and flick left or right until you hear "Recognize with Seeing AI." Double tap this choice to turn it on. Then, you should be set. I have not tried, but I think I heard somewhere it can also recognize PDF documents.

This is a basic overview of Seeing AI. To demo, I used my iPhone 7, version 11.4,  with Seeing AI version 2.2.0. It is a free app, and it is also an excellent app. I hope you choose to try it. And remember, I am saying iPhone because I am testing with my iPhone, but this app may also work with other devices.

Thank you for being with me today as we explored the Seeing AI app. If you have anything to share, comment below.

Faithful readers, you all have been awesome, and we really appreciate your loyalty over the months since this blog began. That is why it saddens us to say that after this month, we will no longer be posting on here. The blog and all its content will remain available to you, as well as our Facebook page, facebook.com/adkinsandwells. We hope you will come over there and join us.

There will be an interview this month on Thursday, Aug. 23, so be sure and come back for that. It will be our last post. If any you have questions, please feel free to get in touch, but we feel that we can no longer devote the time and effort that you deserve.


Until next time, be blessed.

No comments:

Post a Comment