Seba Visitor Guide — How to use the App.
Prototype —
A web app implements a personal guide to
the Asian art collection at the Princeton University Art Museum.
To try out the Prototype app offsite, you will need a PC (or another
phone) to simulate the exhibits at the museum.
Select one of exhibits below by clicking on it; it will expand and
represent the exhibit at the museum.
Currently, there are only ten exhibits for the Prototype.
Next, on your mobile phone, navigate to this site and click on
“Prototype”. On the app, press and hold
the yellow button labeled “Press to Scan”, frame the text description under the
exhibit image while keeping the button pressed.
Release the button when the text is framed. This tells the app that you wish to discuss
that exhibit. The app will audibly
describe the exhibit. On iOS, you may
need to press the “Press to hear” button below the description.
You can ask questions verbally by pressing and holding the “Press to
Talk” button. Release the button when
you are done speaking.
Introduction — read
about what it is.
Project Plan — What
next
Architecture — How it works
Text recognition – Scan image for text
Audio — Record and play back speech
Text to Speech — Multilanguage, but needs translation API
Speech to Text — Multilanguage