Matterport 3D Tour Pros  |  Google Street View Pros  |  Real Estate Agents  |  3rd Party Service Providers
Should I buy a Camera? Quiz How Much to Start 3D Tour Business? Calculate How Much Can I Make as a Pro? Calculate Win More Listings? Calculate
View Map Full Screen
Last 30 Days: 62,737 Page Views | 11,381 Visitors | 84 New Members
WGAN Knowledge Base | Total Posts: 46,883  |  Total Topics: 6,467
3,862 WGAN Members in 108 Countries
We Get Around Network Forum
WGAN Training Academy (Learn more)
WGAN-TV Live at 5
@Metroplex360 Chris Hickman Show and Tell
BLK360 Imaging Laser Scanner Mashed-up with MP
VR

Matteport VR model featuring live chatbot4576

Tosolini
Productions
Tosolini private msg quote post Address this user
As we love R&D, we did a new little experiment. The video below is a proof of concept demonstrating how a Matterport OBJ mesh can be imported into Unity3D to create an environment that facilitates speech conversations with a chatbot. Because this is just a demo, we didn't do the extra effort to clean up the model (@dannybasting is the expert there!).

The program uses the Watson SDK to turn speech into text and that text is then routed through API.ai to return the correct response.



And the original 3D tour is:



Credits to our developer Kathleen Kamali to get this working.
Post 1 IP   flag post
GeorgeK private msg quote post Address this user
That is really cool.... Boy the places that this is going. Thank you for sharing.
Post 2 IP   flag post
Basic
Member
Naz private msg quote post Address this user
Awesome ..
Post 3 IP   flag post
Premium
Member
DannyBasting private msg quote post Address this user
Great job!

I've looked in to speech recognition myself briefly a while ago. While it seemed pretty straight forward to integrate it, I had to put it on hold though due to a lack of time.

Saying "change flooring material" for example, and have a material palette pop up in front of you in VR would be a great addition.

I may have to dive back in to it after reading your post, thanks for sharing

Danny
Post 4 IP   flag post
47398 4 4
destitute