Creating a rich web app by talking to my computer

Edited – In the video below, I demonstrate the latest addition to Phosphorus Five; The Magic Menu. Using the this module, I am able to speak plain English to my computer, and have the computer translate my phrases to computer code, saying things such as “add a paragraph”. At which point the computer adds a “p” HTML element/widget to my web app. The concept works by creating associations between Hyperlambda code and spoken phrases and words, which allows the computer to automatically create code, once some word or phrase is spoken.

I realise this might be difficult to believe in, but I am actually now capable of creating highly rich and interactive web apps, using exclusively my voice, to tell my computer what I want it to create on my behalf – At least in theory. Watch the video below for a demonstration …

Basically, what this implies, is that you can speak natural language to your computer, and have your computer create complex and rich web apps, as a result of understanding what your intentions are. The Magic Menu is a module for Phosphorus Five, and allows you to create your own voice commands, and also serves as a plain navbar, if you don’t want to use your voice, or don’t have a supporting browser. Read more about the Magic Menu here. Although, documentation could probably have been more emphasised.

Disclaimer

Speech recognition on the web is a highly experimental technology, and the speech parts of the Magic Menu only works in Google Chrome at the moment. However, since speech actually is just an option, and you can use the magic menu as a plain navigation menu – This is technology that is currently available for you to use, in your own web apps, today. This is not some obscure research technology, but something that’s available for all web developers, wanting to create web apps, using .Net and C#. Everything needed to get started is Open Source.

The Magic Menu also plugs automatically into all your existing Phosphorus Five apps, and hence allows you to use this type of navigation, in all the apps you create yourself in P5.

If you wish to try this out for yourself, you can check out the installation instructions at the project’s GitHub site. It requires Visual Studio, MySQL, in addition to optionally GnuPG to store PGP keys. If you want to try the source, instead of using the installation script, you must in addition to downloading Phosphorus Five itself, also make sure you’ve got Micro, Magic Menu and Hypereval installed. If you install it using the installation script, you’ll need to install both Hypereval and the Magic Menu through the bazar. You can find all relevant projects through my GitHub account.

Notice, for some odd reasons, Google Chrome refuses to accept speech recognition input, if you try it directly towards an IP address, instead of a domain. Although, the loopback (localhost) seems to work though.

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s