Virtual butler Jarvis: Mark Zuckerberg seeks suggestions from Facebook users

In a video post, which features Mark, his wife Priscilla, his child Max and dog Beast, at their home, he showcases some uses of Jarvis and asks for more from the followers

Virtual butler Jarvis: Mark Zuckerberg seeks suggestions from Facebook users

Facebook CEO and co-founder Mark Zuckerberg started seeking suggestions from his followers to the virtual butler Jarvis more useful and multitasking.

In a video post, which features Mark, his wife Priscilla, his child Max and dog Beast, at their home, he showcases some uses of Jarvis and asks for more from the followers.

Jarvis, named after the character from Marvel Comics series Iron Man, can respond to text and voice commands and it could play music, run air conditioning, doors and other systems. It could recognise visitors start a toaster and even shoot t-shirts from a cannon in his closet.



In the video, it shows that Jarvis can make a decision like who to stoke next, like here it was Max.

However, Zuck needs more. To broaden the horizon of Jarvis' use beyond Mark's house, the experiment “could be a great foundation to build a new product,” he wrote.

Lack of internet-connected devices, scarcity of common standards for connected devices to communicate and challenges related to speech recognition and machine learning were all obstacles, he said. He added that challenges led to eureka moments.

There were adjustments made to make Jarvis recognise context in commands, which led to the system responding to less specific commands in a better fashion, such as asking the system to “play me some music”.

“I’ve found we use these more open-ended requests more frequently than more specific asks. No commercial products I know of do this today, and this seems like a big opportunity,” Zuckerberg wrote.

Making Jarvis proved humanity is “both closer and farther off” from an AI breakthrough than we imagine, he scribbled. Computers are improving by trying to pick up patterns, such as face recognition, but it is very hard to teach them new things, Zuckerberg said.

“Everything I did this year -- natural language, face recognition, speech recognition and so on -- are all variants of the same fundamental pattern recognition techniques,” he wrote. “But even if I spent 1,000 more hours, I probably wouldn’t be able to build a system that could learn completely new skills on its own.”

Meanwhile, Zuck posted another clip which shows the distress his wife had gone through when he was busy with the virtual butler.