1. Joined : Oct 2013
    Posts : 17,465
    64-bit Windows 10 Pro build 15014
       29 Jun 2016 #1

    How Microsoft researchers are moving beyond keyboard and mouse


    Kfir Karmon imagines a world in which a person putting together a presentation can add a quote or move an image with a flick of the wrist instead of a click of a mouse.

    Jamie Shotton envisions a future in which we can easily interact in virtual reality much like we do in actual reality, using our hands for small, sophisticated movements like picking up a tool, pushing a button or squeezing a soft object in front of us.

    And Hrvoje Benko sees a way in which those types of advances could be combined with simple physical objects, such as a few buttons on a piece of wood, to recreate complex, immersive simulators – replacing expensive hardware that people use today for those purposes.

    Microsoft researchers are looking at a number of ways in which technology can start to recognize detailed hand motion — and engineers can put those breakthroughs to use in a wide variety of fields.

    The ultimate goal: Allowing us to interact with technology in more natural ways than ever before.

    “How do we interact with things in the real world? Well, we pick them up, we touch them with our fingers, we manipulate them,” said Shotton, a principal researcher in computer vision at Microsoft’s Cambridge, UK, research lab. “We should be able to do exactly the same thing with virtual objects. We should be able to reach out and touch them.”

    This kind of technology is still evolving. But the computer scientists and engineers who are working on these projects say they believe they are on the cusp of making hand and gesture recognition tools practical enough for mainstream use, much like many people now use speech recognition to dictate texts or computer vision to recognize faces in photos.

    That’s a key step in Microsoft’s broader goal to provide more personal computing experiences by creating technology that can adapt to how people move, speak and see, rather than asking people to adapt to how computers work.

    “If we can make vision work reliably, speech work reliably and gesture work reliably, then people designing things like TVs, coffee machines or any of the Internet of Things gadgets will have a range of interaction possibilities,” said Andrew Fitzgibbon, a principal researcher with the computer vision group at the UK lab.

    That will be especially important as computing becomes more ubiquitous and increasingly anticipates our needs, as opposed to responding to our commands. To make these kinds of ambient computing systems truly work well, experts say, they must be able to combine all our senses, allowing us to easily communicate with gadgets using speech, vision and body language together – just like we do when communicating with each other...





    Read more: Talking with your hands: How Microsoft researchers are moving beyond keyboard and mouse - Next at Microsoft
      My System SpecsSystem Spec


  2. Joined : Oct 2013
    Covington, Louisiana
    Posts : 536
    Windows 10 Pro 64
       29 Jun 2016 #2

    Down here is Southern Louisiana us Cajuns use our hands a lot when talking. If we put our hands in our pockets our mouth stops working.

    We would drive a computer nuts if we get excited.

    Jim
      My System SpecsSystem Spec


  3. Joined : Jan 2016
    Posts : 53
    Windows 10
       12 Jul 2016 #3

    While I think that the idea of using gestures on a PC is pretty cool, and I do see some big things in the future for this kind of technology I don't think that it will ever come close to usefulness\ubiquity the keyboard\mouse interface.

    We've had consumer level motion technology for a while, from motion controllers on the WII to the leap motion. The technology has improved a lot over the years and it's being used for a lot of innovative things. We've also had industrial motion controllers that are a league ahead of the consumer devices. But there is one thing that they all have in common. You can't use them for extended periods of time because the precision movements require will make your arms feel like they are going to drop off after a while.

    When you're using a keyboard\mouse your forearms are supported, so it's easy to use them for 2-3 hours straight, but try using a leap motion for even simple tasks like browsing the web, and your arms will feel like led after a while.
      My System SpecsSystem Spec


  4. Joined : Oct 2014
    Posts : 1,454
    W10 Pro + W10 Preview
       12 Jul 2016 #4

    This technology is not new....Leap have been working on this for some considerable time.
    I bought the Leap Motion app and console at least a couple of years ago.
    All motion is done by hand movements hovering above the console, no need to use a keyboard, mouse or tablet.
      My System SpecsSystem Spec


  5. Joined : Jan 2016
    Posts : 53
    Windows 10
       12 Jul 2016 #5

    dencal said: View Post
    This technology is not new....Leap have been working on this for some considerable time.
    I bought the Leap Motion app and console at least a couple of years ago.
    All motion is done by hand movements hovering above the console, no need to use a keyboard, mouse or tablet.
    I toyed with the idea of getting one for digital painting, but at the end of the day the leap wasn't the right product for me as it's actually incredibly difficult to paint without having a solid surface to offer you resistance. Oh, and they make your arm feel like led after a while.
      My System SpecsSystem Spec


 


Similar Threads
Thread Forum
Solved Stop windows moving when moving the mouse to the edge of the sceen
Hi 10forums, I've been finding this hard to describe and search for so I'm just going to upload a .gif to illustrate my problem. 81615 I want to stop the window moving back onto the screen when the mouse is against the screen edge. Does...
General Support
Moving mouse off of a window has no effect
I'm having this problem on two Windows 10 computers, so I'm not sure if it's "intended", but here goes. When I mouse over a window, I can hover and get the normal tooltip. If I move the mouse off of the window where a hover action extends all the...
General Support
"Microsoft Mouse and keyboard center"
customizable buttons/keys don't work in programs which runs under the certain conditions of compatibility modes, or if program runs with administrative privilege... making administrative privilege to "itype.exe & ipoint.exe &...
Drivers and Hardware
Issues with typing and moving the mouse at the same time
So I just got this new Lenovo Flex3 computer, and it's totally awesome. But a huge problem that I can't figure out how to fix, and I know it's not actually how to fix, but I don't like it, I can't move the mouse using the trackpad while pressing...
Performance & Maintenance
Solved MS Keyboard and Mouse driver not working for left handed mouse
I use left handed mouse, and swapping left / buttons works OK. I also set the wheel button to be "double click". But the wheel button brings up the context menu instead of double click. If I change to right hand mouse, the wheel button gives double...
General Support
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd

All times are GMT -5. The time now is 16:34.
Find Us
Twitter Facebook Google+



Windows 10 Forums