Dev Depot: Headtrackr Provides Unique Possibilities For Motion Control

Microsoft’s Xbox Kinect, Nintendo Wii and Sony’s PlayStation Move all use motion-sensing game controllers to provide an added dimension of user engagement and “fun” to the game play of formerly thumb-bound fans, forced to use a hand-held game controller. Apple’s iPhone ushered in the widespread use of gesture controls, such as swiping or pinching and pulling a screen, as well as shaking the device to initiate software behaviors.

Now, forward looking web developers are moving beyond the mouse and keyboard to embrace innovative, sometimes “hands free” methods, of providing full user control over the computing and display environments.

Now, forward looking web developers are moving beyond the mouse and keyboard to embrace innovative, sometimes “hands free” methods, of providing full user control over the computing and display environments.

If this seems like the kind of cutting edge component that you would like to add to your website, then headtrackr (www.github.com/auduno/headtrackr/), a JavaScript library for real-time face tracking and head tracking via webcam, provides unique possibilities worthy of exploration.

Links from the depository provide additional information on the algorithms and tools, as well as the science behind the technology, providing for interesting further reading, such as the guide at http://dev.opera.com/articles/view/head-tracking-with-webrtc/.

The headtrackr script uses the WebRTC/getUserMedia standard, supporting browsers able to stream video and audio content directly from native devices, such as a webcam.

According to developer Audun Mathias Øygard, one rather exciting use for WebRTC is head tracking — detecting the movement of the user’s head (or other appendages) in relation to a webcam — which in turn allows developers to create gesture-based controls.

Øygard cites FaceKat (www.shinydemos.com/facekat/), an Opera 12 release demo employing head tracking as an example of the technology, noting that Opera 12 was the first desktop browser to support camera access via the getUserMedia API. There is also a video showcasing the technology at http://player.vimeo.com/video/44049736 that might give you an idea of its potential.

The demo and actual production examples are best when used with a laptop that has a builtin camera and a browser that has camera webRTC/getUserMedia support (you can see the overview of browsers supporting getUserMedia at http://caniuse.com/stream).

Better results are obtained when the user’s face is evenly lighted and looking ahead.

Using this technology is as simple as downloading the minified headtrackr.js library and including it on a webpage, just as with any other JavaScript, i.e. using HTML 5:

<script src=?headtrackr.js?></script>

To implement the script, the following code initiates the headtrackr using a video element to contain the mediastream and a canvas element to copy the videoframes to:

<canvas id=?inputCanvas? width=?320? height=?240? style=?display:none?></canvas>
<video id=?inputVideo? autoplay loop></video>
<script>
var videoInput = document.getElementById(?inputVideo?);
var canvasInput = document.getElementById(?inputCanvas?);
var htracker = new headtrackr.Tracker();
htracker.init(videoInput, canvasInput);
htracker.start();
</script>

Once the headtracker script is initiated, it will regularly generate the JavaScript events headtrackingEvent and facetrackingEvent on the relevant document, allowing coders to program various interactions between the site and its visitors, based on where they look.

“The event headtrackingEvent has the attributes x, y, z, which tells us the estimated position of the users head in relation to the center of the screen, in centimeters,” Øygard explains. “The event facetrackingEvent has the attributes x, y, width, height and angle, which tell us the estimated position and size of the face on the video.”

This allows users to either create an eventlistener to handle these events, or if using the three.js script, one of the pre-packaged controllers from this library could be used to create pseudo-3D images, also known as “head-coupled perspective” effects.

Related:  

Copyright © 2024 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More Articles

opinion

To Cloud or Not to Cloud, That Is the Question

Let’s be honest. It just sounds way cooler to say your business is “in the cloud,” right? Buzzwords make everything sound chic and relevant. In fact, someone uninformed might even assume that any hosting that is not in the cloud is inferior. So what’s the truth?

Brad Mitchell ·
opinion

Upcoming Visa Price Changes to Registration, Transaction Fees

Visa is updating its fee structure. Effective April 1, both the card brand’s initial nonrefundable application fee and annual renewal fee will increase from $500 to $950. Visa is also introducing a fee of 10 cents for each transaction, and 10 basis points — 0.1% — on the payment volume of certain merchant accounts.

Jonathan Corona ·
opinion

Unpacking the New Digital Services Act

Do you hear the word “regulation” and get nervous? When it comes to the EU’s Digital Services Act (DSA), you shouldn’t worry. If you’re complying with the most up-to-date card brand regulations, you can breathe a sigh of relief.

Cathy Beardsley ·
opinion

The Perils of Relying on ChatGPT for Legal Advice

It surprised me how many people admitted that they had used ChatGPT or similar services either to draft legal documents or to provide legal advice. “Surprised” is probably an understatement of my reaction to learning about this, as “horrified” more accurately describes my emotional response.

Corey D. Silverstein ·
profile

WIA Profile: Holly Randall

If you’re one of the many regular listeners to Holly Randall’s celebrated podcast, you are already familiar with her charming intro spiel: “Hi, I’m Holly Randall and welcome to my podcast, ‘Holly Randall Unfiltered.’ This is the show about sex, the adult industry and the people in it.

Women In Adult ·
trends

What's Hot Now: Leading Content Players on Trending Genres, Monetization Strategies

The juggernaut creator economy hurtles along, fueled by ever-ascendant demand for personality-based authenticity and intimacy — yet any reports of the demise of the traditional paysite are greatly exaggerated.

Alejandro Freixes ·
opinion

An Ethical Approach to Global Tech Staffing

One thing my 24-year career as a technologist working to support the online adult entertainment industry has taught me about is the power of global staffing. Without a doubt, I have achieved significantly more business success as a direct result of hiring abroad.

Brad Mitchell ·
opinion

Finding the Right Payment Partner

Whenever I am talking with businesses that are just getting started, one particular question comes up a lot: “How do I get a merchant account?” It’s a simple question, but it has a complicated answer.

Jonathan Corona ·
opinion

The Taxman Cometh for Every Business

February may be the month of romance, but it is also a time when we need to think about something that inspires very little love: taxes. April is not far away, and the taxman is always waiting. This year, federal and most state income taxes are due Monday, April 15.

Cathy Beardsley ·
opinion

The Continuous Journey of Legal Compliance in Adult

The adult entertainment industry is teeming with opportunity but is also fraught with challenges, from anticipating consumer behavior to keeping up with technological innovation. The most labyrinthine of all challenges, however, is the world of legal compliance.

Corey D. Silverstein ·
Show More