Dev Depot: Headtrackr Provides Unique Possibilities For Motion Control

Microsoft’s Xbox Kinect, Nintendo Wii and Sony’s PlayStation Move all use motion-sensing game controllers to provide an added dimension of user engagement and “fun” to the game play of formerly thumb-bound fans, forced to use a hand-held game controller. Apple’s iPhone ushered in the widespread use of gesture controls, such as swiping or pinching and pulling a screen, as well as shaking the device to initiate software behaviors.

Now, forward looking web developers are moving beyond the mouse and keyboard to embrace innovative, sometimes “hands free” methods, of providing full user control over the computing and display environments.

Now, forward looking web developers are moving beyond the mouse and keyboard to embrace innovative, sometimes “hands free” methods, of providing full user control over the computing and display environments.

If this seems like the kind of cutting edge component that you would like to add to your website, then headtrackr (www.github.com/auduno/headtrackr/), a JavaScript library for real-time face tracking and head tracking via webcam, provides unique possibilities worthy of exploration.

Links from the depository provide additional information on the algorithms and tools, as well as the science behind the technology, providing for interesting further reading, such as the guide at https://dev.opera.com/articles/view/head-tracking-with-webrtc/.

The headtrackr script uses the WebRTC/getUserMedia standard, supporting browsers able to stream video and audio content directly from native devices, such as a webcam.

According to developer Audun Mathias Øygard, one rather exciting use for WebRTC is head tracking — detecting the movement of the user’s head (or other appendages) in relation to a webcam — which in turn allows developers to create gesture-based controls.

Øygard cites FaceKat (www.shinydemos.com/facekat/), an Opera 12 release demo employing head tracking as an example of the technology, noting that Opera 12 was the first desktop browser to support camera access via the getUserMedia API. There is also a video showcasing the technology at https://player.vimeo.com/video/44049736 that might give you an idea of its potential.

The demo and actual production examples are best when used with a laptop that has a builtin camera and a browser that has camera webRTC/getUserMedia support (you can see the overview of browsers supporting getUserMedia at https://caniuse.com/stream).

Better results are obtained when the user’s face is evenly lighted and looking ahead.

Using this technology is as simple as downloading the minified headtrackr.js library and including it on a webpage, just as with any other JavaScript, i.e. using HTML 5:

<script src=?headtrackr.js?></script>

To implement the script, the following code initiates the headtrackr using a video element to contain the mediastream and a canvas element to copy the videoframes to:

<canvas id=?inputCanvas? width=?320? height=?240? style=?display:none?></canvas>
<video id=?inputVideo? autoplay loop></video>
<script>
var videoInput = document.getElementById(?inputVideo?);
var canvasInput = document.getElementById(?inputCanvas?);
var htracker = new headtrackr.Tracker();
htracker.init(videoInput, canvasInput);
htracker.start();
</script>

Once the headtracker script is initiated, it will regularly generate the JavaScript events headtrackingEvent and facetrackingEvent on the relevant document, allowing coders to program various interactions between the site and its visitors, based on where they look.

“The event headtrackingEvent has the attributes x, y, z, which tells us the estimated position of the users head in relation to the center of the screen, in centimeters,” Øygard explains. “The event facetrackingEvent has the attributes x, y, width, height and angle, which tell us the estimated position and size of the face on the video.”

This allows users to either create an eventlistener to handle these events, or if using the three.js script, one of the pre-packaged controllers from this library could be used to create pseudo-3D images, also known as “head-coupled perspective” effects.

Related:  

Copyright © 2024 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More Articles

opinion

How to Halt Hackers as Fraud Attacks Rise

For hackers, it’s often a game of trial and error. Bad actors will perform enumeration and account testing, repeating the same test on a system to look for vulnerabilities — and if you are not equipped with the proper tools, your merchant account could be the next target.

Cathy Beardsley ·
profile

VerifyMy Seeks to Provide Frictionless Online Safety, Compliance Solutions

Before founding VerifyMy, Ryan Shaw was simply looking for an age verification solution for his previous business. The ones he found, however, were too expensive, too difficult to integrate with, or failed to take into account the needs of either the businesses implementing them or the end users who would be required to interact with them.

Alejandro Freixes ·
opinion

How Adult Website Operators Can Cash in on the 'Interchange' Class Action

The Payment Card Interchange Fee Settlement resulted from a landmark antitrust lawsuit involving Visa, Mastercard and several major banks. The case centered around the interchange fees charged to merchants for processing credit and debit card transactions. These fees are set by card networks and are paid by merchants to the banks that issue the cards.

Jonathan Corona ·
opinion

It's Time to Rock the Vote and Make Your Voice Heard

When I worked to defeat California’s Proposition 60 in 2016, our opposition campaign was outspent nearly 10 to 1. Nevertheless, our community came together and garnered enough support and awareness to defeat that harmful, misguided piece of proposed legislation — by more than a million votes.

Siouxsie Q ·
opinion

Staying Compliant to Avoid the Takedown Shakedown

Dealing with complaints is an everyday part of doing business — and a crucial one, since not dealing with them properly can haunt your business in multiple ways. Card brand regulations require every merchant doing business online to have in place a complaint process for reporting content that may be illegal or that violates the card brand rules.

Cathy Beardsley ·
profile

WIA Profile: Patricia Ucros

Born in Bogota, Colombia, Ucros graduated from college with a degree in education. She spent three years teaching third grade, which she enjoyed a lot, before heeding her father’s advice and moving to South Florida.

Women In Adult ·
opinion

Creating Payment Redundancies to Maximize Payout Uptime

During the global CrowdStrike outage that took place toward the end of July, a flawed software update brought air travel and electronic commerce to a grinding halt worldwide. This dramatically underscores the importance of having a backup plan in place for critical infrastructure.

Jonathan Corona ·
opinion

The Need for Minimal Friction in Age Verification Technology

In the adult sector, robust age assurance, comprised of age verification and age estimation methods, is critical to ensuring legal compliance with ever-evolving regulations, safeguarding minors from inappropriate content and protecting the privacy of adults wishing to view adult content.

Gavin Worrall ·
opinion

Account-to-Account Payments: The New Banking Disruptor?

So much of our industry relies upon Visa and Mastercard to support consumer payments — and with that reliance comes increased scrutiny by both brands. From a compliance perspective, the bar keeps getting raised until it feels like we end up spending half our time making sure we are compliant rather than growing our business.

Cathy Beardsley ·
profile

WIA Profile: Samantha Beatrice

Beatrice credits the sex positivity of Montreal for ultimately inspiring her to pursue work in adult entertainment. She had many friends working in the industry, from sex workers to production teams, so it felt like a natural fit and offered an opportunity to apply her marketing and social media savvy to support people she truly believes in and wants to see succeed.

Women In Adult ·
Show More