The purpose of Never Give It Back is to create an application enabling customers to try on clothes, using a webcam.
In 2014, Kinect 2.0 for Windows was released, and with it, upgraded facial recognition, motion tracking, and resolution. It also has improved tracking of the body and joints of users, joints being the vertices of the skeleton created by data from the infrared camera.
With the vastly improved Kinect 2.0, opportunities have arisen for new developments in industries previously untouched by this technology, though Kinect 2.0 development is currently done without significant development resources and only basic documentation.
Thus, the Never Give It Back team has partnered with Vente.privée.com to create a Windows Store application, which shall allow users to try on clothing virtually.
Upon launch, the Never Give It Back application is able to flexibly match the full screen size of the user's computer. The user can view a simple tutorial which explains Never Give It Back, or start trying on clothing. With the entirety of the screen in use, the user has the maximum amount of space to try on clothing and use the interface.
The application uses this space to integrate data input from the color camera, the infrared camera, and the depth sensor into a single visual frame. This primary objective of the project tracks the position all joints of a user and then places them on the color video stream of the user at the correct depth.
The joints' positions are continually updated, such that they will always be in the correct place on the video stream. With this information, Never Give It Back has the ability to put new objects (such as images of clothing) on the screen using the position of the user's joints. While simultaneously viewing the video stream, the user can use the interface displayed on the right.
This menu of buttons is created with XAML and accepts Kinect gestures. When pressed, the buttons activate appropriate sections of C# code to execute their actions, which can include displaying or hiding new menus, and displaying or hiding clothing on the video stream.
Never Give It Back is a good base for a virtual dressing room application. While it displays what the Kinect 2.0 is capable of and how it can be used to attach virtual clothing objects to a user, who in turn has the ability to manipulate those objects, it does not include realistic clothing objects.
As this technology is a recent development, there does not yet exist a simple system to create a 3D object from a real piece of clothing. In place of this, the Never Give It Back project sought to create its own 3D models and integrate those into the video stream, but this proved to be very time-consuming, and a separate type of work from the rest of the project.
If a new project were to be started with the creation of 3D models as its main body of work, that work could be easily combined with the current Never Give It Back application to create a much more realistic experience for the user.