Blippbuilder Script

Import 3D models, including textures and animations, from existing 3rd-party authoring tools like 3D Studio Max, Blender, or Maya. Control them programmatically with simple JavaScript calls provided by the Blippar libraries.

In addition to animation imported from other 3D authoring tools, Blippbuilder Script also provides animation APIs that allow procedural and other specialized types of animation to be added via script. Some typical use includes (but is not limited to) animation of menus, buttons, and other UI elements.

Blippbuilder Script can track a number of faces within a camera view. There are 3 elements of face tracking that can be utilised:

1) Pose estimation - This calculates the overall position and orientation of a given face in a 3D space, this is the primary face tracking feature and can be used to position 'rigid' geometry onto a face.

2) Facial Feature Tracking - Face tracking detects 68 unique feature points on any given face. These feature points track the position of the face as it moves. These 68 points can be access through the JavaScript API or they can drive character rigged (soft body) geometry.

3) Expression Metrics - pick up facial expressions found with a face by using up to 40 distinct values to determine a different geometric facial state. Each expression describes a small part of a tracked face such as: how much the mouth is smiling, how open are the eyes or the position of the eyebrows. Metrics are separated for each side of the face (left or right) or can be combined into a single overall expression metric. These metrics can be used within the JavaScript API or they can be mapped onto geometry so the facial expressions can drive the animations of 3D geometry.

This allows developers to create features that utilise the user’s location via GPS and the compass. A developer can do single shot or continuous location tracking to accurately place the user with longitude and latitude readings (permission required from the user). Combined with reverse geocoding lookups the developer can get the current address of the user.

The Blippar JavaScript library monitors accelerometer and gyroscope sensors on mobile devices and provides an easy-to-use API for orienting your content in the real world using this data. Programmers can also access the sensor readings directly in order to implement their own algorithms. This allows you to include 360 gyro experiences.

BlippBuilder Script provides rich APIs to record the AR experience in real time. A developer can capture selfie reactions, selfie masks or just record your creation for social media sharing. Video is recorded as an MP4 asset, audio recording is done via OGG.

Video recording is quite flexible, video can be recorded at various resolutions e.g. 1080p, 720p, 360p, full screen resolution, half screen resolution), landscape or portrait, custom frame rates, variable duration, include the camera feed without the AR content or just audio.