Qt Documentation

Contents

Interactive Mobile Phone Example

Demonstrates using Qt Quick item as a texture with three.js.

This example demonstrates how to implement an application that uses Qt Quick 2D element as a texture in a three.js scene. The example shows a 3D model of a mobile phone with an UI implemented with Qt Quick. When the phone is not rotating, the UI can be interacted with.

Qt Quick Implementation

The Qt Quick Implementation main.qml of the example renders the 3D model of the mobile phone using Canvas3D type. The phone UI is composed of the textureSource Qt Quick item and its children. To make it possible to use the item as a texture source for Canvas3D, we must enable the layer of the item:

Item {
    id: textureSource
    layer.enabled: true
    layer.smooth: true
    layer.textureMirroring: ShaderEffectSource.NoMirroring
    ...

The texture mirroring is disabled so that the OpenGL texture generated from the item is oriented as the three.js expects.

The textureSource item is passed as a parameter to the JavaScript function handling the OpenGL initialization in Canvas3D:

onInitializeGL: GLCode.initializeGL(canvas3d, textureSource)

The texture generated from the textureSource is not interactable by itself, as it is just a regular texture. To make it appear interactable, we make it so that the phone UI is interactable only when the phone is not rotating and superimpose the actual textureSource item over the Canvas3D so that both the 3D model and the textureSource items are perfectly aligned. The 3D model and the Qt Quick UI are aligned by careful positioning of the model and scaling of the textureSource item using its transform property. The textureSource item is set fully transparent so that there are no visual artifacts:

transform: [
    Scale {
        origin.y: textureSource.height / 2
        origin.x: textureSource.width / 2
        yScale: 0.5 * mainView.height / mainView.initialHeight
        xScale: 0.5 * mainView.height / mainView.initialHeight
    }
]
opacity: 0.0

To ensure user cannot interact with the UI when the phone is rotating, we hide the textureSource item behind the Canvas3D by adjusting its z property when the phone starts its rotation animation.

The JavaScript Code

The JavaScript side of the implementation, cellphone.js, is done using a version of three.js that is ported for Qt Canvas 3D: three.js.

The initializeGL() method creates the scene. It also adds the lights and the camera to the scene and creates materials and meshes used in the scene. The part relevant to the main point of this example is how the textureSource is handled. It is very simple to create a texture from a Qt Quick texture source: simply create a new THREE.QtQuickItemTexture with the textureSource as a parameter and you are done:

var frontTexture = new THREE.QtQuickItemTexture( textureSource );

The texture created this way can be used as a map to a material just like a regular texture:

var frontMaterial = new THREE.MeshPhongMaterial( { map: frontTexture } );

The scene is rendered in paintGL() method, which simply adjusts the rotations of the phone meshes, repositions the camera and light, and renders the scene.

For more information on how to use three.js the documentation is available here: three.js/docs

The background sphere uses Pluto texture map, which is Copyright (c) by James Hastings-Trew http://planetpixelemporium.com/planets.html. Used with permission.

Files:

Images:

© 2019 The Qt Company Ltd. Documentation contributions included herein are the copyrights of their respective owners. The documentation provided herein is licensed under the terms of the GNU Free Documentation License version 1.3 as published by the Free Software Foundation. Qt and respective logos are trademarks of The Qt Company Ltd. in Finland and/or other countries worldwide. All other trademarks are property of their respective owners.