osgVerse

Introduction

osgVerse, a complete 3D engine solution based on OpenSceneGraph.

Operating System	Compiler	Supported	Notes
Windows 11	Visual Studio 2017-2022
Windows 10	Visual Studio 2017-2022
Windows 10	Visual Studio 2015		Requires VS2015 Update-3
Windows 10	MSYS2 (GCC 10.2)
Windows 10	Intel Compiler 2023		cmake -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icx -GNinja ..
Windows 10 UWP
Ubuntu 18.04	GCC 7.5 (or later)
Debian 11.7.0	GCC 10.2 (or later)
Kylin v10	GCC 8.3 (or later)		Set VERSE_FIND_LEGACY_OPENGL to ON
NeoKylin v7	GCC 8.5 (built manually)		Must disable VERSE_USE_GLIBCXX11_ABI
Mac OS X
Android	WSL + NDK r20e (Clang)
IOS
WebAssmebly	WSL + Emscripten 3.1.44		Supports GLES2 (WebGL1) at present

Main Features (ongoing to v1.0)

• Supports from OSG 3.1.1 to the latest version, and GLSL 1.2 to 4.6, so to work with most hardware in the world.
• (PARTLY) Supports PBR-based rendering and deferred pipeline, with real-time shadowing and deferred lighting.
• (PARTLY) Supports physics simuation based on Bullet3/PhysX library, and character animation based on OZZ library.
• Supports complex model simplication, optimizing and tiling, and saving to OSGB format for better efficiency.
• Provides a LevelDB nosql plugin, for reading tiles from database rather than local folders.
• Provides a media streaming plugin, which supports pixel streaming through WebRTC / Websockets.
• Provides a scripting plugin, which supports scripting using OSGB serialization and changing to Restful-like format.
• Supports GL3 Core profile, as well as GLES2 / GLES3. Google Angel is also supported for future bridging uses.
• (PARTLY) Supports major desktop and mobile operating systems, including Windows, Linux, Mac OSX, Android and IOS.
• Supports major embedded devices with GPU supports, including ARM and RISC-V.
• Supports Emscripten / WASM compilation and works with WebGL 1/2 based browsers.
• Provides an initial visual scene editing tool, comparing with the famous Unity Editor.

Screenshots

• osgVerse_Viewer: PBR and deferred pipeline with Desktop GL
• osgVerse_ViewerWASM: PBR and deferred pipeline with WebGL 1.0, compiled from WASM
• osgVerse_JsCallerWASM: Scriptable osgb rendering with WebGL 1.0, compiled from WASM

Dependencies

1. Please use CMake 3.0 or higher version. (https://cmake.org/download/)
2. Please use a C++ compiler supporting C++ 14 at least.
3. OpenSceneGraph is always required for building osgVerse. (https://github.com/openscenegraph/OpenSceneGraph) Current project mainly depends on OSG 3.7.0, but can compile on OSG 3.1.1 or later versions.
4. Important dependencies:

• 4.1 SDL2 (https://github.com/libsdl-org/SDL)
• 4.2 Google Angle (https://github.com/google/angle)

5. Optional dependencies:

• 5.1 osgEarth 2.10.1 or later, for earth related applications and examples. (https://github.com/gwaldron/osgearth)
• 5.2 Bullet 3.17 or later, for physics support in osgVerseAnimation module and related examples. (https://github.com/bulletphysics/bullet3). Remember to enable INSTALL_LIBS (for correct installation) and USE_MSVC_RUNTIME_LIBRARY_DLL (for /MD flag) while compiling Bullet.
• 5.3 Entwine 2.0 or later, for EPT point cloud octree constructing. (https://github.com/connormanning/entwine)
• 5.4 Qt 5.5 or later, for Qt related applications and examples. (https://www.qt.io/licensing/open-source-lgpl-obligations)
• 5.5 ZLMediaKit (git version), for media streaming plugin. (https://github.com/ZLMediaKit/ZLMediaKit) Remember to uncheck the ENABLE_MSVC_MT option while compiling. To encode to H264 frame and pull to media server, you may also check ENABLE_X264 and add x264 (http://www.videolan.org/developers/x264.html) to ZLMediaKit.
• 5.6 OpenVDB 10.0 or later, for VDB point cloud and 3D image reader/writer plugin. (https://github.com/AcademySoftwareFoundation/openvdb)
• 5.7 libDraco 1.5 or later, for Draco mesh compression support in osgVerseReaderWriter library. (https://github.com/google/draco)

Supported Hardware

To use osgVerse libraries and applications, OpenGL version must be higher than 2.0. Both core profile and compatible profile will work. Our project uses the GLSL functionality, and supports from GLSL 120 to the latest GLSL version. Our project is already tested on graphics cards listed as below:

Graphics Card	OpenGL Version	Supported	Notes
NVIDIA RTX 30** Series	4.6 / GLSL 4.6
NVIDIA 10** Series	4.6 / GLSL 4.6
NVIDIA 1070 (Nouveau)	4.3 / GLSL 4.3		Display has broken problems with Nouveau driver
NVIDIA GT720	4.6 / GLSL 4.6		Current frame rate < 12fps
NVIDIA Quadro K2200	4.6 / GLSL 4.6
AMD Radeon RX5500
AMD Radeon (TM) Graphics	4.6 / GLSL 4.6		Current frame rate < 15fps
Intel UHD Graphics	4.6 / GLSL 4.6		Current frame rate ~= 30fps
MooreThreads S80, S2000	3.3 / GLSL 3.3		Enable VERSE_USE_MTT_DRIVER before solving driver problems
JingJia Micro JM7201
Zhaoxin C-960 (SIS)	3.2 / GLSL 1.5		Segment fault in osg::Texture at present
VirtualBox SVGA 3D	2.1 / GLSL 1.2		osgVerse_Test_Pipeline can work; standard can't

Modules

1. osgVersePipeline: modern rendering pipeline supporting PBR materials, realtime shadows, deferred lighting and effects.
2. osgVerseReaderWriter: full featured reader-writer support for FBX, GLTF and KTX formats, and for more later.
3. osgVerseAnimation: physics and character animation supports.
4. osgVerseModeling: model simplification pipeline, modeling operators, and computational geometry utilities
5. osgVerseUI: IMGUI based quick UI support, HTML based UI solution, and related utilities.
6. osgVerseScript: Scripting support based on OSG serialization functionalities.
7. TBD...

Applications

1. osgVerse_SceneEditor: a forward-looking scene editor for osgVerse scene & components.
2. osgVerse_Viewer: a single-camera viewer with modern rendering pipeline support.
3. osgVerse_ViewerComposite: a multi-camera (multi-view) viewer with modern rendering pipeline support.
4. osgVerse_ViewerGLES: an example demostrating how to integrate osgVerse with SDL2, mainly with GLES2/3.
5. osgVerse_EarthViewer: an example demostrating how to integrate osgVerse with osgEarth.
6. osgVerse_QtViewer: an example demostrating how to integrate osgVerse with Qt.
7. osgVerse_ViewerWASM (wasm/pbr_demo): an example of WASM, with modern rendering pipeline support.
8. osgVerse_JsCallerWASM (wasm/script_demo): an example of WASM, demostrating how to use OSGB scripts with JS.
9. TBD...

Tests and Examples

1. osgVerse_Test_ImGui: a quick test for demostrating the use of IMGUI in osg scene.
2. osgVerse_Test_Mesh_Process: a mesh process and topology builder example.
3. osgVerse_Test_Physics_Basic: a physics world example supporting rigid bodies & kinematics, requiring Bullet3.
4. osgVerse_Test_Shadow: a test for shadow algorithm debugging and optimizing.
5. osgVerse_Test_Pipeline: a program for simple cases and compatiblity tests of osgVerse pipeline.
6. osgVerse_Test_Pbr_Prerequisite: a quick utility to pre-compute global PBR textures and save them to IBL osgb files.
7. osgVerse_Test_Paging_Lod: a test for paged LOD file combination, optimization and transferring to levelDB.
8. osgVerse_Test_Point_Cloud: a test for point cloud viewing and manipulating.
9. osgVerse_Test_Media_Stream: a test for media streaming / pixel streaming, including server and pusher implementation.
10. osgVerse_Test_Restful_Server: a test for restful HTTP API, which is based on libhv.
11. osgVerse_Test_Scripting: a test for scripting implementation based on OSGB serialization format.
12. osgVerse_Test_Compressing: a test for KTX texture compression (DXT / ETC) and Draco geometry compressing.
13. osgVerse_Test_Thread: a test for using the Marl thread task scheduler along with osgViewer.
14. osgVerse_Test_Volume_Rendering: a test for different methods to implement volume rendering.
15. osgVerse_Test_Symbols: a test for displaying massive symbols with icons and texts.
16. osgVerse_Test_Tween_Animation: a test for tween animations, like path and data-driven animations.
17. Deprecated tests:

• osgVerse_Test_FastRtt: a quick test for using newly-introduced RTT draw callback.
• osgVerse_Test_Obb_KDop: a quick test for creating a model's obb/kdop bounding volume.
• osgVerse_Test_CubeRtt: a quick test for render-to-cubemap (6 faces) demonstaration.
• osgVerse_Test_Indirect_Draw: a demo program to demonstrate how to use indirect drawing of OpenGL 4.x.
• osgVerse_Test_Tesselation: a demo program to demonstrate how to use tessellation shaders of OpenGL 4.x.
• osgVerse_Test_MultiView_Shader: a test for using geometry shader to implement multi-view rendering.

OSG-style Plugins

1. osgdb_verse_ept: a plugin for massive point cloud paging and rendering based on Entwine.
2. osgdb_verse_fbx: a plugin with full-featured FBX format support.
3. osgdb_verse_gltf: a plugin with full-featured GLTF & GLB format support.
4. osgdb_verse_web: a plugin for HTTP and more web protocols, which may replace the curl plugin.
5. osgdb_verse_image: a plugin for reading common image formats like JPEG and PNG. It mainly works for WASM case.
6. osgdb_verse_leveldb: a plugin for reading/writing from LevelDB database.
7. osgdb_verse_ms: a plugin for reading/writing from media streaming protocols like RTSP/RTMP/WebRTC.
8. osgdb_verse_tiff: a plugin for reading/writing TIFF files, which supports 2D/3D tiff files.
9. osgdb_vese_tiles: a plugin for reading Cesium 3dtiles (.json) and Osgb files (metadata.xml, or just the root folder).
10. osgdb_verse_osgparticle: a plugin to wrap osgParticle classes for use in scene editor, mainly as an example for custom extensions.
11. osgdb_pbrlayout: a pseudo-plugin to change PBR textures' layout to osgVerse standard. It supports following options:

• Diffuse (D), Specular (S), Normal (N), Metallic (M), Roughness (R), Occlusion (O), Emissive (E), Ambient (A), Omitted (X)
• Every source texture is defined by a option character and a channel number (1-4), and separated with a ','.
• Example input: model.fbx.D4,M1R1X2,N3.pbrlayout (Tex0 = Diffuse x 4, Tex1 = Metallic+Roughness, Tex2 = Normal)
• All layouts will be converted to osgVerse standard: D4,N3,S4,O1R1M1,A3,E3

12. TBD...

Assets

1. models: 3D models for test use, mainly in GLTF format.
2. shaders: Shaders for osgVerse rendering pipeline use.
3. skyboxes: Skyboxes for test use, may be one HDR image or 6 cubemaps.
4. misc: Chinese IME CiKu files, font files, screenshots...
5. tests: Some test data

Prepare and build third-party libraries

1. By default, osgVerse will find third-party libraries as follows:

• OpenGL: from the system. Note that some Linux distributions (e.g., Qilin) should enable VERSE_FIND_LEGACY_OPENGL first.
• OpenSceneGraph: from environment variable $OSG_ROOT.
• SDL, Draco, Bullet, etc.: from CMake variable ${VERSE_3RDPARTY_PATH}, which is <osgverse_folder>/../Dependencies by default.
  • Actually path to find includes and libraries will be automatically set to '${VERSE_3RDPARTY_PATH}/'.
  • For x86/x64 build: is 'x86/x64'.
  • For Android build: is 'android'.
  • For MacOSX/IOS build: is 'apple/ios'.
  • For WebAssembly (WASM) build: is 'wasm'.
  • For Windows UWP build: is 'uwp'.

2. Build Draco:

• For WebAssembly (WASM):
  • export EMSCRIPTEN=<emsdk_folder>/upstream/emscripten
  • cmake -DCMAKE_TOOLCHAIN_FILE=$EMSCRIPTEN/cmake/Modules/Platform/Emscripten.cmake -DDRACO_WASM=ON -DDRACO_JS_GLUE=OFF -DCMAKE_INSTALL_PREFIX=<your_path>/Dependencies/wasm <draco_folder>
• See https://github.com/google/draco/blob/master/BUILDING.md for other platforms.

3. Build ZLMediaKit: TBD...
4. TBD...

Build from Source

0. Assume that osgVerse source code is already at <osgverse_folder>.
1. Desktop Windows / Linux

• Make sure you have a compiler environment (e.g., Visual Studio).
• Download and install CMake tool.
• Download OSG prebuilt libraries or build them from source, extracting to <osg_sdk_folder>.
• Declare an environment variable OSG_ROOT, to indicate OSG root directory:
  • (Windows) $ set OSG_ROOT=<osg_sdk_folder>
  • (Linux) $ export OSG_ROOT=<osg_sdk_folder>
• Run commands below in terminal:
  • $ cd <osgverse_folder>
  • $ mkdir build
  • $ cd build
  • $ cmake ..
  • $ cmake --build .
• You may also choose to use cmake-gui and set OSG related options in GUI mode.
• For UWP build:
  • First download Windows Store SDK or latest Windows 11 SDK (with VS2022).
  • Download Angle for UWP: https://www.nuget.org/packages/ANGLE.WindowsStore
  • Rename the .nuget file to .zip and extract it. Find libraries and include files there.
  • Build OSG for GLES2/GLES3 (Desktop / GoogleAngle). See herlps/osg_builder/README.md for details.
  • Run commands below in terminal:
    • $ cmake -G "Visual Studio 17 2022" -DCMAKE_SYSTEM_NAME=WindowsStore -DCMAKE_SYSTEM_VERSION="10.0" <osgverse_folder>

2. Desktop Mac OSX

• TBD...

3. Android

• TBD...

4. IOS

• TBD...

5. WebAssembly

• Download emsdk from https://emscripten.org/docs/getting_started/downloads.html, extracting to <emsdk_folder>.
• Update and activate emsdk as required at the page above.
• Download OSG source code and extract it to <osgverse_folder>/../OpenSceneGraph.
• Start a UNIX ternimal (under Windows, please install WSL v1 and start it).
• Run commands below in terminal:
  • $ cd <osgverse_folder>
  • $ ./Setup.sh <emsdk_folder>
• Select "3. WASM / OpenGL ES2" and starting building WASM at <osgverse_folder>/build/verse_wasm.
• Start an HTTPS server at <osgverse_folder>/build/verse_wasm/bin. See <osgverse_folder>/wasm/run_webserver.py as an example.
• Copy <osgverse_folder>/assets to the same root folder of the server, and enjoy our WebGL examples.

CMake options