[Detail] [Paper]
We propose a three-stage architecture for metaverse announcers, which is designed to identify events, position cameras, and blend between shots. Based on the architecture, we introduce a Metaverse Announcer User Experience (MAUE) model to identify the factors affecting the users’ Quality of Experience (QoE) from a human-centered perspective. In addition, we implement MetaCast, a practical self-driven metaverse announcer in a university campus metaverse prototype, to conduct user studies for MAUE model. The experimental results have effectively achieved satisfactory announcer settings that align with the preferences of most users, encompassing parameters such as video transition rate, repetition rate, importance threshold value, and image composition.

CUHKSZ Metaverse
[Detail] [Paper]
CUHKSZ-Metaverse is a university campus prototype of a metaverse based on blockchain technology. Players can have a tour around the low poly style CUHK(SZ) campus here. The metaverse and the real world are interacting with each other all the time. Your physical position will determine the speed of acquiring tokens. And you can communicate with those “strangers” that locate in the same building as you in the metaverse. The main gameplay is based on the concept of UGC (User-Generated Content). Players can make voxel-style objects with the built-in editor; paint their pet cat freely by their imagination; sell their non-fungible tokens (NTF) in the marketplace to become rich. Your token and products are stored on your own blockchain address and become your digital assets.

Newbie at CUHK(SZ)
[Detail] [Code]
Newbie at CUHK(SZ) is a 3D game featuring a voxelized version of our campus. It is developed by the undergraduates of our laboratory for half a year. Through an open world based RPG story, the life of a freshman here is presented to the players. The player will explore the campus, communicate with the staff, and finish missions as a “newbie” of our university. During gameplay, the player will get familiar with the life and study in CUHK(SZ). The missions contain greetings from presidents and deans, interesting stories circulated among students, photography quests testing player’s eyesight, and so on. We hope that this game can help freshmen get used to the campus quickly and promote our university to the public.

APIC: Audiovisual Perception Integration Crowdsourcing Platform
[Detail] [Link] [Paper]
Audiovisual Perception Integration Crowdsourcing Platform (APIC) is a cloud-based crowdsourcing platform to understand the human perception of digital multimedia. Due to the network steam transmission fluctuation and hardware communication delay, the soundtrack may not be in sync with the picture. However, human perception is with the ability to infer the content source of the clips. Hence, extreme tiny mistiming can be corrected by perception unconscious. We want to further understand the role of perception in the audiovisual asynchrony. The platform provides asynchrony clips with kinds of contents and mistiming. Participants should adjust soundtracks until they feel the video is synchronized. We analyze the operation during adjusting and final synchronous point. A questionnaire is offered after experiment. We will also search the potential linkage between human culture background and the ability of audiovisual integration.

CryptoArcade: A Blockchain Empowered Cloud Gaming System
[Detail] [Paper]
CryptoArcade is a token-based cloud gaming system that employs blockchain-empowered cryptocurrency as a payment method for players using cloud gaming services. In CryptoArcade, the user purchases the token in advance and then consumes the token to start the service, then connected the service with the URL, just like the traditional physical arcade. By using cryptocurrency, CryptoArcade provides a transparent and resource-aware pricing method, it also enables a time-irrelevant silent payment on the floating price to protect users’ payment.

Rhythm Dungeon: A Blockchain-based Music Roguelike Game
[Detail] [Paper] [Code]
Rhythm Dungeon is a rhythm game that leverages the blockchain as a shared open database. During the gaming session, the player explores a roguelike dungeon by inputting specific sequences in time to music rhythm. By integrating smart contract to the game program, the enemies through the venture are generated from other games which share the identical blockchain. On the other hand, the player may upload their characters at the end of their journey, so that their own character may appear in other games and make an influence. Rhythm Dungeon is designed and implemented to show the potential of decentralized gaming experience, which utilizes the blockchain to provide asynchronous interactions among massive players.