The Quality and Usability Lab of TU Berlin analyses human interaction with technology in order to design optimum user experiences. Whereas we focused on 3D audio presentation techniques in the past, most of our current work addresses implications of interactive visual XR technology. In particular, we are interested in analyzing influencing factors on UX in XR, social aspects, as well as methods for measuring UX. The tour will show our lab spaces on the 15th floor of the TEL building of TU Berlin, and will highlight current research work.

The talk will provide an overview of the theoretical and practical basis of Mobile Brain/Body Imaging (MoBI) that uses mobile brain imaging modalities in combination with motion capture and other physiological recordings to investigate human brain activity in actively behaving participants. I will present experimental protocols using mobile multimodal data recordings combined with virtual reality to investigate the impact of movement on human brain activity. The results of a series of experiments reveal that the active behavior of human participants is fundamental for a better understanding of human brain function in real and virtual environents and showcases the importance of VR for designing new experimental protocols to investigate the human brain.

The REALITAETENLABOR offers a space for interdisciplinary and application-oriented augmented (AR) and virtual reality (VR) developments with a focus on eBusiness applications as well as interdisciplinary projects in cooperation with institutions and researchers from diverse disciplines. In the talk, we will illustrate how interdisciplinary XR (AR+VR) research can be accomplished based on the Design Science Research (DSR) paradigm on the example of VR applications for virtual exposure therapies and virtual archaeological deposits. After the presentation, you have the opportunity to experience the applications in the REALITAETENLABOR on the sixth floor of the TU Berlin main building.

Assistance systems for bicycles based on vehicle-to-vehicle or vehicle-to-everything (V2X) communication have the potential to prevent accidents and increase the perceived safety when cycling. To develop and test such systems efficiently and in a safe environment, we use an interactive cycling simulator called Virtual Cycling Environment (VCE). We give an insight into V2X communication, how it could be used in a bicycle context, how our VCE works and what experience we have gained with the simulation environment.

Enjoy the holidays!

Prof. Pablo Dornhege and Franziska Ritter present their research project "Im/material Theatre Spaces". Here, over the past 3 years, application-oriented research has been conducted into the potential of digital technologies such as virtual and augmented reality for the theater and event industry - whether as a tool for creative processes, as a knowledge space or as a place for new theatrical forms of performance. Around the topics of theater technology, architecture and stage space, we provide insights into prototypical showcases and present approaches for further research projects and cooperation opportunities. In addition, the newly founded Future Realities Lab at the Communication Design study program of HTW Berlin will be presented. In the future, topics related to virtual and hybrid-real cultural and knowledge spaces will be researched here.

Die fotorealistische Modellierung und Darstellung von Menschen ist für Virtual Reality (VR)-Umgebungen äußerst wichtig, da der menschliche Körper und das Gesicht sehr komplex sind und eine große Formvariabilität aufweisen, vor allem aber auch, weil Menschen sehr empfindlich darauf reagieren, Menschen zu betrachten. Außerdem spielt in VR-Umgebungen die Interaktivität eine wichtige Rolle. Mit reinen Computergrafikmodellen lassen sich zwar sehr realistische Menschenmodelle erstellen, doch ist es extrem rechenintensiv, mit diesen Modellen echten Fotorealismus zu erreichen. Daher wurden in den letzten Jahren mehr und mehr hybride Methoden vorgeschlagen. In diesem Vortrag geht es um die Erstellung hochwertiger animierbarer volumetrischer Videoinhalte von menschlichen Darbietungen. Jüngste Fortschritte im Bereich des Lernens menschlicher Bewegungen und des Aussehens, neuronales Rendering und implizites Funktionsrendering (z. B. NeRF) ermöglichen die Erstellung realistischer Darstellungen virtueller Menschen. Wir kombinieren diese Ansätze mit klassischen Modellen, um eine vollständige Kontrolle über die Körper- und Gesichtsanimation zu erhalten. Es werden verschiedene Konzepte vorgestellt, die von animierbaren volumetrischen Videos bis hin zu rein datengesteuerten Darstellungen reichen und die realistische Animation von virtuellen Menschen für verschiedene Anwendungen zum Ziel haben.

Tragen Chirurg*innen bald Datenbrillen im Operationssaal? Wie verändern die neuen Raumtechnologien der extended reality (XR) die auf Schnitten basierende medizinische Bildgebung? Wie lassen sich medizinische Arbeitsprozess digital anleiten und trainieren? Die Digitalisierung der Medizin ist die zentrale Herausforderung des Gesundheitssystems im laufenden Jahrzehnt. Im Bereich digitaler Bildgebungtechnologien erforscht die Charité – Universitätsmedizin Berlin neue Möglichkeiten der Diagnose und Therapie und untersucht die damit verbundenen Herausforderungen in Bezug auf die Wahrnehmung, Interpretation und Gestaltung von Bildern. Anhand konkreter Fallbeispiele gibt der Vortrag einen Einblick in die aktuelle Forschung und diskutiert grundlegende Prinzipien von XR im Hinblick darauf, was Nutzer*innen und Entwickler*innen medizinischer XR-Anwendungen heute wissen müssen.

Which system features contribute to user immersion? Does the system user feel immersed? Considering these questions when evaluating and developing extended reality systems is crucial. This talk discusses how we can evaluate extended reality technologies, which are often wrongly put on the same level and measured the same way. The focus is to create and establish evaluation tools for each technology and for the specific variables to be measured. In the Immersive Reality Lab, we evaluate and develop immersive technologies. Examples include gaming, mobile applications for iOS and Android, and healthcare technology. Currently, two projects demonstrate the wide range of applications for immersive media at the Immersive Reality Lab. The DIDYMOS-XR project uses artificial intelligence to create digital twins that update in real-time. The project MIA-PROM aims to make questionnaires' automatic administration more engaging and trustworthy using 3-D characters.

Delirium is the most frequent syndrome of acute brain dysfunction among patients treated in the intensive care unit (ICU). Up to 80% of patients are affected. More importantly, one-third of these patients suffer from persistent cognitive disabilities, which is also a substantial economic healthcare issue. As pharmacological approaches have failed to show benefits for patient outcomes, non-pharmacological strategies have come into focus. Emerging evidence is reshaping critical care medicine from paralyzed sedated patients to awake, non-sedated patients. Within an interdisciplinary project funded by the Federal Ministry of Economics, our research group at Charité developed a new and highly customizable light ceiling that allows individualized circadian lighting and parameterized visuals to be deployed at the patient's bedside. Parts of it have recently become the status of a medical device. As the first preliminary results are auspicious, we are now extending the development of therapies and exploring options, including XR technology. Beyond offering insights into these applications and ongoing research, our presentation offers opportunities for other research areas to engage and explore the potential of such technology in clinical care. Currently, we are establishing a laboratory that allows for different experiments outside clinical practice. For more information on this project visit https://cociwg.org & https://www.tu.berlin/tim/forschung/projekte

Das Human.VR.Lab erforscht die Schnittmenge von Mensch-Computer- und Mensch-Roboter-Interaktion durch verschiedene interdisziplinäre Themen. Dazu gehören die Untersuchung der gestenbasierten Interaktion mit humanoiden Robotern, die Bewegungsanalyse und Posenschätzung des Menschen, die Entwicklung von interaktionsbasierten Gehtechniken für virtuelle Umgebungen, die Untersuchung neuer haptischer Schnittstellen und die Zusammenarbeit mit der Charite bei innovativen virtuellen Therapieanwendungen. // The Human.VR.Lab explores the intersection of human-computer and human-robot interaction through various interdisciplinary topics. These include the study of gesture-based interaction with humanoid robots, human motion analysis and pose estimation, the development of interaction-based walking techniques for virtual environments, the examination of new haptic interfaces, and the collaboration with the Charite on innovative virtual therapy applications.

The Mixed Reality Design Lab of TU and UdK Berlin works on computer-aided design methods in the field of architecture, building physics, acoustics as well as in the field of art and design, and on the direct transfer of these designs into a sensory experience with techniques of virtual and augmented reality. The talk will give an insight into the computational framework that has been developed. Afterwards, some virtual environments from ongoing research projects will be shown.