Publications

I devote to inventing future interactive technologies in 3D graphics, fusing the information from the physical and virtual worlds, and making it interactive, accessible, and useful in VR, AR, and MR. My work has been published in CHI, SIGGRAPH Asia, ECCV, I3D, Web3D, etc. Please feel free to search keywords / authors / conference below or visit my Google Scholar for more details.


Peer-reviewed Publications [bibTeX]

teaser image of Geollery: A Mixed Reality Social Media Platform

Geollery: A Mixed Reality Social Media Platform

Ruofei Du, David Li, and Amitabh Varshney
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
teaser image of Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures

Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures

Journal of Computer Graphics Techniques (JCGT), 2019.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields

teaser image of Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media

Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media

Ruofei Du and Amitabh Varshney
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: spatial-temporal virtual reality; social media; street view; geographical information systems; mixed reality; WebGL
teaser image of Fusing Multimedia Data Into Dynamic Virtual Environments

Fusing Multimedia Data Into Dynamic Virtual Environments

Ruofei Du
Ph.D. Dissertation, Computer Science Department., University of Maryland, College Park., 2018.
Keywords: social street view, geollery, spherical harmonics, 360 video, multiview video, montage4d, haptics, cryptography
teaser image of 3D-Kernel Foveated Rendering for Light Fields

3D-Kernel Foveated Rendering for Light Fields

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2020.
Keywords: light field, foveated rendering, microscopic light field, eye tracking, visualization
teaser image of MeteoVis: Visualizing Meteorological Events in Virtual Reality

MeteoVis: Visualizing Meteorological Events in Virtual Reality

Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA), 2020.
Keywords: scientific visualization, virtual reality, meteorological data, immersion, interactive visualization, vector field

teaser image of Eye-Dominance-Guided Foveated Rendering

Eye-Dominance-Guided Foveated Rendering

IEEE Transactions on Visualization and Computer Graphics (TVCG, Special Issue of IEEE Conference on Virtual Reality and 3D User Interfaces), 2020.
Keywords: virtual reality, foveated rendering, perception, gaze-contingent rendering, ocular dominance, eye tracking
teaser image of Language-Based Colorization of Scene Sketches

Language-Based Colorization of Scene Sketches

ACM Transactions on Graphics (SIGGRAPH Asia), 2019.
Keywords: deep neural networks; image segmentation; language-based editing; scene sketch; sketch colorization
teaser image of ORC Layout: Adaptive GUI Layout With OR-Constraints

ORC Layout: Adaptive GUI Layout With OR-Constraints

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: GUI builder, layout manager, constraint-based layout, visual interface design, visual programming
teaser image of Kernel Foveated Rendering

Kernel Foveated Rendering

Proceedings of the ACM on Computer Graphics and Interactive Techniques (I3D), 2018.
Keywords: foveated rendering, perception, log-polar mapping, eye-tracking, virtual reality, head-mounted displays
teaser image of Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Social Media

Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Social Media

Ruofei Du, David Li, and Amitabh Varshney
Proceedings of the 24th International Conference on Web3D Technology (Web3D), 2019.
Keywords: virtual reality, mixed reality, 360° image, GIS, 3D reconstruction, projection mapping, mirrored world, social media, WebGL
teaser image of Montage4D: Interactive Seamless Fusion of Multiview Video Textures

Montage4D: Interactive Seamless Fusion of Multiview Video Textures

Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), 2018.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields

teaser image of SketchyScene: Richly-Annotated Scene Sketches

SketchyScene: Richly-Annotated Scene Sketches

European Conference on Computer Vision (ECCV), 2018.
Keywords: sketch dataset, scene sketch, sketch segmentation
teaser image of Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

ACM Transactions on Accessible Computing (TACCESS), 2016.
Keywords: accessibility, real-time OCR, visual impairments, wearables

teaser image of Video Fields: Fusing Multiple Surveillance Videos Into a Dynamic Virtual Environment

Video Fields: Fusing Multiple Surveillance Videos Into a Dynamic Virtual Environment

Ruofei Du, Sujal Bista, and Amitabh Varshney
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: virtual reality; mixed-reality; video-based rendering; projection mapping; surveillance video; WebGL; WebVR
teaser image of Experiencing a Mirrored World With Geotagged Social Media in Geollery

Experiencing a Mirrored World With Geotagged Social Media in Geollery

Ruofei Du, David Li, and Amitabh Varshney
Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
teaser image of Interactive Fusion of 360° Images for a Mirrored World

Interactive Fusion of 360° Images for a Mirrored World

Ruofei Du, David Li, and Amitabh Varshney
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: virtual reality, 360° image, 3D reconstruction, mixed reality, projection mapping, mirrored world
teaser image of Tracking-Tolerent Visual Cryptography

Tracking-Tolerent Visual Cryptography

Ruofei Du, Eric Lee, and Amitabh Varshney
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: visual cryptography, augmented reality (AR), tracking
teaser image of VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality

VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality

Ruofei Du and Liang He
Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2016.
Keywords: Virtual Reality; Tangible User Interface; Haptics; Gesture Recognition; Head-Mounted Display

teaser image of AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden

AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden

Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2015.
Keywords: Visualization; Tangible Interactive Art; Machine Aesthetics; Calm Technology; XY Servo Table; Kinect

teaser image of The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Computer Vision - ECCV 2014 Workshops (ECCVW), 2014.
Keywords: Accessibility, Wearables, Real-time OCR, Text Reading for Blind

teaser image of Supporting Everyday Activities for Persons With Visual Impairments Through Computer Vision

Supporting Everyday Activities for Persons With Visual Impairments Through Computer Vision

Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS), 2015.
Keywords: Blind; visually impaired; wearable computing; computer vision; vision-augmented touch


teaser image of Online Vigilance Analysis Combining Video and Electrooculography Features

Online Vigilance Analysis Combining Video and Electrooculography Features

Neural Information Processing - 19th International Conference (ICONIP), 2012.
Keywords: Vigilance Analysis Fatigue Detection Active Shape Model Electrooculography Support Vector Machine

Technical Reports

teaser image of DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality

DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality

Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST), 2020.
Keywords: depth map; interactive 3D graphics; real time; interaction; augmented reality; mobile AR; rendering; GPU; ARCore



teaser image of C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions

C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions

University of Maryland, College Park. Department of Computer Science, 2012.
Keywords: Information Visualization; Data Mapping; Indoor Visualization; Business; Usability Testing

teaser image of Statistics for K-Mer Based Splicing Analysis

Statistics for K-Mer Based Splicing Analysis

Ruofei Du, Hao Li, Hui Miao, and Shangfu Peng
University of Maryland, College Park. Department of Computer Science, 2014.
teaser image of UistViz: 26 Years of UIST Coauthor Network Visualization

UistViz: 26 Years of UIST Coauthor Network Visualization

Ruofei Du
University of Maryland, College Park. Department of Computer Science, 2013.
Keywords: Information Visualization; UIST; Coauthor Network; DBLP; NodeXL
teaser image of Learning Depression Patterns From MyPersonality and Reddit

Learning Depression Patterns From MyPersonality and Reddit

Weiwei Yang, Xuetong Sun, and Ruofei Du
University of Maryland, College Park. Department of Computer Science, 2015.
teaser image of Zero-Shot Learning Based Pedestrian Parsing

Zero-Shot Learning Based Pedestrian Parsing

Xiyang Dai, Ruofei Du, and Hao Zhou
University of Maryland, College Park. Department of Computer Science, 2015.
Keywords: pedestrian parsing, zero-shot learning, segmentation
teaser image of Deliberately Planning and Acting for Angry Birds With Refinement Methods

Deliberately Planning and Acting for Angry Birds With Refinement Methods

Ruofei Du, Zebao Gao, and Zheng Xu
University of Maryland, College Park. Department of Computer Science, 2015.

Stay In Touch