Publications
As a Research Scientist at Google, I devote to inventing future interactive technologies in 3D graphics, fusing the information from the physical and virtual worlds, and making it interactive, accessible, and useful in VR, AR, and MR. I have published over 20 peer-reviewed publications in top venues of HCI, Computer Graphics, and Computer Vision, including CHI, SIGGRAPH, UIST, TVCG, CVPR, ECCV, ISMAR, VR, I3D, Web3D, etc. Please feel free to search keywords / authors / journal / conference below or visit my Google Scholar for more details.
Peer-reviewed Publications [bibTeX]
DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality
Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST), 2020.
Keywords: depth map; interactive 3D graphics; real time; interaction; augmented reality; mobile AR; rendering; GPU; ARCore
Geollery: A Mixed Reality Social Media Platform
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures
Journal of Computer Graphics Techniques (JCGT), 2019.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields
Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: spatial-temporal virtual reality; social media; street view; geographical information systems; mixed reality; WebGL
Fusing Multimedia Data Into Dynamic Virtual Environments
Ph.D. Dissertation, Computer Science Department., University of Maryland, College Park., 2018.
Keywords: social street view, geollery, spherical harmonics, 360 video, multiview video, montage4d, haptics, cryptography
A Log-Rectilinear Transformation for Foveated 360-Degree Video Streaming
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021.
Keywords: 360° video, foveation, virtual reality, live video stream-ing, log-rectilinear, summed-area table
CollaboVR: A Reconfigurable Framework for Multi-User to Communicate in Virtual Reality
2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2020.
Keywords: chalktalk, virtual reality, collaborative work, layout, telepresence, communication
Experiencing Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality in DepthLab
Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST), 2020.
Keywords: depth map; interactive 3D graphics; real time; interaction; augmented reality; mobile AR; rendering; GPU; ARCore
MeteoVis: Visualizing Meteorological Events in Virtual Reality
Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA), 2020.
Keywords: scientific visualization, virtual reality, meteorological data, immersion, interactive visualization, vector field
Eye-Dominance-Guided Foveated Rendering
IEEE Transactions on Visualization and Computer Graphics (TVCG, Special Issue of IEEE Conference on Virtual Reality and 3D User Interfaces), 2020.
Keywords: virtual reality, foveated rendering, perception, gaze-contingent rendering, ocular dominance, eye tracking
ORC Layout: Adaptive GUI Layout With OR-Constraints
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: GUI builder, layout manager, constraint-based layout, visual interface design, visual programming
Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Social Media
Proceedings of the 24th International Conference on Web3D Technology (Web3D), 2019.
Keywords: virtual reality, mixed reality, 360° image, GIS, 3D reconstruction, projection mapping, mirrored world, social media, WebGL
Montage4D: Interactive Seamless Fusion of Multiview Video Textures
Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), 2018.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields
Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras
ACM Transactions on Accessible Computing (TACCESS), 2016.
Keywords: accessibility, real-time OCR, visual impairments, wearables
Video Fields: Fusing Multiple Surveillance Videos Into a Dynamic Virtual Environment
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: virtual reality; mixed-reality; video-based rendering; projection mapping; surveillance video; WebGL; WebVR
Experiencing a Mirrored World With Geotagged Social Media in Geollery
Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
Interactive Fusion of 360° Images for a Mirrored World
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: virtual reality, 360° image, 3D reconstruction, mixed reality, projection mapping, mirrored world
Tracking-Tolerent Visual Cryptography
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: visual cryptography, augmented reality (AR), tracking
VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality
Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2016.
Keywords: Virtual Reality; Tangible User Interface; Haptics; Gesture Recognition; Head-Mounted Display
AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden
Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2015.
Keywords: Visualization; Tangible Interactive Art; Machine Aesthetics; Calm Technology; XY Servo Table; Kinect
The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind
Computer Vision - ECCV 2014 Workshops (ECCVW), 2014.
Keywords: Accessibility, Wearables, Real-time OCR, Text Reading for Blind
Supporting Everyday Activities for Persons With Visual Impairments Through Computer Vision
Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS), 2015.
Keywords: Blind; visually impaired; wearable computing; computer vision; vision-augmented touch
Online Vigilance Analysis Combining Video and Electrooculography Features
Neural Information Processing - 19th International Conference (ICONIP), 2012.
Keywords: Vigilance Analysis Fatigue Detection Active Shape Model Electrooculography Support Vector Machine
Technical Reports
C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions
University of Maryland, College Park. Department of Computer Science, 2012.
Keywords: Information Visualization; Data Mapping; Indoor Visualization; Business; Usability Testing
Statistics for K-Mer Based Splicing Analysis
University of Maryland, College Park. Department of Computer Science, 2014.
UistViz: 26 Years of UIST Coauthor Network Visualization
University of Maryland, College Park. Department of Computer Science, 2013.
Keywords: Information Visualization; UIST; Coauthor Network; DBLP; NodeXL
Learning Depression Patterns From MyPersonality and Reddit
University of Maryland, College Park. Department of Computer Science, 2015.
Zero-Shot Learning Based Pedestrian Parsing
University of Maryland, College Park. Department of Computer Science, 2015.
Keywords: pedestrian parsing, zero-shot learning, segmentation
Deliberately Planning and Acting for Angry Birds With Refinement Methods
University of Maryland, College Park. Department of Computer Science, 2015.