Top

ABOUT TARS

DIRECTORS

Sean Banerjee
Associate Professor
Computer Science
CV | Scholar
Natasha Banerjee
Associate Professor
Computer Science
CV | Scholar

At the Terascale All-sensing Research Studio (TARS) at Wright State University, Dayton, OH, we perform research in human-driven artificial intelligence using capture and analysis of dense multi-person interactions in online and real-world environments. Our research spans computer vision, computer graphics, deep learning, human-robot interaction, virtual reality, and human-computer interaction.

We look for graduate and undergraduate students with excellent academic credentials, substantial project work in computer science and AI (at the graduate level) and a strong drive to perform research with us.

PUBLICATIONS

A. Megyeri, N. Wiederhold, M. Kyrarini, S. Banerjee, and N. K. Banerjee. GraspPC: Generating Diverse Hand Grasp Point Clouds on Objects. IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Pasadena, California, 2024.

A. Megyeri, S. Banerjee, M. Kyrarini, and N. K. Banerjee. Using Human-Human Handover Data to Analyze Giver and Receiver Timing Relationships During the Pre-Handover Phase. IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Pasadena, California, 2024.

M. Li, N. K. Banerjee, and S. Banerjee. Using Motion Forecasting for Behavior-Based Virtual Reality (VR) Authentication. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024. [Best Paper]

M. Duver, N. Wiederhold, M. Kyrarini, S. Banerjee, and N. K. Banerjee. VR-Hand-in-Hand: Using Virtual Reality (VR) Hand Tracking For Hand-Object Data Annotation. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024. [Best Demo]

J. Minnekanti, N. K. Banerjee, and S. Banerjee. ClassesInVR: An Immersive VR-Based Classroom. VR-Hand-in-Hand: Using Virtual Reality (VR) Hand Tracking For Hand-Object Data Annotation. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024.

M. White, A. Kupin, S. Inzerillo, N. K. Banerjee, and S. Banerjee. Evaluating the Effectiveness of VR Classrooms as a Replacement for Traditional Asynchronous Video-based Learning Environments. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024.

E. Matzek, T. Yankee, O. Kohler, T. Lipke-Perry, N. K. Banerjee, and S. Banerjee. VRmonic: A VR Piano Playing Form Trainer. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024.

M. White, N. K. Banerjee, and S. Banerjee. VRcabulary: A VR Environment for Reinforced Language Learning via Multi-Modular Design. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024.

M. Li, N. Zafar, N. K. Banerjee, and S. Banerjee. Evaluating Deep Networks for Detecting User Familiarity with VR from Hand Interactions. IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR), Los Angeles, California, 2024.

N. Wiederhold, A. Megyeri, D. Paris, S. Banerjee, and N. K. Banerjee. HOH: Markerless Multimodal Human-Object-Human Handover Dataset with Large Object Count. Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, New Orleans, Louisiana.

[Webpage] [Paper]

N. Lamb, B. Molloy, C. Palmer, S. Banerjee, and N. K. Banerjee (2023). Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterparts. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, Canada.

[Webpage] [Paper] [Video]

N. Wiederhold, M. Li, N. Lamb, D. Paris, A. Tulskie, S. Banerjee, and N. K. Banerjee (2023). Studying How Object Handoff Orientations Relate to Subject Preferences on Handover. IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO), Berlin, Germany.

[Paper] [Video]

G. Kaur, S. Banerjee, and N. K. Banerjee (2023). Perception of Human-Robot Collaboration Across Countries and Job Domains. IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO), Berlin, Germany.

[Paper]

G. Kaur, S. Banerjee, and N. K. Banerjee (2023). Studying Worker Perceptions on Safety, Autonomy, and Job Security in Human-Robot Collaboration. International Conference on Automation, Robotics and Applications (ICARA), Abu Dhabi, UAE

[Paper]

X. Song, N. Lamb, S. Banerjee, and N. K. Banerjee (2023). Reinforcement-Learning Based Robotic Assembly of Fractured Objects Using Visual and Tactile Information. International Conference on Automation, Robotics and Applications (ICARA), Abu Dhabi, UAE

[Paper]

N. Lamb, S. Banerjee, and N. K. Banerjee (2022). DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair. SIGGRAPH Asia.

[Paper] [Video] [Code]

N. Lamb, S. Banerjee, and N. K. Banerjee (2022). DeepMend: Learning Occupancy Functions to Represent Shape for Repair. European Conference on Computer Vision (ECCV).

[Paper] [Video] [Code]

N. Lamb, S. Banerjee, and N. K. Banerjee (2022). MendNet: Restoration of Fractured Shapes Using Learned Occupancy Functions. Computer Graphics Forum (CGF, Proc. Symposium on Computer Graphics, SGP).

[Paper] [Video] [Code]

J. Judge, P. R. K. Prosun, O. Talmage, A. Dykeman, S. Banerjee, and N. K. Banerjee (2022). Predicting Weight and Strenuousness from High-Speed Videos of Subjects Attempting Lift. IEEE Conference on Connected Health: Applications, Systems, and Engineering Technologies (CHASE).

[Paper]

A. Dykeman, J. Judge, P. R. K. Prosun, G. Kaur, O. Talmage, S. Banerjee, and N. K. Banerjee (2022). Post-Lift Analysis of Thermal Imprint for Weight and Effort Detection. IEEE Conference on Connected Health: Applications, Systems, and Engineering Technologies (CHASE). [Best Student Paper Runner Up]

[Paper]

R. Turner, N. K. Banerjee, and S. Banerjee (2022). Using Video Motion Vectors for Structure from Motion 3D Reconstruction. International Conference on Signal Processing and Multimedia Applications (SIGMAP). [Best Paper]

[Paper]

R. Miller, N. K. Banerjee, and S. Banerjee (2022). Combining Real-World Constraints on User Behavior with Deep Neural Networks for Virtual Reality (VR) Biometrics. IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR). [Best Paper Honorable Mention]

[Paper] [Video] [Code]

R. Miller, N. K. Banerjee, and S. Banerjee (2022). Temporal Effects in Motion Behavior for Virtual Reality (VR) Biometrics. IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR).

[Paper] [Video] [Code]

R. Miller, N. K. Banerjee, and S. Banerjee (2022). Using External Video to Attack Behavior-Based Security Mechanisms in Virtual Reality (VR). IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR).

[Paper] [Video] [Code]

N. Lamb, N. Wiederhold, B. Lamb, S. Banerjee, and N. K. Banerjee (2021). Using Learned Visual and Geometric Features to Retrieve Complete 3D Proxies for Broken Objects. ACM Symposium on Computational Fabrication (SCF).

[Paper] [Code]

R. Miller, N. K. Banerjee, and S. Banerjee (2021). Using Siamese Neural Networks to Perform Cross-System Behavioral Authentication in Virtual Reality. IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR).

[Paper]

R. Miller, N. K. Banerjee, and S. Banerjee (2020). Within-System and Cross-System Behavior-Based Biometric Authentication in Virtual Reality. IEEE Conference on Virtual Reality and 3D User Interfaces Workshops (VRW), Atlanta, Georgia.

[Paper]

J. Gately, Y. Liang, M. K. Wright, N. K. Banerjee, S. Banerjee, and S. Dey (2020). Automatic Material Classification Using Thermal Finger Impression. International Conference on Multimedia Modeling (MMM), Daejeon, Korea.

[Paper]

R. Miller, A. Ajit, N. K. Banerjee, and S. Banerjee (2019). Realtime Behavior-Based Continual Authentication of Users in Virtual Reality Environments. IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), San Diego, California.

[Paper] [Video]

D. Gwinn, J. Helmick, N. K. Banerjee, and S. Banerjee (2019). Comparison of Traditional and Constrained Recursive Clustering Approaches for Generating Optimal Census Block Group Clusters. Communications in Computer and Information Science.

[Paper]

A. Ajit, N. K. Banerjee, and S. Banerjee (2019). Combining Pairwise Feature Matches from Device Trajectories for Biometric Authentication in Virtual Reality Environments. IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), San Diego, California [Best Student Paper].

[Paper]

N. Lamb, S. Banerjee, and N. K. Banerjee (2019). Automated Reconstruction of Smoothly Joining 3D Printed Restorations to Fix Broken Objects. ACM Symposium on Computational Fabrication (SCF), Pittsburgh, Pennsylvania.

[Paper] [Presentation] [Video]

Y. Jiang, S. Banerjee, and N. K. Banerjee (2019). Predicting Human Grasp Locations on Cup Handles by Using Deep Neural Networks to Infer Heat Signatures from Depth Data. IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Shanghai, China.

[Paper]

J. Ryan, S. Inzerillo, J. Helmick, A. Boolani, N. K. Banerjee, and S. Banerjee (2019). Predicting If Older Adults Perform Cognitive Tasks Using Body Joint Movements From RGB-D Videos. The Eleventh International Conference on eHealth, Telemedicine, and Social Medicine (eTELEMED), Athens, Greece.

[Paper]

A. Kupin, B. Moeller, N. K. Banerjee, and S. Banerjee (2019). Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece [Best Paper Candidate].

[Paper]

Y. Jiang, E. Schenck, S. Kranz, S. Banerjee, and N. K. Banerjee (2019). CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece.

[Paper]

Y. Jiang, M. Luo, S. Banerjee, and N. K. Banerjee (2018). When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos. IEEE Intl. Conf. on Multimedia and Expo Workshops (ICMEW), San Diego, CA.

[Paper]

T. Dunn, S. Banerjee, and N. K. Banerjee (2018). User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction. International Workshop on Multimedia Signal Processing (MMSP), Vancouver, Canada [Top 5% Paper Award].

[Paper]

Y. Jiang, D. Russell, T. Godisart, N. K. Banerjee, and S. Banerjee (2018). Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture. IEEE International Conference on Multimedia and Expo (ICME), San Diego, California.

[Paper]

L. Guo, H. Quant, N. Lamb, B. Lowit, N. K. Banerjee, and S. Banerjee (2018). Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[Paper] [Video]

L. Guo, H. Quant, N. Lamb, B. Lowit, S. Banerjee, and N. K. Banerjee (2018). Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[Paper]

N. Lamb, N. K. Banerjee, and S. Banerjee (2018). Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects. Intl. Conf. on Multimedia Modeling (MMM), Bangkok, Thailand.

[Paper] [Video]

H. Quant, S. Banerjee, and N. K. Banerjee (2018). A virtual reality interface for interactions with spatiotemporal 3D data. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[Paper] [Video]

D. Gwinn, J. Helmick, N. K. Banerjee, and S. Banerjee (2018). Optimal Estimation of Census Block Group Clusters to Improve the Computational Efficiency of Drive Time Calculations. Intl. Conf. on Geographical Information Systems Theory, Applications and Management (GISTAM), Madeira, Portugal.

[Paper]

T. Dunn, N. K. Banerjee, and S. Banerjee (2016). GPU acceleration of document similarity measures for automated bug triaging. International Workshop on Software Faults (co-located with IEEE International Symposium on Software Reliability Engineering, ISSRE), Ottawa, Canada.

[Paper]

AWARDS

Best Paper Award at 2024 IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR)

Best Demo Award at 2024 IEEE International Conference on Artificial Intelligence & extended and Virtual Reality (AIxVR)

Clarkson Technology Showcase & Competition, Audience Choice in Promising Tech Category, 2022

Best Student Paper Runner Up at 2022 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE)

Best Paper at 2022 International Conference on Signal Processing and Multimedia Applications (SIGMAP)

Best Paper Honorable Mention at 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR)

Best Student Paper at 2019 International Conference on Artificial Intelligence & Virtual Reality (AIVR)

Best Paper Candidate at 2019 International Conference on Multimedia Modeling (MMM)

Top 5% Paper Award at 2018 Multimedia Signal Processing Workshop (MMSP)

WORKSHOPS & TUTORIALS

PEOPLE

Sean Banerjee
Associate Professor
Computer Science & Engineering
Wright State University
Natasha Banerjee
Associate Professor
Computer Science & Engineering
Wright State University

PhD STUDENTS

Ava Megyeri
Computer Science & Engineering
Wright State University
Ethan Matzek
Computer Science & Engineering
Wright State University
Xinchao Song
Computer Science
Clarkson University
Mingjun Li
Computer Science
Clarkson University
Yu Liu
Computer Science
Clarkson University

GRADUATE ALUMNI

Nikolas Lamb
Computer Science
Noah Wiederhold
Computer Science
Clarkson University
Gurpreet Kaur
Computer Science
Clarkson University
Richard Turner
Computer Science
Clarkson University
Owen Talmage (MS)
Computer Science
Clarkson University
Austin Dykeman (MS)
Computer Science
Clarkson University
Robert Miller (PhD)
Computer Science
Clarkson University
Yijun Jiang (PhD)
Computer Science
Clarkson University
Damon Gwinn (MS)
Computer Science
Clarkson University
Marc Bishop (MS)
Computer Science
Clarkson University
Miao Luo (MS)
Computer Science
Lintao Guo (MS)
Computer Science
Clarkson University
DiMaggio Paris (MS)
Computer Science
Clarkson University
Alex Kupin (MS)
Computer Science
Clarkson University
Alaina Tulskie (MS)
Computer Science
Clarkson University
Jyothinadh Minnekanti (MS)
Computer Science
Clarkson University

Copyright © Natasha Kholgade Banerjee. All rights reserved.