VisLinkMR
VisLinkMR explores how utilizing an LLM can enhance object detection to facilitate seamless connections between physical objects, such as tangible items, and mixed reality interfaces. I helped lay the groundwork for the literature that led to the development of this tool. I also helped design the interactions that framed the foundation for this interaction.
Manuscript Under Review
-
Literature Designer helping to shape the framework to create and support the research questions
Interaction Co-Designer who helped develop the interactions for the wearable tangible to be easily detectable by the LLM in mixed reality
-
Using a developed AI model to detect the physical wearable tangible to sync it to virtual counterparts in mixed reality for interacting with data