NA-MIC Project Weeks

Back to Projects List

MARIN: Mobile Augmented Reality Interactive Neuronavigator (in Slicer)

Key Investigators

Mehrdad Asadi (Concordia University, Canada)
Étienne Léger (Montreal Neurological Institute, Canada)
Bahar Jahani (Concordia University, Canada)
Zahra Asadi (Concordia University, Canada)

Project Description

MARIN is an application that can be used in conjunction with a neuronavigation platform to enable in situ AR guidance on a mobile device. It currently supports iOS and works in conjunction with Ibis (with the additional MARIN plugins). The goal of this project is to implement the same support in Slicer.

Objective

Add Slicer support for MARIN (provide the same functionalities that Ibis currently does)

Approach and Plan

MARIN is a mobile application that can overlay virtual structures over the live camera feed from a device, enabling in situ augmented reality navigation for surgical applications (see image below). The MARIN application itself can interface with any platform, provided that the platform supports real-time communication, can handle tracking and generate 3D renderings. Slicer has all of these capabilities. Communication between Slicer and MARIN can be set-up through the OpenIGTLinkIF module. The main components that will have to be implemented are Slicer modules to handle device configuration and rendering of tracked virtual objects.

Progress and Next Steps

TODO

Illustrations

MARIN demo, with Ibis: teaser_looped_small

Background and References

Article: Léger, É., Reyes, J., Drouin, S., Popa, T., Hall, J. A., Collins, D. L., Kersten-Oertel, M., “MARIN: an Open Source Mobile Augmented Reality Interactive Neuronavigation System”, International Journal of Computer Assisted Radiology and Surgery (2020). https://doi.org/10.1007/s11548-020-02155-6

Source code repository: MARIN