An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images

Purpose: In pediatric endoscopic surgery, a limited view and lack of tactile sensation restrict the surgeon's abilities. Moreover, in pediatric oncology, it is sometimes difficult to detect and resect tumors due to the adhesion and degeneration of tumors treated with multimodality therapies. We developed an augmented reality (AR) navigation system based on preoperative CT and MRI imaging for use in endoscopic surgery for pediatric tumors. Methods: The patients preoperatively underwent either CT or MRI with body surface markers. We used an optical tracking system to register the reconstructed 3D images obtained from the CT and MRI data and body surface markers during surgery. AR visualization was superimposed with the 3D images projected onto captured live images. Six patients underwent surgery using this system. Results: The median age of the patients was 3.5 years. Two of the six patients underwent laparoscopic surgery, two patients underwent thoracoscopic surgery, and two patients underwent laparotomy using this system. The indications for surgery were local recurrence of a Wilms tumor in one case, metastasis of rhabdomyosarcoma in one case, undifferentiated sarcoma in one case, bronchogenic cysts in two cases, and hepatoblastoma in one case. The average tumor size was 22.0 ± 14.2 mm. Four patients were treated with chemotherapy, three patients were treated with radiotherapy before surgery, and four patients underwent reoperation. All six tumors were detected using the AR navigation system and successfully resected without any complications. Conclusions: The AR navigation system is very useful for detecting the tumor location during pediatric surgery, especially for endoscopic surgery. Crown