The Cognitive Vision in Robotic Surgery Lab is developing computer vision and AI techniques for intraoperative navigation and real-time tissue characterisation.
Head of Group
Dr Stamatia (Matina) Giannarou
411 Bessemer Building
South Kensington Campus
+44 (0) 20 7594 8904
What we do
Surgery is undergoing rapid changes driven by recent technological advances and our on-going pursuit towards early intervention and personalised treatment. We are developing computer vision and Artificial Intelligence techniques for intraoperative navigation and real-time tissue characterisation during minimally invasive and robot-assisted operations to improve both the efficacy and safety of surgical procedures. Our work will revolutionize the treatment of cancers and pave the way for autonomous robot-assisted interventions.
Why it is important?
With recent advances in medical imaging, sensing, and robotics, surgical oncology is entering a new era of early intervention, personalised treatment, and faster patient recovery. The main goal is to completely remove cancerous tissue while minimising damage to surrounding areas. However, achieving this can be challenging, often leading to imprecise surgeries, high re-excision rates, and reduced quality of life due to unintended injuries. Therefore, technologies that enhance cancer detection and enable more precise surgeries may improve patient outcomes.
How can it benefit patients?
Our methods aim to ensure patients receive accurate and timely surgical treatment while reducing surgeons' mental workload, overcoming limitations, and minimizing errors. By improving tumor excision, our hybrid diagnostic and therapeutic tools will lower recurrence rates and enhance survival outcomes. More complete tumor removal will also reduce the need for repeat procedures, improving patient quality of life, life expectancy, and benefiting society and the economy.
Meet the team
Results
- Showing results for:
- Reset all filters
Search results
-
PatentYe M, 2015,
Method and Apparatus
, WO/2015/033147 -
Conference paperYe M, Johns E, Giannarou S, et al., 2014,
Online Scene Association for Endoscopic Navigation
, 17th International Conference MICCAI 2014, Publisher: Springer International Publishing, Pages: 316-323, ISSN: 0302-9743Endoscopic surveillance is a widely used method for moni-toring abnormal changes in the gastrointestinal tract such as Barrett'sesophagus. Direct visual assessment, however, is both time consumingand error prone, as it involves manual labelling of abnormalities on alarge set of images. To assist surveillance, this paper proposes an onlinescene association scheme to summarise an endoscopic video into scenes,on-the-y. This provides scene clustering based on visual contents, andalso facilitates topological localisation during navigation. The proposedmethod is based on tracking and detection of visual landmarks on thetissue surface. A generative model is proposed for online learning of pair-wise geometrical relationships between landmarks. This enables robustdetection of landmarks and scene association under tissue deformation.Detailed experimental comparison and validation have been conductedon in vivo endoscopic videos to demonstrate the practical value of ourapproach.
-
Conference paperYe M, Johns E, Giannarou S, et al., 2014,
Online scene association for endoscopic navigation
, Pages: 316-323Endoscopic surveillance is a widely used method for monitoring abnormal changes in the gastrointestinal tract such as Barrett's esophagus. Direct visual assessment, however, is both time consuming and error prone, as it involves manual labelling of abnormalities on a large set of images. To assist surveillance, this paper proposes an online scene association scheme to summarise an endoscopic video into scenes, on-the-fly. This provides scene clustering based on visual contents, and also facilitates topological localisation during navigation. The proposed method is based on tracking and detection of visual landmarks on the tissue surface. A generative model is proposed for online learning of pairwise geometrical relationships between landmarks. This enables robust detection of landmarks and scene association under tissue deformation. Detailed experimental comparison and validation have been conducted on in vivo endoscopic videos to demonstrate the practical value of our approach.
-
Conference paperGiannarou S, Gruijthuijsen C, Yang G-Z, 2014,
Modeling and Recognition of Ongoing Surgical Gestures in TAVI Procedures
-
Conference paperShi C, Giannarou S, Lee S-L, et al., 2014,
Simultaneous Catheter and Environment Modeling for Trans-catheter Aortic Valve Implantation
-
Conference paperYe M, Giannarou S, Patel N, et al., 2013,
Pathological Site Retargeting under Tissue Deformation Using Geometrical Association and Tracking
, 16th International Conference on MICCAI 2013, Publisher: Springer Berlin Heidelberg, Pages: 67-74, ISSN: 0302-9743Recent advances in microscopic detection techniques includefluorescence spectroscopy, fibred confocal microscopy and optical coher-ence tomography. These methods can be integrated with miniaturisedprobes to assist endoscopy, thus enabling diseases to be detected at anearly and pre-invasive stage, forgoing the need for histopathological sam-ples and off-line analysis. Since optical-based biopsy does not leave vis-ible marks after sampling, it is important to track the biopsy sites toenable accurate retargeting and subsequent serial examination. In thispaper, a novel approach is proposed for pathological site retargeting ingastroscopic examinations. The proposed method is based on affine defor-mation modelling with geometrical association combined with cascadedonline learning and tracking. It provides online in vivo retargeting, and is able to track pathological sites in the presence of tissue deformation. It is also robust to partial occlusions and can be applied to a range of imaging probes including confocal laser endomicroscopy.
-
Conference paperElmikaty M, Stathaki T, Kimber P, et al., 2013,
A novel two-level shape descriptor for pedestrian detection
, SSPD 2012The demand for pedestrian detection and tracking algorithms is rapidly increasing with applications in security systems, human computer interaction and human activity analysis. A pedestrian is a person standing in an upright position. Previous work involves using various types of image descriptors to detect humans. However, the existing approaches, although exhibit low misdetection rate, result in high rate of false alarms in the case of complex image backgrounds. In this work, a novel approach for pedestrian detection is proposed which is based on the combined use of two object detection approaches with the aim of reducing the false alarm rate of the individual detectors. These are the Histogram of Oriented Gradients (HOG) and a Shape Context based object detector (SC). Preliminary results are very encouraging and demonstrate clearly the ability of the proposed system to reduce the number of false alarms without significant increase in the processing time.
-
Conference paper, 2013,
Pathological site retargeting under tissue deformation using geometrical association and tracking.
, Pages: 67-74Recent advances in microscopic detection techniques include fluorescence spectroscopy, fibred confocal microscopy and optical coherence tomography. These methods can be integrated with miniaturised probes to assist endoscopy, thus enabling diseases to be detected at an early and pre-invasive stage, forgoing the need for histopathological samples and off-line analysis. Since optical-based biopsy does not leave visible marks after sampling, it is important to track the biopsy sites to enable accurate retargeting and subsequent serial examination. In this paper, a novel approach is proposed for pathological site retargeting in gastroscopic examinations. The proposed method is based on affine deformation modelling with geometrical association combined with cascaded online learning and tracking. It provides online in vivo retargeting, and is able to track pathological sites in the presence of tissue deformation. It is also robust to partial occlusions and can be applied to a range of imaging probes including confocal laser endomicroscopy.
-
Journal articleGiannarou S, Visentini-Scarzanella M, Yang G-Z, 2013,
Probabilistic Tracking of Affine-Invariant Anisotropic Regions
, IEEE Trans. Pattern Anal. Machine Intell -
Conference paperVandini A, Giannarou S, Lee S-L, et al., 2013,
3D Robotic Catheter Shape Reconstruction and Localisation using Appearance Priors and Adaptive C-arm Positioning
, Pages: 172-181
This data is extracted from the Web of Science and reproduced under a licence from Thomson Reuters. You may not copy or re-distribute this data in whole or in part without the written consent of the Science business of Thomson Reuters.
Contact Us
The Hamlyn Centre
Bessemer Building
South Kensington Campus
Imperial College
London, SW7 2AZ
Map location