Automated visibility map of the internal colon surface from colonoscopy video

Ali ARMIN, Girija CHETTY, Hans De Visser, Cedric Dumas, Florian Grimpen, olivier salvado

    Research output: Contribution to journalArticle

    3 Citations (Scopus)

    Abstract

    PURPOSE: Optical colonoscopy is a prominent procedure by which clinicians examine the surface of the colon for cancerous polyps using a flexible colonoscope. One of the main concerns regarding the quality of the colonoscopy is to ensure that the whole colonic surface has been inspected for abnormalities. In this paper, we aim at estimating areas that have not been covered thoroughly by providing a map from the internal colon surface.
    METHODS: Camera parameters were estimated using optical flow between consecutive colonoscopy frames. A cylinder model was fitted to the colon structure using 3D pseudo stereo vision and projected into each frame. A circumferential band from the cylinder was extracted to unroll the internal colon surface (band image). By registering these band images, drift in estimating camera motion could be reduced, and a visibility map of the colon surface could be generated, revealing uncovered areas by the colonoscope. Hidden areas behind haustral folds were ignored in this study. The method was validated on simulated and actual colonoscopy videos. The realistic simulated videos were generated using a colonoscopy simulator with known ground truth, and the actual colonoscopy videos were manually assessed by a clinical expert.
    RESULTS: The proposed method obtained a sensitivity and precision of 98 and 96 % for detecting the number of uncovered areas on simulated data, whereas validation on real videos showed a sensitivity and precision of 96 and 78 %, respectively. Error in camera motion drift could be reduced by almost 50 % using results from band image registration.
    CONCLUSION: Using a simple cylindrical model for the colon and reducing drift by registering band images allows for the generation of visibility maps. The current results also suggest that the provided feedback through the visibility map could enhance clinicians' awareness of uncovered areas, which in return could reduce the probability of missing polyps
    Original languageEnglish
    Pages (from-to)1599-1610
    Number of pages12
    JournalInternational Journal of Computer Assisted Radiology and Surgery
    Volume11
    Issue number9
    DOIs
    Publication statusPublished - 1 Sep 2016

    Fingerprint

    Colonoscopy
    Visibility
    Colon
    Colonoscopes
    Cameras
    Polyps
    Stereo vision
    Optical flows
    Image registration
    Simulators
    Feedback

    Cite this

    ARMIN, Ali ; CHETTY, Girija ; De Visser, Hans ; Dumas, Cedric ; Grimpen, Florian ; salvado, olivier. / Automated visibility map of the internal colon surface from colonoscopy video. In: International Journal of Computer Assisted Radiology and Surgery. 2016 ; Vol. 11, No. 9. pp. 1599-1610.
    @article{374f44d09a8741268e272c64a7c341f7,
    title = "Automated visibility map of the internal colon surface from colonoscopy video",
    abstract = "PURPOSE: Optical colonoscopy is a prominent procedure by which clinicians examine the surface of the colon for cancerous polyps using a flexible colonoscope. One of the main concerns regarding the quality of the colonoscopy is to ensure that the whole colonic surface has been inspected for abnormalities. In this paper, we aim at estimating areas that have not been covered thoroughly by providing a map from the internal colon surface.METHODS: Camera parameters were estimated using optical flow between consecutive colonoscopy frames. A cylinder model was fitted to the colon structure using 3D pseudo stereo vision and projected into each frame. A circumferential band from the cylinder was extracted to unroll the internal colon surface (band image). By registering these band images, drift in estimating camera motion could be reduced, and a visibility map of the colon surface could be generated, revealing uncovered areas by the colonoscope. Hidden areas behind haustral folds were ignored in this study. The method was validated on simulated and actual colonoscopy videos. The realistic simulated videos were generated using a colonoscopy simulator with known ground truth, and the actual colonoscopy videos were manually assessed by a clinical expert.RESULTS: The proposed method obtained a sensitivity and precision of 98 and 96 {\%} for detecting the number of uncovered areas on simulated data, whereas validation on real videos showed a sensitivity and precision of 96 and 78 {\%}, respectively. Error in camera motion drift could be reduced by almost 50 {\%} using results from band image registration.CONCLUSION: Using a simple cylindrical model for the colon and reducing drift by registering band images allows for the generation of visibility maps. The current results also suggest that the provided feedback through the visibility map could enhance clinicians' awareness of uncovered areas, which in return could reduce the probability of missing polyps",
    keywords = "visibility-map, camera-motion-estimation, colonoscopy, Optical colonoscopy, Uncovered area, Camera motion parameters, Colonoscopy quality, Camera motion drift, Visibility map, Colonic Polyps/diagnosis, Colon/diagnostic imaging, Colonoscopes, Humans, Colonoscopy/methods, Equipment Design, Video Recording, Imaging, Three-Dimensional",
    author = "Ali ARMIN and Girija CHETTY and {De Visser}, Hans and Cedric Dumas and Florian Grimpen and olivier salvado",
    year = "2016",
    month = "9",
    day = "1",
    doi = "10.1007/s11548-016-1462-8",
    language = "English",
    volume = "11",
    pages = "1599--1610",
    journal = "Computer-Assisted Radiology and Surgery",
    issn = "1861-6410",
    publisher = "Springer Verlag",
    number = "9",

    }

    Automated visibility map of the internal colon surface from colonoscopy video. / ARMIN, Ali; CHETTY, Girija; De Visser, Hans; Dumas, Cedric; Grimpen, Florian; salvado, olivier.

    In: International Journal of Computer Assisted Radiology and Surgery, Vol. 11, No. 9, 01.09.2016, p. 1599-1610.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Automated visibility map of the internal colon surface from colonoscopy video

    AU - ARMIN, Ali

    AU - CHETTY, Girija

    AU - De Visser, Hans

    AU - Dumas, Cedric

    AU - Grimpen, Florian

    AU - salvado, olivier

    PY - 2016/9/1

    Y1 - 2016/9/1

    N2 - PURPOSE: Optical colonoscopy is a prominent procedure by which clinicians examine the surface of the colon for cancerous polyps using a flexible colonoscope. One of the main concerns regarding the quality of the colonoscopy is to ensure that the whole colonic surface has been inspected for abnormalities. In this paper, we aim at estimating areas that have not been covered thoroughly by providing a map from the internal colon surface.METHODS: Camera parameters were estimated using optical flow between consecutive colonoscopy frames. A cylinder model was fitted to the colon structure using 3D pseudo stereo vision and projected into each frame. A circumferential band from the cylinder was extracted to unroll the internal colon surface (band image). By registering these band images, drift in estimating camera motion could be reduced, and a visibility map of the colon surface could be generated, revealing uncovered areas by the colonoscope. Hidden areas behind haustral folds were ignored in this study. The method was validated on simulated and actual colonoscopy videos. The realistic simulated videos were generated using a colonoscopy simulator with known ground truth, and the actual colonoscopy videos were manually assessed by a clinical expert.RESULTS: The proposed method obtained a sensitivity and precision of 98 and 96 % for detecting the number of uncovered areas on simulated data, whereas validation on real videos showed a sensitivity and precision of 96 and 78 %, respectively. Error in camera motion drift could be reduced by almost 50 % using results from band image registration.CONCLUSION: Using a simple cylindrical model for the colon and reducing drift by registering band images allows for the generation of visibility maps. The current results also suggest that the provided feedback through the visibility map could enhance clinicians' awareness of uncovered areas, which in return could reduce the probability of missing polyps

    AB - PURPOSE: Optical colonoscopy is a prominent procedure by which clinicians examine the surface of the colon for cancerous polyps using a flexible colonoscope. One of the main concerns regarding the quality of the colonoscopy is to ensure that the whole colonic surface has been inspected for abnormalities. In this paper, we aim at estimating areas that have not been covered thoroughly by providing a map from the internal colon surface.METHODS: Camera parameters were estimated using optical flow between consecutive colonoscopy frames. A cylinder model was fitted to the colon structure using 3D pseudo stereo vision and projected into each frame. A circumferential band from the cylinder was extracted to unroll the internal colon surface (band image). By registering these band images, drift in estimating camera motion could be reduced, and a visibility map of the colon surface could be generated, revealing uncovered areas by the colonoscope. Hidden areas behind haustral folds were ignored in this study. The method was validated on simulated and actual colonoscopy videos. The realistic simulated videos were generated using a colonoscopy simulator with known ground truth, and the actual colonoscopy videos were manually assessed by a clinical expert.RESULTS: The proposed method obtained a sensitivity and precision of 98 and 96 % for detecting the number of uncovered areas on simulated data, whereas validation on real videos showed a sensitivity and precision of 96 and 78 %, respectively. Error in camera motion drift could be reduced by almost 50 % using results from band image registration.CONCLUSION: Using a simple cylindrical model for the colon and reducing drift by registering band images allows for the generation of visibility maps. The current results also suggest that the provided feedback through the visibility map could enhance clinicians' awareness of uncovered areas, which in return could reduce the probability of missing polyps

    KW - visibility-map

    KW - camera-motion-estimation

    KW - colonoscopy

    KW - Optical colonoscopy

    KW - Uncovered area

    KW - Camera motion parameters

    KW - Colonoscopy quality

    KW - Camera motion drift

    KW - Visibility map

    KW - Colonic Polyps/diagnosis

    KW - Colon/diagnostic imaging

    KW - Colonoscopes

    KW - Humans

    KW - Colonoscopy/methods

    KW - Equipment Design

    KW - Video Recording

    KW - Imaging, Three-Dimensional

    UR - http://www.scopus.com/inward/record.url?scp=84982950437&partnerID=8YFLogxK

    UR - http://www.mendeley.com/research/automated-visibility-map-internal-colon-surface-colonoscopy-video

    U2 - 10.1007/s11548-016-1462-8

    DO - 10.1007/s11548-016-1462-8

    M3 - Article

    VL - 11

    SP - 1599

    EP - 1610

    JO - Computer-Assisted Radiology and Surgery

    JF - Computer-Assisted Radiology and Surgery

    SN - 1861-6410

    IS - 9

    ER -