KR-CNN Example

KR-CNN Example

Citation Author(s):
Submitted by:
Guinther SAIBRO
Last updated:
Fri, 03/29/2019 - 07:00
Dataset Views:
Share / Embed Cite



We present the first approach to automatically detect and track a needle in an endoscopic ultrasound (EUS) video. EUS is a fundamental medical procedure that is used extensively for biopsying targets in the upper gastro-intestinal tract. The approach enables various new applications for advancing EUS, including automatic EUS workflow analysis, automatic report generation, video summarization, technical skills assessment and quality indicator automation. Our approach does not require annotations of needles in videos, which is a laborious and demanding task. We propose to solve this problem by combining a state-of-the-art multi-hypothesis single image detector using Convolutional Neural Networks (CNN), with Bayesian temporal filtering to incorporate dynamics constraints. The single image detector is trained using a small but diverse dataset, covering variations in device, needle type, resolution and medical centre. The dynamics filter is used to detect the presence of the needle and tracking it over time, using noisy observations provided by the single-image detector's bounding box distribution. The method has only two free parameters that have been experimentally set using only one video. We have evaluated the approach on a dataset of 15 EUS videos, consisting in various real-world challenges including artefacts, fast needle motion, partially visible needles caused by needle bending and Doppler artefacts. Compared to the current state-of-the-art for needle detection in ultrasound (US) images, we improve considerably the mean average precision performance from 0.27 to 0.42. We will make our datasets public available.


Example video.

Dataset Files

You must be an IEEE Dataport Subscriber to access these files. Login or subscribe now. Sign up to be a Beta Tester and receive a coupon code for a free subscription to IEEE DataPort!

Embed this dataset on another website

Copy and paste the HTML code below to embed your dataset:

Share via email or social media

Click the buttons below:

[1] Guinther SAIBRO VIEIRA, "KR-CNN Example", IEEE Dataport, 2019. [Online]. Available: Accessed: Jun. 20, 2019.
doi = {10.21227/1pzy-m131},
url = {},
author = {Guinther SAIBRO VIEIRA },
publisher = {IEEE Dataport},
title = {KR-CNN Example},
year = {2019} }
T1 - KR-CNN Example
PY - 2019
PB - IEEE Dataport
UR - 10.21227/1pzy-m131
ER -
Guinther SAIBRO VIEIRA. (2019). KR-CNN Example. IEEE Dataport.
Guinther SAIBRO VIEIRA, 2019. KR-CNN Example. Available at:
Guinther SAIBRO VIEIRA. (2019). "KR-CNN Example." Web.
1. Guinther SAIBRO VIEIRA. KR-CNN Example [Internet]. IEEE Dataport; 2019. Available from :
Guinther SAIBRO VIEIRA. "KR-CNN Example." doi: 10.21227/1pzy-m131