Earth on Canvas

Citation Author(s):
Ushasi
Chaudhuri
Indian Institute of Technology Bombay
Biplab
Banerjee
Indian Institute of Technology Bombay
Avik
Bhattacharya
Indian Institute of Technology Bombay
Mihai
Datcu
German Aerospace Center (DLR)
Submitted by:
ushasi chaudhuri
Last updated:
Thu, 04/08/2021 - 12:03
DOI:
Data Format:
Links:
License:
0
0 ratings - Please login to submit your rating.

Abstract 

With the advancement in sensor technology, huge amounts of data are being collected from various satellites. Hence, the task of target-based data retrieval and acquisition has become exceedingly challenging. Existing satellites essentially scan a vast overlapping region of the Earth using various sensing techniques, like multi-spectral, hyperspectral, Synthetic Aperture Radar (SAR), video, and compressed sensing, to name a few. With increasing complexity and different sensing techniques at our disposal, it has become our primary interest to design efficient algorithms to retrieve data from multiple data modalities, given the complementary information that is captured by different sensors. This type of problem is referred to as inter-modal data retrieval. In remote sensing (RS), there are primarily two important types of problems, i.e., land-cover classification and object detection. In this work, we focus on the target-based object retrieval part, which falls under the realm of object detection in RS. Object retrieval essentially requires high-resolution imagery for objects to be distinctly visible in the image. The main challenge with the conventional retrieval approach using large-scale databases is that, quite often, we do not have any query image sample of the target class at our disposal. The target of interest solely exists as a perception to the user in the form of an imprecise sketch. In such situations where a photo query is absent, it can be immensely useful if we can promptly make a quick hand-made sketch of the target. Sketches are a highly symbolic and hieroglyphic representation of data. One can exploit the notion of this minimalistic representative of sketch queries for sketch-based image retrieval (SBIR) framework. While dealing with satellite images, it is imperative to collect as many samples of images as possible for each object class for object recognition with a high success rate. However, in general, there exists a considerable number of classes for which we seldom have any training data samples. Therefore, for such classes, we can use the zero-shot learning (ZSL) strategy. The ZSL approach aims to solve a task without receiving any example of that task during the training phase. This makes the network capable of handling an unseen class (new class) sample obtained during the inference phase upon deployment of the network. In this database, we propose an aerial skecth-image database that can be useful for designing frameworks for the above-mentioned tasks.

Instructions: 

A Zero-Shot Sketch-based Inter-Modal Object Retrieval Scheme for Remote Sensing Images

Email the authors at ushasi@iitb.ac.in for any query..

Classes in this dataset:

  1. Airplane
  2. Baseball Diamond
  3. Buildings
  4. Freeway
  5. Golf Course
  6. Harbor
  7. Intersection
  8. Mobile home park
  9. Overpass
  10. Parking lot
  11. River
  12. Runway
  13. Storage tank
  14. Tennis court

Paper

``` @InProceedings{Chaudhuri_2020_EoC, author = {Chaudhuri, Ushasi and Banerjee, Biplab and Bhattacharya, Avik and Datcu, Mihai}, title = {A Zero-Shot Sketch-based Inter-Modal Object Retrieval Scheme for Remote Sensing Images}, booktitle = {http://arxiv.org/abs/2008.05225}, month = {Aug}, year = {2020} }