Abstract

Instance retrieval has emerged as a promising research area with buildings as the popular test subject. Given a query im-age or region, the objective is to find images in the database containing the same object or scene. There has been a recents urge in efforts in finding instances of the same building in challenging datasets such as the Oxford 5k dataset[19], Ox-ford 100k dataset and the Paris dataset[20].We ascend one level higher and pose the question:Are Buildings Only Instances?Buildings located in the same geographical region or constructed in a certain time period in history often follow a specific method of construction.These architectural styles are characterized by certain fea-tures which distinguish them from other styles of architec-ture. We explore, beyond the idea of buildings as instances,the possibility that buildings can be categorized based on the architectural style. Certain characteristic features distin-guish an architectural style from others. We perform exper-iments to evaluate how characteristic information obtained from low-level feature configurations can help in classifica-tion of buildings into architectural style categories. Encour-aged by our observations, we mine characteristic features with semantic utility for different architectural styles from our dataset of European monuments. These mined features are of various scales, and provide an insight into what makes a particular architectural style category distinct. The utility of the mined characteristics is verified from Wikipedia

Abstract

In this paper, we propose a framework for content level ac-cess to the scanned pages of Digital Library of India (DLI).The current Optical Character Recognition (OCR) systems are not robust and reliable enough for generating accurate text from DLI pages. We propose a search scheme which fuses noisy OCR output and holistic visual features for con-tent level access to the DLI pages. Visual content is cap-tured using Bag of Visual Words (BoVW) approach. We show that our fusion scheme improves over the individual methods in terms of mean Average Precision (mAP) and mean precision at 10 (mPrec@10). We exploit the fact that OCR has a high precision while BoVW has a high recall.We use a modified edit distance to improve the order of re-sults ranked by BoVW. Experiments are carried out on largedatasets of DLI pages in Hindi and Telugu languages. Wevalidate our method on more than 10,000 pages and 4 Mil-lion words, and report a mAP of around 0.8 and mPrec@10of more than 0.9. We show improvements over BoVW by introducing query expansion. We also demonstrate a textual query interface for the search system.

Abstract

A wide category of objects and scenes can be effectively searched and classified using the modern descriptors and classifiers. With the performance on many popular cate-gories becoming satisfactory, we explore into the issues as-sociated with much harder recognition problems.We address the problem of searching specific images in In-dian stone-carvings and sculptures in an unsupervised set-up. For this, we introduce a new dataset of 524 images containing sculptures and carvings of eight different Indian deities and three other subjects popular in the Indian sce-nario. We perform a thorough analysis to investigate var-ious challenges associated with this task. A new image-representation is proposed using a sequence of discriminative patches mined in an unsupervised manner. For each image,these patches are identified based on their ability to distin-guish the given image from the image most dissimilar to it. Then a rejection-based re-ranking scheme is formulated based on both similarity as well as dissimilarity between two images. This new scheme is experimentally compared with two baselines using state-of-the-art descriptors on the pro-posed dataset. Empirical evaluations demonstrate that our proposed method of image-representation and rejection cas-cade improves the retrieval performance on this hard prob-lem as compared to the baseline descriptors.

Abstract

n this paper, we demonstrate a computer vision applica-tion on mobile phones. One can take a picture at a her-itage site/monument and obtain associated annotations on a mid-end mobile phone instantly. This does not require any communication of images or features with a remote server,and all the necessary computations take place on the phone itself. We demonstrate the app on two Indian heritage sites:Golkonda Fort and Hampi Temples. Underlying our appli-cation, we have a Bag of visual Words (BoW) image retrieval system, and an annotated database of images.In the process of developing this mobile app, we extend the performance, scope and applicability of computer vision techniques: (i) we do a BoW-based image retrieval on mo-bile phones from a database of 10K images within 50 MB of storage and 10 MB of RAM. (ii) we introduce a vocabulary pruning method for reducing the vocabulary size. (iii) wede sign a simple method of database pruning, that helps in reducing the size of the inverted index by removing seman-tically similar images. In (ii) and (iii), we demonstrate how memory(RAM) and computational speed can be optimized without any loss in performance.

Abstract

Motion segmentation is an inevitable component for mobile robotic systems such as the case with robots performing SLAM and collision avoidance in dynamic worlds. This paper proposes an incremental motion segmentation system that efficiently segments multiple moving objects and simultaneously build the map of the environment using visual SLAM modules. Multiple cues based on optical flow and two view geometry are integrated to achieve this segmentation. A dense optical flow algorithm is used for dense tracking of features. Motion potentials based on geometry are computed for each of these dense tracks. These geometric potentials along with the optical flow potentials are used to form a graph like structure. A graph based segmentation algorithm then clusters together nodes of similar potentials to form the eventual motion segments. Experimental results of high quality segmentation on different publicly available datasets demonstrate the effectiveness of our method.

Abstract

The AXES project participated in the interactive known-item search task (KIS) and the interactive instance search task (INS) for TRECVid 2011. We used the same system architecture and a nearly identical user interface for both the KIS and INS tasks. Both systems made use of text search on ASR, visual concept detectors, and visual similarity search. The user experiments were carried out with media professionals and media students at the Netherlands Institute for Sound and Vision, with media professionals performing the KIS task and media students participating in the INS task. This paper describes the results and findings of our experiments.

Abstract

Video Scene Segmentation is an important problem in computer vision as it helps in efficient storage, indexing and retrieval of videos. Significant amount of work has been done in this area in the form of shot segmentation techniques and they often give reasonably good results. However, shots are not of much importance for the semantic analysis of the videos. For semantic and meaningful analysis of the videos (e.g. movies), scene is more important since it captures one complete unit of action. People have tried different approaches in scene segmentation but almost all of them use color, texture etc. to compute scene boundaries. In this paper, we propose a new algorithm based on a Bag of Words(BoW) representation which computes semantic similarity between shots using a Bipartite Graph Model (BGM). Based on semantic similarity, we detect the scene boundaries in the movie. We have tested our algorithm on a multiple Hollywood movies, and the proposed method is found to give good results.

Abstract

A major requirement in the design of robust OCRs is the invariance of feature extraction scheme with the popular fonts used in the print. Many statistical and structural features have been tried for character classification in the past. In this paper, we get motivated by the recent successes in object category recognition literature and use a spatial extension of the histogram of oriented gradients (HOG) for character classification. Our experiments are conducted on 1453950 Telugu character samples in 359 classes and 15 fonts. On this data set, we obtain an accuracy of 96-98% with an SVM classifier.

Abstract

This paper presents integration and testing scheme for managing a large Multilingual OCR Project. The project is an attempt to implement an integrated platform for OCR of different Indian languages. Software engineering, workflow management and testing processes have been discussed in this paper. The OCR has now been experimentally deployed for some specific applications and currently is being enhanced for handling the space and time constraints, achieving higher recognition accuracies and adding new functionalities.

Abstract

Page segmentation is a basic step in any character recognition system. Its failure is one of the major causes for deteriorating overall accuracy of the current Indian language OCR engines. Many segmentation algorithms are proposed in literature. Often these algorithms fail to adapt dynamically to a given page and thus tend to yield poor segmentation for some specific regions or some specific pages. Given the ground truth, locating page segmentation errors is a straight foreword problem and merely useful for comparing segmentation algorithms. In this work, we locate segmentation errors without directly using the ground truth. Such automatic localization of page segmentation errors can be considered a major step towards improving page segmentation errors. In this work, we focus on localizing line level segmentation errors. We perform experiments on more than 18000 scanned pages of 109 books belonging to four prominent south Indian languages.