Abstract

The convergence of computer vision and advertising has sparked substantial interest lately. Existing advertisement datasets are either subsets of existing datasets with specialized annotations or feature diverse annotations without a cohesive taxonomy among ad images. Notably, no datasets encompass diverse advertisement styles or semantic grouping at various levels of granularity. Our work addresses this gap by introducing MAdVerse, an extensive, multilingual compilation of more than 50,000 ads from the web, social media websites, and e-newspapers. Advertisements are hierarchically grouped with uniform granularity into 11 categories, divided into 51 sub-categories, and 524 fine-grained brands at leaf level, each featuring ads in various languages. We provide comprehensive baseline classification results for prediction tasks within the realm of advertising analysis. These tasks include hierarchical ad classification, source classification, multilingual classification, and inducing hierarchy in existing ad datasets.

Abstract

Global visual localization in LiDAR-maps, crucial for autonomous driving applications, remains largely unexplored due to the challenging issue of bridging the cross-modal heterogeneity gap. Popular multi-modal learning approach Contrastive Language-Image Pre-Training (CLIP) has popularized contrastive symmetric loss using batch construction technique by applying it to multi-modal domains of text and image. We apply this approach to the domains of 2D image and 3D LiDAR points on the task of cross-modal localization. Our method is explained as follows: A batch of N (image, LiDAR) pairs is constructed so as to predict what is the right match between N X N possible pairings across the batch by jointly training an image encoder and LiDAR encoder to learn a multi-modal embedding space. In this way, the cosine similarity between N positive pairings is maximized, whereas that between the remaining negative pairings is minimized. Finally, over the obtained similarity scores, a symmetric cross-entropy loss is optimized. To the best of our knowledge, this is the first work to apply batched loss approach to a cross-modal setting of image & LiDAR data and also to show Zero-shot transfer in a visual localization setting. We conduct extensive analyses on standard autonomous driving datasets such as KITTI and KITTI-360 datasets. Our method outperforms state-of-the-art recall@1 accuracy on the KITTI-360 dataset by 22.4%, using only perspective images, in contrast to the state-of-the-art approach, which utilizes the more informative fisheye images. Additionally, this superior performance is achieved without resorting to complex architectures. Moreover, we demonstrate the zero-shot capabilities of our model and we beat SOTA by 8% without even training on it. Furthermore, we establish the first benchmark for cross-modal localization on the KITTI dataset.

Abstract

In the whole procedure of preservation, conservation, and restoration of monuments and historical buildings, structural restoration is considered an undesirable parameter, since it implies interventions on a large scale that might harm the authenticity of a culturally protected building. However, this type of intervention is an inevitable action, because it pertains to the safety of the building and, most importantly, to the safety of the users. In this respect, authenticity and safety are two concepts contradicting each other, and they are ensured by professionals of different origins and philosophies, namely archaeology & architecture on one side and science & technology on the other. In the case of structural restoration, these professionals are required to find a common space of co-existence so that the results of restoration satisfy both concepts, authenticity and safety. The present study gives an overview of thorough knowledge of construction techniques of masonry elements or systems or forms used in the past. In fact, in a period of more than five millennia, various techniques of construction have been developed as a result of big revolutions that have taken place in the history of human civilization. A deep knowledge of all the above is necessary for the suitable selection of present-day techniques and materials that might be used in structural restoration, where principles of reversible or irreversible techniques play a vital role together with the compatibility and durability of intervention materials. The main objective of this study is to guide the structural engineers involved in the structural repair of ancient monuments and buildings of national importance.

Abstract

Masonry is a traditional, extremely durable type of construction material, and many heritage masonry structures from different historical eras have endured adverse environmental conditions to varying degrees despite sometimes significantly losing their integrity, strength, and durability. Throughout history, the choice of masonry materials has largely been determined by availability, local geological formations, and environmental conditions. Although masonry has evolved over the centuries, the fundamentals of using stone, aggregate, or brick in combination with a binding material have not changed. It is not surprising that strong masonry materials were used to build some of the most notable historical buildings in human history that are still standing today. Resources nowadays are devoted to heritage architecture restoration and conservation because of its cultural significance. For the proper selection of construction techniques that could be applied to structural restoration or before taking any remedial action, a thorough understanding of masonry materials is required. Architectural surveys, the use of written evidence, laboratory investigations, and on-site tests can all be used to achieve this. Hence, the current study provides a thorough overview of the materials and their mechanical properties that have been developed over more than five thousand years for the construction of different structural components of masonry buildings that helped perform well during past seismic events.

Abstract

Recently, the fundamental problem of unsupervised domain adaptation (UDA) on 3D point clouds has been motivated by a wide variety of applications in robotics, virtual reality, and scene understanding, to name a few. The point cloud data acquisition procedures manifest themselves as significant domain discrepancies and geometric variations among both similar and dissimilar classes. The standard domain adaptation methods developed for images do not directly translate to point cloud data because of their complex geometric nature. To address this challenge, we leverage the idea of multimodality and alignment between distributions. We propose a new UDA architecture for point cloud classification that benefits from multimodal contrastive learning to get better class separation in both domains individually. Further, the use of optimal transport (OT) aims at learning source and target data distributions jointly to reduce the cross-domain shift and provide a better alignment. We conduct a comprehensive empirical study on PointDA-10 and GraspNetPC-10 and show that our method achieves state-of-the-art performance on GraspNetPC-10 (with ≈ 4-12% margin) and best average performance on PointDA-10. Our ablation studies and decision boundary analysis also validate the significance of our contrastive learning module and OT alig

Abstract

Learning embeddings of any data largely depends on the ability of the target space to capture semantic relations. The widely used Euclidean space, where embeddings are represented as point vectors, is known to be lacking in its potential to exploit complex structures and relations. Contrary to standard Euclidean embeddings, in this work, we embed point clouds as discrete probability distributions in Wasserstein space. We build a contrastive learning setup to learn Wasserstein embeddings that can be used as a pre-training method with or without supervision towards any downstream task. We show that the features captured by Wasserstein embeddings are better in preserving the point cloud geometry, including both global and local information, thus resulting in improved quality embeddings. We perform exhaustive experiments and demonstrate the effectiveness of our method for point cloud classification, transfer learning, segmentation, and interpolation tasks over multiple datasets including synthetic and realworld objects. We also compare against recent methods that use Wasserstein space and show that our method outperforms them in all downstream tasks. Additionally, our study reveals a promising interpretation of capturing critical points of point clouds that makes our proposed method self-explainable.

Abstract

Absolute separable (AS) quantum states are those states from which it is impossible to create entanglement, even under global unitary operations. It is known from the resource theory of non- absolute separability that the set of absolute separable states forms a convex and compact set, and global unitaries are free operations. We show that the action of a quantum switch controlled by an ancilla qubit over the global unitaries can break this robustness of AS states and produce ordinary separable states. First, we consider bipartite qubit systems and find the effect of quantum switch starting from the states sitting on the boundary of the set of absolute separable states. As particular examples, we illustrate what happens to modified Werner states and Bell diagonal (BD) states. For the Bell diagonal states, we provide the structure for the set of AS BD states and show how the structure changes under the influence of a switch. Further, we consider numerical generalization of the global unitary operations and show that it is always possible to take AS states out of the convex set under switching operations. We also generalized our results in higher dimensions.

Abstract

We introduce an innovative approach to automated sleep stage classification using EOG signals, addressing the discomfort and impracticality associated with EEG data acquisition. In addition, it is important to note that this approach is untapped in the field, highlighting its potential for novel insights and contributions. Our proposed SE-Resnet-Transformer model provides an accurate classification of five distinct sleep stages from raw EOG signal. Extensive validation on publically available databases (SleepEDF-20, SleepEDF-78, and SHHS) reveals noteworthy performance, with macro-F1 scores of 74.72, 70.63, and 69.26, respectively. Our model excels in identifying REM sleep, a crucial aspect of sleep disorder investigations. We also provide insight into the internal mechanisms of our model using techniques such as 1D-GradCAM and t-SNE plots. Our method improves the accessibility of sleep stage classification while decreasing the need for EEG modalities. This development will have promising implications for healthcare and the incorporation of wearable technology into sleep studies, thereby advancing the field's potential for enhanced diagnostics and patient comfort.

Abstract

We focus on the problem of LiDAR point cloud based loop detection (or Finding) and closure (LDC) for mobile robots. State-of-the-art (SOTA) methods directly generate learned embeddings from a given point cloud, require large data augmentation, and are not robust to wide viewpoint variations in 6 Degrees-of-Freedom (DOF). Moreover, the absence of strong priors in an unstructured point cloud leads to highly inaccurate LDC. In this original approach, we propose independent roll and pitch canonicalization of point clouds using a common dominant ground plane. We discretize the canonicalized point clouds along the axis perpendicular to the ground plane leads to images similar to digital elevation maps (DEMs), which expose strong spatial priors in the scene. Our experiments show that LDC based on learnt embeddings from such DEMs is not only data efficient but also significantly more robust, and generalizable than the current SOTA. We report an (average precision for loop detection, mean absolute translation/rotation error) improvement of (8.4, 16.7/5.43)% on the KITTI08 sequence, and (11.0, 34.0/25.4)% on GPR10 sequence, over the current SOTA. To further test the robustness of our technique on point clouds in 6-DOF motion we create and opensource a custom dataset called LidarUrbanFly Dataset (LUF) which consists of point clouds obtained from a LiDAR mounted on a quadrotor. More details on our website https://gsc2001.github.io/FinderNet/

Abstract

Worldover, seismic design of buildings typically follows a prescriptive approach in which designers conform to a series of prescriptive code requirements in terms of both analysis and design procedures. Even though this prescriptive seismic design approach is time-tested and easily understandable by structural designers. In the recent past, performance-based seismic design has started to gain traction among structural designers. The performance-based seismic design allows designers to set performance objectives and design buildings to meet the targeted performance criteria. Due to its flexible nature, performance-based design has proven extremely useful for critical and lifeline buildings like hospitals and tall buildings. With a focus placed on performance objectives, designers utilizing performance-based seismic design are proficient in designing code exceeding buildings efficiently. Despite these cited benefits, performance-based design is still considered an uncommon practice in structural design, particularly in the developing countries. Hence, the present study aims to provide an overview and framework to practice performance-based seismic design. This work identifies and discusses the key differences between the prescriptive- and performance-based seismic design methods and also addresses the significance, application and implementation of performance-based seismic design of buildings. This paper makes an original contribution to the literature through a critical review of how the performance-based design withholds the opportunity to elevate the role of the structural engineers to which they are informed members of the community, where the structures they create not only perform according to design prescriptions, but also perform according to the needs of the owners, engineers, and society.