Abstract

We introduce multimodal story summarization by leveraging TV episode recaps – short video sequences interweaving key visual moments and dialog from previous episodes to bring viewers up to speed. We propose PlotSnap, a dataset featuring two crime thriller TV shows with rich recaps, and long-form content over 40 minutes per episode. Recap shots are mapped to corresponding sub-stories that serve as labels for story summarization. We propose a hierarchical model TaleSumm that (i) processes entire episodes by creating compact shot and dialog representations, and (ii) predicts importance scores for each video shot and dialog utterance by enabling interactions between local story groups. Unlike traditional summarization tasks, our method extracts multiple plot points from long-form videos. We present a thorough evaluation on this task, including promising cross-series generalization. TaleSumm shows good results on video summarization benchmarks.

Abstract

Indian folk paintings have a rich mosaic of symbols, colors, textures, and stories making them an invaluable repository of cultural legacy. The paper presents a novel approach to classifying these paintings into distinct art forms and tagging them with their unique salient features. A custom dataset named FolkTalent, comprising 2279 digital images of paintings across 12 different forms, has been prepared using websites that are direct outlets of Indian folk paintings. Tags covering a wide range of attributes like color, theme, artistic style, and patterns are generated using GPT4, and verified by an expert for each painting. Classification is performed employing the RandomForest ensemble technique on fine-tuned Convolutional Neural Network (CNN) models to classify Indian folk paintings, achieving an accuracy of 91.83%. Tagging is accomplished via the prominent fine-tuned CNN-based backbones with a custom classifier attached to its top to perform multi-label image classification. The generated tags offer a deeper insight into the painting, enabling an enhanced search experience based on theme and visual attributes. The proposed hybrid model sets a new benchmark in folk painting classification and tagging, significantly contributing to cataloging India’s folk-art heritage.

Abstract

A constant reference voltage/current generating circuit connected between a power supply voltage source and a ground that provides a constant reference voltage/current at an output terminal. The constant reference voltage/current generating circuit includes one or more transistors that generates the constant reference voltage by determining a difference between a gate-source voltage of a first transistor and a gate source voltage of a second transistor with respect to a temperature. The constant reference voltage is mirrored at the output terminal of the constant reference voltage/current generating circuit using a current mirror circuit. The current mirror circuit is connected to the constant reference voltage/current generating circuit.

Abstract

In the field of biometric security, the quality assessment of fingerprint images is paramount for boosting the accuracy of fingerprint recognition systems. These systems are fundamental for the secure and efficient authentication and identification of individuals. Our research presents FRBQ (Fingerprint Recognition-Based Quality), an innovative quality metric designed to navigate the limitations of the NFIQ2 model. FRBQ exploits deep learning algorithms in a weakly supervised setting and utilizes matching scores from DeepPrint, a Fixed-Length Fingerprint Representation Model. Each score is paired with labels indicating the robustness of fingerprint image matches. However, in a fully referenced setting, these labels can be subjective, lacking a clear definition of what "image quality" inherently means. This weakly labeled approach strives to capture diverse perspectives on image quality, potentially making it a more encompassing metric. In comparison to NFIQ2, our research showcases the superior performance of the FRBQ model. It not only correlates better with recognition scores but also effectively evaluates challenging images that NFIQ2 struggles with. Validated by the esteemed FVC 2004 dataset, FRBQ proves its efficacy in fingerprint image quality assessment. This study underscores the transformative potential of AI in biometrics, emphasizing its capability to capture details that traditional methods might overlook. Our work stresses the critical role of precise quality assessment in the evolution of fingerprint recognition systems.

Abstract

An on-chip resistance amplifier which amplifies the resistance of a small on-chip resistor in die size is provided. The amplifier is a two-terminal circuit of which a high voltage terminal ranging from 0.4 Volts to 3.6 Volts and a second low voltage terminal at the ground includes a small on-chip resistor, a Voltage divider, an operational amplifier op-amp, a NMOS transistor. The voltage divider works in ultra-low power. The voltage (V) at high voltage terminal is divided by some gain A which is V/A, a second voltage. The second voltage is given to the on-chip resistor R. The current generated by on-chip resistor is passed through the higher voltage terminal and the resistance seen at the higher terminal is the amplified resistance of A*R.

Abstract

Biomolecules play indispensable roles in all life processes, including disease development, so their accurate detection is critical to cell investigation, medical diagnosis, and treatment. Radio Frequency (RF) sensing has become a popular testing technique compared to traditional methods for biomolecule analysis, providing results in less time using less volume of samples. It allows rapid, sensitive, real-time measurements and label-free techniques. However, for taking the signals from biomolecules over the RF-based sensors we need to connect them with the Vector Network Analyzer (VNA) which is a bulky and costly device. To develop an RF sensing based a true lab-on-chip (LoC) device, the paper presents a fully integrated low-power less-area on-chip single port CMOS VNA designed in 65nm CMOS technology to detect the bio-molecule The proposed design works in a tunable frequency range of 0.5 GHz to 2.5 GHz, ensuring much higher precision. Using an RLC equivalent of an Interdigitated capacitor (IDC) sensor, a fully integrated architecture for detecting $S_{11}$ of the biomolecules has been introduced. A resistive bridge coupler is used for wideband operation with a directivity of 14.89dB up to 2.5 GHz. Also, a high-linearity LNA (low noise amplifier) is designed with a linearity of -13dB and a gain of 14dB. The LNA has a low NF of 3.21dB. The design occupies an active area of 0.01767mm^2 and consumes power of 41mW from a 1 V supply.

Abstract

Molecular spectroscopy studies the interaction of molecules with electromagnetic radiation, and interpreting the resultant spectra is invaluable for deducing the molecular structures. However, predicting the molecular structure from spectroscopic data is a strenuous task that requires highly specific domain knowledge. DeepSPInN is a deep reinforcement learning method that predicts the molecular structure when given Infrared and 13C Nuclear magnetic resonance spectra by formulating the molecular structure prediction problem as a Markov decision process (MDP) and employs Monte-Carlo tree search to explore and choose the actions in the formulated MDP. On the QM9 dataset, DeepSPInN is able to predict the correct molecular structure for 91.5% of the input spectra in an average time of 77 seconds for molecules with less than 10 heavy atoms. This study is the first of its kind that uses only infrared and 13C nuclear magnetic resonance spectra for molecular structure prediction without referring to any pre-existing spectral databases or molecular fragment knowledge bases, and is a leap forward in automated molecular spectral analysis.

Abstract

This paper introduces a novel approach for fault detection and localization in a motor of a Hexacopter UAV. The proposed two-stage architecture leverages Long Short-Term Memory (LSTM) networks for latent temporal feature extraction and Random Forest for localization. By combining them, we see improved fault detection and isolation performance. Our evaluations show the robustness of this approach in varying noise levels and real-world-like environments. Analysis of computational efficiency in rapid detection shows that the model identified faults within 2-5 time steps of the flight. Finally, we show that the proposed method surpasses classical statistical models and deep learning techniques in terms of overall accuracy (96.78%).

Abstract

Aggressive scaling down of transistor dimensions has made process-aware circuit modeling a crucial task. Achieving accurate circuit modeling requires lengthy and resource intensive simulations. Machine Learning-based surrogate models, offering computational efficiency and speed, are viable alternatives to traditional simulators. This paper introduces a meta-learning approach designed to accurately capture process induced variations in the leakage power of VLSI circuits. The impact of a wide range of fluctuations in operating conditions, including temperature (-55°C to 125°C) and supply voltage (±10%) has also been incorporated for leakage modeling. The proposed meta-learning model is versatile, enhancing the performance of underlying baseline machine learning models while eliminating the need for time-consuming hyperparameter optimization. Our experiments on leakage estimation using 16 and 7 nanometer FinFET technology nodes demonstrate an average improvement of up to 50% and 48% in Mean Absolute Percentage Error compared to stand-alone baseline models.

Abstract

Knowledge graphs (KGs) have been playing a crucial role in leveraging informa- tion on web for several downstream tasks, making it vital to construct and maintain them. Despite previous efforts in populating KGs, these methods typically do not focus on analyzing entity-specific content exclusively but rely on a fixed collection of documents. We define an approach to populate such KGs by utilizing entity-specific content on the web, for generating entity embeddings to establish entity-category interconnections. We empirically prove our ap- proach’s effectiveness, by utilizing it for a downstream task of Notability detection, associated with one of the most popular and important Knowledge Graphs - Wikipedia platform. To mod- erate the content uploaded to Wikipedia, “Notability” guidelines are defined by its editors to identify named entities that warrant their article on Wikipedia. So far notability is enforced by humans, which makes scalability an issue, and there has been no significant work on automat- ing this process. In this paper, we define a multipronged category-agnostic approach based on web-based entity features and their text-based salience encodings, to construct entity embed- dings for determining an entity’s notability. We distinguish entities based on their categories and utilize neural networks to perform classification. For validation, we utilize accuracy and prediction confidence on popular Wikipedia pages. Our system outperforms machine learning- based classifier approaches and handcrafted entity salience detection algorithms, by achieving performance accuracy of around 88%. Our system provides an efficient and scalable alterna- tive to manual decision-making about the importance of a topic, which could be extended to other such KG-based tasks