Abstract

The global impact of coal mining and associated activities on land use/land cover (LULC) changes is significant. This study used Landsat satellite images from 1990 to 2020 to assess LULC changes and their impact on land surface temperature (LST) in four districts of Chhattisgarh state, India. Over three decades, Korba and Raigarh districts saw expansion in coal mines, built-up areas, and water bodies, while forest areas diminished by 711.3 km2 and 212.87 km2, respectively. Koriya district saw coal mine expansion of 5.68 km2 (1990–2010), later declining to 2.85 km2, alongside growth in built-up regions, and forest cover reduction by 251.31 km2 in 2020. Surguja district experienced coal mine and built-up area expansion (1990–2020), with initial forest decline of 160.21 km2 in 2010 followed by recovery in 2020. LST was determined using the Mono-window algorithm. LST increased during winter and summer, with the most significant rise in summer. Vegetation-rich regions had lower LST, while coal mines had the highest temperatures. There was a positive relationship between mining land patch size and patch temperatures. This study underscores the need for vegetation restoration in mining areas, particularly abandoned sites, and sustainable mining practices to mitigate coal mining's warming effects.

Abstract

Generative Large Language Models (LLMs) have achieved remarkable advancements in var- ious NLP tasks. In this work, our aim is to ex- plore the multilingual capabilities of large lan- guage models by using machine translation as a task involving English and 22 Indian languages. We first investigate the translation capabilities of raw large language models, followed by ex- ploring the in-context learning capabilities of the same raw models. We fine-tune these large language models using parameter efficient fine- tuning methods such as LoRA and additionally with full fine-tuning. Through our study, we have identified the best performing large lan- guage model for the translation task involving LLMs, which is based on LLaMA.

Abstract

The task of headline generation within the realm of Natural Language Processing (NLP) holds immense significance, as it strives to dis- till the true essence of textual content into con- cise and attention-grabbing summaries. While noteworthy progress has been made in head- line generation for widely spoken languages like English, there persist numerous challenges when it comes to generating headlines in low- resource languages, such as the rich and diverse Indian languages. A prominent obstacle that specifically hinders headline generation in In- dian languages is the scarcity of high-quality annotated data. To address this crucial gap, we proudly present Mukhyansh, an extensive mul- tilingual dataset, tailored for Indian language headline generation. Comprising an impressive collection of over 3.39 million article-headline pairs, Mukhyansh spans across eight promi- nent Indian languages, namely Telugu, Tamil, Kannada, Malayalam, Hindi, Bengali, Marathi, and Gujarati. We present a comprehensive evaluation of several state-of-the-art baseline models. Additionally, through an empirical analysis of existing works, we demonstrate that Mukhyansh outperforms all other mod- els, achieving an impressive average ROUGE-L score of 31.43 across all 8 languages.

Abstract

Analysis of Indian English (IE) pronunciation variabilities is useful in ASR and TTS modelling for the Indian context. Prior works characterised IE variabilities by reporting qualitative phonetic rules relative to Received Pronunciation (RP). However, such characterisations lack quantitative descriptors and data-driven analysis of diverse IE pronunciations, which could be due to the scarcity of phonetically labelled data. Furthermore, the versatility of IE stems from the influence of a large diversity of the speakers’ mother tongues and demographic region differences. To address these issues, we consider the corpus Indic TIMIT and manually obtain 13, 632 phonetic transcriptions in addition to those parts of the corpus. By performing a data-driven analysis on 15, 974 phonetic transcriptions of 80 speakers from diverse regions of India, we present a new set of phonetic rules and validate them against the existing phonetic rules to identify their relevance. Finally, we test the efficacy of Grapheme-to-Phoneme (G2P) conversion developed based on the obtained rules considering Phoneme Error Rate (PER) as the metric for performance.

Abstract

Automatic syllable stress detection is helpful in assessing L2 learners’ pronunciation. In this work, for stress detection, we propose a representation learning framework by jointly optimizing VAE and DNN. The obtained representations from the proposed VAE plus DNN framework are compared with the implicit representations learned from DNN-based stress detection. Further, we compare the obtained representations from VAE plus DNN with those obtained from autoencoder (AE) plus DNN, and sparse-autoencoder (SAE) plus DNN considering with/without implicit representations from DNN. We perform the experiments on the ISLE corpus consisting of English utterances from German and Italian native speakers. We observe that the detection performance with the learned representations from VAE plus DNN is significantly better than that with the state-of-the-art method without any representation learning with the highest improvement of 2.2%, 5.1%, and 1.4% under matched, combined, and cross scenarios, respectively.

Abstract

This work proposes the utilization of a self-supervised pre-trained network for developing a Language Identification (LID) system catering to low-resource Indian languages. The framework employed is Wav2vec2.0-XLSR-53, pre-trained on 53k hours of unlabeled speech data. The unsupervised training of the model enables it to learn the acoustic patterns specific to a language. Given that languages share phonetic space, multi-lingual pre-training is instrumental in learning cross-lingual information and building systems that cater to low-resource languages. Further fine-tuning with a limited amount of labeled data significantly boosts the model’s accuracy. The results showcase a relative improvement of 33.2% over the DNN-A (DNN with attention) model and 19.04% over Dense Resnets for the Language Identification task on the IIITH-ILSC database using the proposed features (Shivang Gupta and Kowshik Siva Sai Motepalli share first authorship).

Abstract

Background The Empathizing-Systemizing theory proposes that individuals with Autism Spectrum Disorder are systemizers and prefer Intense music characterized as loud , distorted, electric and percussive musical attributes and aggressive emotional attributes, typical of genres such as heavy metal, hard rock. However, there have been no studies that have tested this theory in a cross cultural setting. Aim The aim of this cross-cultural study is to gather music preferences by Indians and Non-Indians (US and Europe) and verify Baron-Cohen’s hypothesis. Method The Indian population of 20 participants (n=20; male, aged - 18-24 years), were contacted directly while for the Non-Indian population of 30 participants (n=25; US, n=5; Europe, male, aged 18-24) , we used social media platform Reddit (r/asperges and r/autism sub-reddit groups). Semi structured interviews were conducted to gather their demographic information, music they liked and disliked and how listening to music helps them in everyday life. Subsequently a mix of 10 songs each were curated comprising 5 songs they liked and out of the remaining 5 songs , 3 are of the genre they liked and 2 of the genre they disliked, taken from other individual’s playlist in a controlled setting. While playing each song, their likert responses (Like, Neutral, Dislike) were recorded per stimulus. Music Preferences were assessed based on the MUSIC model framework. Results Out of 20 participants, 18 preferred a mix of relaxing, non-aggressive, slow, quiet and instrumental musical attributes categorized as mix of Mellow and Sophisticated factor which helped in improved sleep and social skills and disliked music with loud and rebellious musical attributes categorized as Intense factor which shows that music serves for emotion regulation towards positive emotions in Indian population. In comparison , out of the 30 participants 22 preferred music categorized as Intense factor which brought in a calming factor when stressed and disliked music categorized as a mix of Mellow and Sophisticated factors which shows that music serves to discharge negative emotions in the Non-Indian group. Implications These results provide support to the Empathizing–Systemizing Theory for Non-Indian population but not for Indian population. It also suggests that cultural differences affect emotional arousal. These findings are helpful to build a recommendation system based on an individual’s preferences that can help in arousal regulation, sensory modulation difficulties commonly found among individuals with ASD.

Abstract

Humans use abstract concepts for understanding instead of hard features. Recent interpretability research has focused on human-centered concept explanations of neural networks. Concept Activation Vectors (CAVs) estimate a model’s sensitivity and possible biases to a given concept. In this paper, we extend CAVs from post- hoc analysis to ante-hoc training in order to reduce model bias through fine-tuning using an additional Concept Loss. Concepts were defined on the final layer of the network in the past. We generalize it to intermediate layers using class prototypes. This facilitates class learning in the last convolution layer, which is known to be most informative. We also introduce Concept Distillation to create richer concepts using a pre-trained knowledgeable model as the teacher. Our method can sensitize or desensitize a model towards concepts. We show applications of concept-sensitive training to debias several classification problems. We also use concepts to induce prior knowledge into IID, a reconstruction problem. Concept-sensitive training can improve model interpretability, reduce biases, and induce prior knowledge. Please visit https://avani17101.github.io/Concept-Distilllation/ for code and more details

Abstract

iven multiple videos of the same task, procedure learn- ing addresses identifying the key-steps and determining their order to perform the task. For this purpose, existing approaches use the signal generated from a pair of videos. This makes key-steps discovery challenging as the algo- rithms lack inter-videos perspective. Instead, we propose an unsupervised Graph-based Procedure Learning (GPL) framework. GPL consists of the novel UnityGraph that rep- resents all the videos of a task as a graph to obtain both intra-video and inter-videos context. Further, to obtain sim- ilar embeddings for the same key-steps, the embeddings of UnityGraph are updated in an unsupervised manner using the Node2Vec algorithm. Finally, to identify the key-steps, we cluster the embeddings using KMeans. We test GPL on benchmark ProceL, CrossTask, and EgoProceL datasets and achieve an average improvement of 2% on third-person datasets and 3.6% on EgoProceL over the state-of-the-art.

Abstract

We present Ego-Exo4D, a diverse, large-scale multi- modal multiview video dataset and benchmark challenge. Ego-Exo4D centers around simultaneously-captured ego- centric and exocentric video of skilled human activities (e.g., sports, music, dance, bike repair). More than 800 participants from 13 cities worldwide performed these ac- tivities in 131 different natural scene contexts, yielding long-form captures from 1 to 42 minutes each and 1,422 hours of video combined. The multimodal nature of the dataset is unprecedented: the video is accompanied by mul- tichannel audio, eye gaze, 3D point clouds, camera poses, IMU, and multiplepaired language descriptions—including a novel “expert commentary” done by coaches and teach- ers and tailored to the skilled-activity domain. To push the frontier of first-person video understanding of skilled hu- man activity, we also present a suite of benchmark tasks and their annotations, including fine-grained activity un- derstanding, proficiency estimation, cross-view translation, and 3D hand/body pose. All resources will be open sourced to fuel new research in the community