Abstract

Embodiments herein provide a system and a method for automatically generating at least one synthetic talking head video using a machine learning model. The method includes (i) extracting features from each frame of a video that is extracted from data sources,(ii) analyzing, using a face-detection model, the video to determine a driving face video if a number of identities, and faces of speakers are equal to one in all frames of the video,(iii) generating, using a text to speech model, synthetic speech utterances by automatically selecting a vocabulary of words and sentences from the data sources,(iv) modifying lip movements that are originally present in the driving face video corresponding to the synthetic speech utterances, and (v) generating, using machine learning model, synthetic talking head video based on the lip movements that are modified corresponding to the synthetic speech utterances.

Abstract

Universal Semantic Representation (USR) captures how the speaker intends to view a situation. The representation is aimed at being language-independent. The theoretical model, Universal Semantic Grammar (USG), that has been adopted for the task is based on Indian Grammatical Tradition (IGT henceforth) and Pāṇini's grammatical model. USR is not limited to just presenting “who is doing what to whom and when and where” in a sentence. It is about capturing a speaker’s vivakṣā, how the speaker views a situation. The way the speaker views a situation or an event, accordingly he/she selects kāraka roles for the participants of an event, tense-aspect-modility features on the verb, sentence structure by foregrounding and backgrounding information, also various discourse elements such as particles, connectives, co-referencing and so on. USR is a text-based data structure that is close to the Attribute Value matrix (AVM) representation. It is easier to read and write manually, as well as process computationally. This document describes the theoretical foundation of USR and the strategies that have been adopted for USR annotation

Abstract

Sign language is a rich form of communication, uniquely conveying meaning through a combination of gestures, facial expressions, and body movements. Existing research in sign language generation has predominantly focused on text-to-sign pose generation, while speech-to-sign pose generation remains relatively underexplored. Speech-to-sign language generation models can facilitate effective communication between the deaf and hearing communities. In this paper, we propose an architecture that utilises prosodic information from speech audio and semantic context from text to generate sign pose sequences. In our approach, we adopt a multi-tasking strategy that involves an additional task of predicting Facial Action Units (FAUs). FAUs capture the intricate facial muscle movements that play a crucial role in conveying specific facial expressions during sign language generation.

Abstract

In this paper we show an effective means of integrating data driven frameworks to sampling based optimal control to vastly reduce the compute time for easy adoption and adaptation to real time applications such as on-road autonomous driving in the presence of dynamic actors. Presented with training examples, a spatio-temporal CNN learns to predict the optimal mean control over a finite horizon that precludes further resampling, an iterative process that makes sampling based optimal control formulations difficult to adopt in real time settings. Generating control samples around the network-predicted optimal mean retains the advantage of sample diversity while enabling real time rollout of trajectories that avoids multiple dynamic obstacles in an on-road navigation setting. Further the 3D CNN architecture implicitly learns the future trajectories of the dynamic agents in the scene resulting in successful collision free …

Abstract

This work proposes a resource efficient robust control scheme for missile-target engagement scenarios subjected to external disturbances. The robustness is achieved by using an annular event-triggered artificial time-delayed control (ET-TDC) methodology with input saturation. The ET-TDC philosophy uses the TDC strategy through a dynamic predefined triggering mechanism which overcomes the requirement to update the control periodically for every sampling instant, unlike conventional TDC and other robust control schemes. Thus, the proposed methodology, can tackle uncertainties with minimal a priori knowledge while significantly reducing the over-utilization of system resources. In addition, the adopted event triggered mechanism facilitates further conservation of energy which might be crucial for mid-to-long range engagement scenarios. The closed-loop stability is derived analytically and the simulation

Abstract

Climate classification simplifies the representation of expected climate conditions by eliminating the need to describe each climatic parameter. Climate classification is frequently used as a basis for recommendations through codes and standards for buildings because a given climate has nearly similar design conditions. Furthermore, building energy efficiency programmes are designed based on the climatic classification to determine appropriate design strategies to eliminate the under-design or over-design of buildings for similar climatic regions. This necessitates the use of realistic and reliable climate classifications. Over the past two decades, numerous research studies have proposed climate classification methods. However, there is a lack of universal acceptance of climate classification methodology to balance complexity and accuracy. This research provides an overview of various climate classification …

Abstract

This study investigates the impact of loss-framing and individual risk attitude on the willingness- to purchase insurance products, utilizing a game-like interface in a choice architecture. The application presents events as experienced in real-life , as a young adult searching for employment to retirement. Both financial and emotional loss-framing events are followed by choices to purchase insurance. The participant cohorts considered were undergraduate students and older participants, the latter group was further subdivided by income and education. From the within-subject analysis, the preliminary findings reveal that the loss framing effect on insurance consumption is higher in the younger population though contingent on the insurance product type. Health and accident insurance shows a negative correlation with risk attitudes for the younger age and a positive correlation with accident insurance for older participants. Risk attitude and life insurance products willingness-to-purchase showed no dependency. The findings elucidate the role of age, income, family responsibilities, and risk attitude in purchasing insurance products. Importantly, it confirms the correlation between age and the effect heuristics of framing/nudging.

Abstract

Remote Labs refer to an end-to-end system, including hardware and software built to access scientific equipment and resources remotely. The software platform built for such purposes needs to be robust enough to handle the communication of inputs and outputs between the client and the hardware nodes with minimal latency and simultaneously provide a seamless user experience. This paper highlights the importance of scalability in Remote Labs and presents multi-user multiplexing as a solution, to essentially provide users with concurrent access to the hardware node for experiments which can generate outputs instantaneously. The paper discusses the inefficiency of existing web-based Remote Labs with 4-layered architectures and proposes the use of WebSocket with a 3-layer software architecture to enhance user experience, accelerate input-output communication and implement multi-user multiplexing. To showcase the effectiveness of the proposed architecture over existing implementations using Blynk IoT platform as the middleware, a comprehensive communication pipeline was developed from scratch to perform Kirchhoff’s Voltage Law (KVL) experiment remotely.

Abstract

This study investigates the impact of loss-framing and individual risk attitude on willingness- to purchase insurance products utilizing a game-like interface as choice architecture. The application presents events as experienced in real life. Both financial and emotional loss-framing events are followed by choices to purchase insurance. The participant cohorts considered were undergraduate students and older participants; the latter group was further subdivided by income and education. The within-subject analysis reveals that the loss framing effect on insurance consumption is higher in the younger population, though contingent on the insurance product type. Health and accident insurance shows a negative correlation with risk attitudes for younger participants and a positive correlation with accident insurance for older participants. Risk attitude and life insurance products showed no dependency. The findings elucidate the role of age, income, family responsibilities, and risk attitude in purchasing insurance products. Importantly, it confirms the heuristics of framing/nudging.

Abstract

Music listening is a dynamic process that entails complex interactions between sensory, cognitive, and emotional processes. The naturalistic paradigm provides a means to investigate these processes in an ecologically valid manner by allowing experimental settings that mimic real-life musical experiences. In this paper, we highlight the importance of the naturalistic paradigm in studying dynamic music processing and discuss how it allows for investigating both the segregation and integration of brain processes using model-based and model-free methods. We further suggest that studying individual difference-modulated music processing in this paradigm can provide insights into the mechanisms of brain plasticity, which can have implications for the development of interventions and therapies in a personalized way. Finally, despite the challenges that the naturalistic paradigm poses, we end with a discussion on future prospects of music and neuroscience research, especially with the continued development and refinement of naturalistic paradigms and the adoption of open science practices.