Abstract

Reading and writing documents is one among the primary skills with which we gather and communicate information. With the emergence of artificial intelligence (AI), researchers are in constant pursuit to build intelligent algorithms that can bring our physical and digital worlds close to each other. One such important domain is document image analysis, where we delve into the problem of understanding content from scanned document image collections. Considering “words” as the basic unit in understanding a document, in this thesis, we address the problem of finding the best possible representation for word images. Representation learning has been a key investigation for an AI problem. The primary goal of this thesis is to learn efficient representations for word images that encode its content. An ideal representation should be invariant to multiple fonts, handwritten styles and less sensitive to noise and distortions. In the past, representations have been handcrafted, specific to modalities (printed, handwritten), and sensitive to the complexities in handwriting in multi-writer scenarios. In this work, we choose the paradigm of learning from data using deep neural networks. We take our inspiration from the fact that given large amounts of annotated data, modern deep neural networks can inherently learn better representations. In this thesis, we also relax the need for large annotated datasets by heavily capitalizing on synthetically generated images. We also introduce a novel problem of learning semantic representation for word images which encodes the semantics of the word and reduces the vocabulary gap that exists between the query and the retrieved results. The first contribution of this thesis is a simple technique to generate large amounts of synthetic data, useful for pre-training deep neural networks. This led to the creation of IIIT-HWS dataset which is now widely used in the document community. The other major contributions of this thesis are: (a) the design of a deep convolutional architecture (named as HWNet) for learning an efficient holistic representation for word images, (b) a joint embedding scheme to project words and textual strings onto a common subspace, and (c) a novel form of word image representation which respects the word form along with its semantic meaning. The learned representations are evaluated under the tasks of word spotting and word recognition. We report state-of-the-art performance on popular datasets under both modern/historical and handwritten/printed document images while keeping the representation size compact in nature. Finally, in order to validate the proposed representations of this thesis, we present some interesting use cases such as (i) finding similarity between a pair of handwritten documents images, (ii) searching for keywords from online lecture videos, and (iii) building word retrieval system for Indic scripts.

Abstract

Neural Machine Translation (NMT) is a rapidly advancing MT paradigm and has shown promising results for many language pairs, especially in large training data scenarios. But Indian to English language Machine Translation is a challenging problem, owing to multiple factors including the structural and morphological difference, in addition to the lack of sufficient parallel training data, thereby demanding efficient strategies to improve the translation quality of the NMT systems. Although NMT is a promising approach, it still lacks the ability of modeling deeper semantic and syntactic aspects of the language. In machine translation with a low-resource setting, resolving data sparseness and semantic ambiguity problems can help improve its performance. In this thesis, we investigate utilizing extra syntactic and semantic linguistic factors in the context of the NMT framework for a low resource language pair i.e. Hindi-English. We propose a new architecture to incorporate explicit linguistic input features into the state-of-the-art Transformer network and demonstrate considerable performance improvements. Despite the massive success brought by neural machine translation, it has been noticed that the vanilla NMT often lags behind conventional machine translation systems, such as statistical phrase-based translation systems, for low-resource language pairs. In the past few years, various approaches have been proposed to address this issue but not much work has been done for Indian languages in this context. In this thesis, we also present our efforts towards building efficient Neural Machine Translation systems between Indian languages (specifically Indo-Aryan languages) and English via exploring the effectiveness of Multilingual Learning and Transfer Learning. We describe techniques to leverage the language relatedness among Indo-Aryan languages to improve the translation quality for individual language pairs. We also present our new approach Multilingual Transfer Learning which outperforms the aforementioned techniques. Neural MT models are generally trained using a Maximum Likelihood Estimation (MLE) objective and are tested with sequence level evaluation metrics such as BLEU. To address this inconsistency issue, Reinforcement Learning (RL) methods have been adopted to directly optimize sequence-level objectives. In this thesis, we also present an approach for training Neural Machine Translation systems using Advantage Actor-Critic method from Reinforcement Learning. Our approach directly optimizes the model parameters with respect to the task specific scores, unlike conventional maximum likelihood estimation and is fit for problems with low resource settings, large action space & delayed rewards. We also demonstrate experiments to leverage our approach to further boost the performance of NMT systems using source & target monolingual data for a low resource language pair like Hindi-English.

Abstract

The performance of speech recognition (ASR) system degrades when there is a mismatch between training and operating environments. The presence of expressive (emotional) speech is one among the mismatches in operating environments as majority of ASR systems are trained using neutral speech. The emotional state of the speaker induces changes in the speech characteristics and effects the ASR system in practical scenarios. The goal of this thesis is to improve the performance of ASR systems in these emotional conditions. The key challenge in addressing this research problem is the lack of resources, where the existing emotional databases are limited in the number of speakers and their size. The main focus of this thesis is to create the required infrastructure to study this challenging problem for low resource Telugu language and present different exploratory studies to evaluate the accuracy of Telugu ASR systems. This thesis investigates several different techniques at various stages of the recognition process that are suitable for building an emotionally robust ASR system. In the first study, prosody modification is employed at the pre-processing level of the speech recognizer. Model-based and feature-space adaptation approaches are also analyzed towards the improvement of ASR systems. These emotion adaptation strategies were studied using various deep neural network (DNNs) architectures and shown to be effective in comparison with baseline Gaussian mixture models (GMMs). The experiments are conducted using IIT Kharagpur simulated emotion speech corpus (IITKGP-SESC) and IIIT-Hyderabad Telugu naturalistic emotional speech corpus (IIIT-H TNESC). Some studies and the major conclusions are: • Prosody parameters such as pitch, duration and energy play a vital role in the analysis of emotional speech. In the first study, prosody modification is used at the pre-processing level to convert the emotional speech to neutral speech. This prosody modified emotional speech has shown an improvement in the performance of the ASR system at the preprocessing level. • In the second study, prosody modification is used to create the training data from the given neutral to emotional speech. Different ASR models were built for the generated emotional speech along with the existing neutral speech. An emotion recognition system built using differenced prosody features is used to route speech to the corresponding ASR model. • From the above studies, we observed that the emotion data used for training resulted in better performance than pre-processing emotional speech. Hence the feasibility of extending the emotion adaptation algorithms of GMM-HMM acoustic models to DNN based models is explored using model-based and feature-space adaptation approaches in the third study. The best performance is observed for TDNN based acoustic models which use utterance level decisions as their objective function instead of a standard frame level decision. • Feature space adaptation strategies have performed better than model space adaptation techniques. The auxiliary features appended to the conventional MFCCs contain emotion specific information, which helps in better handling of emotional speech by the ASR systems. Model-based adaptation could have performed well, when sufficient emotional data is provided for adaptation. fMLLR based adaptation are effective in handling the emotion-specific information in comparison with MAP adaptation for building the ASR systems.

Abstract

The choice of platform to launch one’s product/service on in order to maximize the adoption the product/service gets with minimal marketing costs is a matter of high-stakes for product makers. This choice is especially tougher for startup founders or very early stage product makers as they often have highly limited resources and hence cannot afford to either launch on multiple platforms to maximise the opportunity for adoption or to launch on a single platform and get the decision wrong. Yet, it has been very tough and complicated for product makers to make this choice due to the lack of any framework or theoretical foundation enabling this decision. In this thesis, we attempt to create a scale that product makers can use to evaluate various platforms available to them and make the logical choice of platform in a pre-launch stage with minimal effort and costs. Through this thesis, we have evaluated seven factors namely Platform readiness index, Product platform fit, Perceived security, Perceived price, Contextual accessibility, Contextual modality compatibility and Degree of plasticity in an attempt to create a scale that product makers can use to make a decision regarding which platform would be ideal for them to launch their product/service on. These seven factors were arrived at through the learnings from the journey of a real startup, Bucker. The learnings from Bucker were further conceptually strengthened through a literature review. Two confirmatory studies were then conducted further to evaluate the validity of these seven factors to belong to the Pros Scale. The first study expanded the existing model Decomposed Theory of Planned behaviour and utilized the statistical tool structural equation modelling to answer whether or not the seven factors have an impact on the potential adoption a product/service would get when launched through a particular platform. The second study was in an attempt to answer if three of the factors, namely Degree of plasticity, Perceived security and perceived price, are differentiating between various platforms to ensure the parsimony of the PROS scale and utilized the statistical tool ANOVA for this. Through these studies, we were able to find substantial evidence for five factors namely Platform readiness index, Product platform fit, Perceived price, Contextual modality compatibility and Degree of plasticity to belong on the Pros scale . In addition to providing a practical scale early-stage product makers can use to evaluate the platform choices they have to decide which platform to launch their product/service on, we have also successfully expanded the existing D-TPB model to now include platform factors as significant influencers of the adoption and thus advancing the theoretical models in the information systems adoption research field.

Abstract

MLWare applications is an upcoming term used to refer to Software applications that use MachineLearning approaches/algorithms (in part) to address the application’s objective. The development andutilization of such applications is growing rapidly in every major sector with the increase in speedand volume of data collection/analysis. These applications tend to be complex and hence maintainingthem can be a difficult task. The complexity of the applications may be due to the inherent complexityof algorithms used or may be accidental due to the structural and dynamic relationships between thevarious sub-systems of the application. Maintaining such complex systems can a difficult task as thereare challenges such as comprehension of complex code base, lack of documentation, lack of supporttools, etc. Furthermore, such applications tend to be algorithm centric. As a result, there is a lack ofsoftware engineering rigour associated with building such applications.Researchers have started to work on integrating software engineering practices while buildingMLware applications. Applying software engineering practices, specifically pattern based approachesfor the development of MLware applications can potentially improve reliability, robustness,extensibility, scalability and other such quality attributes. Another problem with MLware applicationsis the need for an explanation associated with the decisions arrived at during various stages. This isdifficult as some Machine Learning models are black-box models and hence explainability is a difficultcharacteristic to achieve.In this thesis, developing maintainable, scalable, and explainable MLware applications usingsoftware engineering practices is described and a proof of concept implementation for the specific caseof credit risk evaluation is detailed. Microservices based architecture is used to develop the applicationwith the use of Strategy design pattern.This helps with scalability and maintainability of theapplications. A simple approach to understand the decision made by the machine learning model isalso provided. We detail the set of practices using a credit risk evaluation MLware application thathelps a loan granting officer in deciding whether to grant the loan or not. The implementation is doneusing Django framework and is deployed on Heroku server

Abstract

Social media has provided new opportunities to users for creating, accessing, and sharing information in a location independent and timeless fashion. Recent years have witnessed exponential rise in the number of individuals and organizations using social media for sharing healthcare information which is publicly accessible. Medical social media is a subset of social media, in which the interests of the users are specifically devoted to medicine and health related issues. Medical social media encompasses healthcare related texts in generic social media platforms such as WordPress, Twitter, Facebook, Quora, Instagram, YouTube as well as medical forums such as patientslikeme.com, https://patient.info/forums, doctorslounge.com and kevinmd.com/blogs. People use medical social media for a variety of reasons such as seeking answers to specific questions, giving expert advice about a particular drug or a treatment, spreading awareness, sharing experiences, reporting discoveries and findings, voicing opinions and forming communities. Apart from individual users, a lot of medical organizations such as hospitals, clinics, and insurance companies are also actively contributing to medical social media. Medical social media data plays a crucial role in several applications such as studying the unintended effects of a drug (pharmacovigilance), hiring potential participants for a clinical trial, promoting a drug, monitor public health and healthcare delivery. However, extracting information from medical social media is challenging due to various reasons. First, medical social media posts are highly noisy; they are plagued with incorrect spellings, incorrect grammar, non-standard abbreviations and slang words. Owing to this, the current medical information extraction tools fail to extract concept mentions such as imence pain in ma leg which are very frequent in medical social media. Secondly, several applications rely on human labeled examples for training supervised machine learning models. Manually creating such datasets is effort-intensive and expensive. Lastly, several applications require the persona associated with a medical social media post. Medical social media contributors belong to various persona such as patient, consultant, journalist, caretaker, researcher and pharmacist. Identifying the medical persona from the content of a medical social media post is a challenging task. In this thesis, we propose solutions for three important problems related to information extraction from medical social media. In our first contribution, we address the problem of medical persona classification which refers to computationally identifying the medical persona associated with a particular medical social media post. We formulate this as a supervised multi-class text classification task and propose a neural model for it. In order to minimize the human labeling effort, we propose a distant supervision based approach to heuristically obtain labeled examples which can be used for training the model. In our second contribution, we address the task of medical concept normalization, which aims to map concept mentions such as not able to sleep to their corresponding medical concepts such as Insomnia. We propose neural models which are capable of mapping any concept mention to its corresponding medical concept in standard medical vocabularies such as SNOMED CT1 . There are several challenges associated with existing methods for normalizing medical concept mentions. First, creating training data is effort intensive, as it requires manually mapping medical concept mentions to entries in a target lexicon such as SNOMED CT. Secondly, existing models fail to map a mention to target concepts which were not encountered during the training phase. Thirdly, current models have to be retrained from scratch whenever new concepts are added to the target lexicon, which is computationally expensive. We propose a neural model which overcomes these limitations. Our model scales to millions of target concepts and trivially accommodates a growing target lexicon size without incurring a significant computational cost. While our approach reduces the need for human-labeled examples, it does not completely eliminate it. In order to overcome this grave practical challenge we propose a distant supervision based approach to train our model. We extract informal medical phrases and medical concepts from patient discussion forums using a synthetically trained classifier and an off-the-shelf medical entity linker respectively. We use pretrained sentence encoding models to find the k-nearest phrases corresponding to each medical concept. The resultant mappings are used to train our model, which shows significant performance improvements over previous methods while avoiding manual labeling. In our third contribution, we focus on the problem of automatic simplification of medical text. Patients and caregivers are increasingly usi

Abstract

Soil act as supporting medium for buildings as loads from the buildings transfer to soil. Ability of soil to resist these loads depends on type of building and on type of soil. Existing soil tests and geotechnical investigations in practice according to code show the behavior of soil based on only type of soil and discuss results before construction of building. Behavior of soil under the action of these building loads requires attention. This study initiated to considered magnitude of load based on height of buildings and type of soil based on IS 1893 (Part-1)-2016. From earlier studies this study categorized geotechnical investigations based on each low, medium and highrise structures founded on hard, medium and soft soils respectively. Combined behavior of soil and sub-structure of building plays an important role in building safety. Soil-structure interaction (SSI) is important phenomenon which consider soil and substructure behavior together. In past case studies SSI in many of structures studied only under seismic events where behavior of soil becomes complex. It is seen that respective seismic design of these building according to IS code is not sufficient for building safety as type of soil is not considered to required extent in building design. Not only in seismic design even in general design of buildings type of soil is ignored and base of building is assumed to be fixed. This study compare fixed base and flexible base by considering low, medium and high-rise buildings founded on hard, medium and soft soils designed for IS 1893 (Part-1)-2016, fixed base and flexible base respectively. This study considered low (5-storey), medium (10-storey) and high-rise (20-storey) buildings founded on different type of soils according to IS code as hard, medium and soft soils. These 9 buildings designed for base shear obtained from IS 1893 (Part-1)-2016, fixed base and flexible base respectively show that buildings are over designed when compare with flexible base. In hard soil, building designed for IS Code is 11%, 21%, 33% overdesigned than flexible base building, in medium soil it is 9%, 21%, 33% overdesigned and in soft soil it is 25%, 45%, 59% overdesigned in all low, medium and high-rise buildings respectively. Buildings with overdesign are assumed to be safe, to check the safety of these overdesigned buildings linear dynamic analysis and pushover analysis were performed, from these analysis it is proved that flexible base design is safe and economic than IS code and fixed base design except for high-rise buildings on soft soil. For these high-rise buildings soil improvement techniques are suggested as mentioned in Appendix B.

Abstract

The Lok Sabha Elections 2019 in the ’s largest democracy, India, was a significant electoral event.These elections are conducted to elect representatives across the country for a period of 5 years and arealso key to the process of selecting the Prime Minister, the highest authority in the Union cabinet. Inkeeping with global trends, the Indian elections saw a very prominent use of Online Social Media bypolitical parties to create discourses in their favour. We focus our study on Twitter, collecting over 45Million tweets, tracking more than 3,500 hashtags and over 2,500 political handles while monitoringtheir network interactions.We begin with a study of major political trends in the country since its independence in 1947. We lookat political alignments and realignments in the country that led to a shift from a Single Party dominantpolitical system to a strong two-party system we have today. Our study focuses on national politicaltrends, and not on individual states. We thus study two political blocs - the National Democratic Alliance(NDA, led by the Bharatiya Janata Party) and the United Progressive Alliance (UPA, led by the IndianNational Congress).We did a comparative analysis of various political parties in India and their Social media presenceduring the 2019 General Elections. We also perform a social network graph analysis for the verifiedpolitical handles who were active during the 2019 Elections. This helps us understand their relationshipswithin and across the parties. We are also able to see a direct correlation between the node-size of apolitical handle in its cluster, and its hierarchy in the party. This follower-following network shows anunmistakable relationship between politicians at an individual node level, and between the parties thatsupport each other at the cluster level.We then move on to analyse the nature of political discourse that parties attempted to propagate in theonline sphere. We analyze the Manifestos released by both the major political parties - BJP and INC. Weanalyze tweets collected during the 2019 elections to see how narratives were shaped and altered over time. We study the narratives propagated by the party already in power and how they were supportedor challenged by other parties. Spanning over 5 months, January to May 2019, we analyzed monthlychanges in the political messaging promoted by leading political parties and leaders. We then speculateon the impact of these changes on existing narratives during the campaigning and the elections.We further move onto a comparative discourse analysis between the 2014 and 2019 General Electionsin India. We begin by understanding how these elections were fundamentally different with regardsto the incumbency factor and various other politico-economic factors. Given the contrasting politicalscenarios, we observe how the ruling and the opposition party brought a change in the discourses duringthe two elections. We compare our results with the on-ground surveys (or the Mood of the Nation)conducted by Lokniti, a research programme run by the Delhi-based CSDS, across the nation.This thesis helps in getting a clear picture of the activity in the online eco-system during the 2019General Elections. The discourse analysis helps in understanding how the conversations were shaped onthe web and what impacts it had. Understanding the data and numbers from a socio-political perspective,we see how narratives that were formed online, steered the offline world and vice versa. The networkand social media analysis of the political handles aids in understanding how the political parties in Indiadrove their online battles. Adding on to a study conducted during the 2014 General Elections, we alsocontrasted the 2019 and 2014 General Elections in India.

Abstract

Recent advances in the semiconductor industry for the internet of things have increased the demand for novel, fast and robust circuits. The thirst for high-processing ICs is ever increasing. This has pushed the demand for high data rates in wireless and wireline communication systems in the multi-Gbps range. For high-speed transmission of data, there arises a need for high-speed on-chip clocking circuits making the use of Phase-Locked Loops (PLLs) crucial. Phase-Locked Loops are used for synchronization, synthesis of clock ,and jitter reduction in mobile or wireless communications. For demodulating a signal and recovering it to its original input signal, the PLL circuit is used. PLL has wide application in high frequency ranges (Giga Hertz) as crystal oscillators have a limited operating frequency range in the oder of MegaHertz. The current reference is an indispensable circuit in analog, digital, and power electronic systems. Since it is easy to implement a voltage reference by the bandgap circuit, current references are derived from voltage references by voltage to current conversion. However, this conversion may take more silicon area since it contains transistors, operational amplifier, and resistors. In this thesis, we present a robust on-chip clock generator circuit using a power efficient phase frequency detector and a low current mismatch dual adaptive regulated charge pump. Another technique for charge pump has been proposed to implement PLL using Dynamic Voltage Frequency Scaling (DVFS) scheme. To manifest the effectiveness of this DVFS, a 10-bit Successive Approximation ADC (SAR ADC) is built. The current reference circuit is proposed which is robust to process, temperature, and voltage variations. Ring oscillator and temperature sensor are built using the proposed current reference circuit. The simulations of all circuits are done by using the Cadence Virtuoso tool in the 180nm UMC MPW RF process.

Abstract

The word ‘Cloud’, in its traditional term, gives the illusion of immense and infinite capacity. This has been made very true by some of the leading public cloud providers. However, it is the subscription based, on-demand and flexible nature of the Cloud that attracts organizations. The sheer thought of running capacity comparable to a super-computer, spawning the entire infrastructure from scratch in minutes and paying at an hourly rate, is powerful. With virtual resources ready to start on the press of a button, cloud gave birth to programmable infrastructure. Gone are the days when only shell scripts were used to configure servers. Now an entire data center could be deployed using a few lines of code. This is so powerful and tempting that organizations are opting for a cloud-like model for handling their in-house resources, giving birth to the private cloud. Both public and private clouds offer great opportunities to start from scratch, but this is not an option for organizations which have been running their services on traditional infrastructure for years. Many organisations are already migrating their services and applications to cloud. This involves a lot of decision making and resources, both in terms of time and money. With plenty of public cloud providers available currently, choice isn’t straightforward. Apart from a few common features, each provider has offerings specific to their platform. With differences in APIs, features, cost etc. selecting a specific cloud becomes a long term commitment for the company. Due to inherent heterogeneity present in the cloud space, coming up with a unified solution which is compatible across all providers isn’t cheap and at times not even feasible. Our thesis focuses on designing and building solutions to facilitate migration of applications from a traditional setup to Cloud and enable a subset of applications and workload to use Multiple Clouds - across public providers or hybrid environments. A lift and shift strategy for migration could result in disruption of services. An approach to migrate a group of processes from one host to the other without ever stopping them is called live migration. To minimize the disruption and performance of services, we propose two live migration strategies - inter-hypervisor and inter-cloud. The former enables an organization to migrate their Virtual Machines to different physical machines allowing them to easily move to a Private Cloud. The latter allows live migration of containers across different nodes. Due to no dependence on hypervisors, the latter offers a solution to move to a public cloud. Live migration has a lot of inherent challenges and a majority of workloads don’t have such stringent downtime requirements which demand live migration. Not to mention that most production applications are clustered and have multiple replicas to be Highly Available. In such cases, it would be simpler and preferred to spawn a new process in the remote location and failover instead of live migration. Ideally, we should be using frameworks which support multiple clouds and migration of an application to a new cloud should simply be increasing its deployment scope. Our work has been focussed on building frameworks which leverage multiple cloud providers out of the box and reducing the heterogeneity between cloud providers. We’ve developed frameworks and prototypes for few standard applications and platforms to run them seamlessly across multiple cloud environments. To that end, we propose the design of MultiPaas, a platform capable of running traditional web applications across multiple cloud providers. We target the fundamental problem associated with running a PaaS across multiple clouds and design this as an extension to an existing PaaS, Deis. We built a platform, MultiStack, which enables Big Data frameworks to run across multiple public and private cloud providers. It currently supports Hadoop, a popular Big Data solution, and can be easily expanded to support others. It supports both EC2 API, allowing seamless adoption of AWS, Rackspace, Openstack and Eucalyptus cloud solutions