I have joined Microsoft Research India as a Postdoctoral Researcher. At MSRI, with Dr. Monojit Choudhury, I am exploring evaluation and enhancement of Neural language models using the combined theories of Language and Logic. Our exploration leads us to consider both traditional neural models and neuro-symbolic variants. Parallel to exploring neuro(symbolic) methods in the context of NLI, I am also exploring multi-hop reasoning capabilities of neural methods in symbolic domains with Dr. Navin Goyal.
Overall, my central goal in research has been devloping models that learns from data, yet enriched by knowledge and capable of reasoning with such knowledge. Developing such models require three central considerations: knowledge acquisition, representation and reasoning. At MSRI and during my PhD, a fundamental observation was that, often an equal measure of concentration is required for each application.
During my doctoral studies, my efforts revolved around Image Understanding under the supervision of Prof. Chitta Baral (Past President of KR.inc, 2016-2018). I was also co-advised by Dr. Yezhou Yang (Assistant Professor, ASU). Through a combination of Deep Learning, Knowledge Representation and Probabilistic Logical Reasoning; I demonstrated the benefits of using reasoning and knowledge in Visual Question-Answering (IJCAI, AAAI), Captioning (CVIU), image puzzle solving (UAI) and visual reasoning (WACV). I completed my Ph.D. in Computer Science from CIDSE, Arizona State University on June 27, 2018.
I completed my Masters (ME) in Computer Science from the Indian Institute of Science, Bangalore in 2011 with a concentration in Machine Learning under the supervision of Prof. M Narasimha Murty (Dean, Faculty of Engineering, IISc). I have done my Bachelors in CS from Jadavpur University in 2009. Prior to joining PhD, I worked as a developer in the Next-Generation Sequencing (NGS) team at Strand Life Sciences for nearly 2.5 years.
PhD in Computer Science, 2018
Arizona State University
MEng in Computer Science, 2011
Indian Institute of Science, Bangalore
BE in Computer Science, 2009
Jadavpur University, Kolkata
We investigate how to evaluate, explain and enhance neural models under the lens of reasoning
In this work, we propose a way to integrate spatial commonsense knowledge to aid visual reasoning
In this work, we propose an exlicit reasoning layer over Deep Neural Architectures to solve VQA.
In this work, we propose image puzzles that require background knowledge to solve. This project is also aimed to advocates logically …
In this project, we aim to achieve a deeper understanding of images and videos with the help of background or common-sense knowledge. …
I have served as a teaching assistant for the following courses at Arizona State University:
I collaborated with an amazing bunch of bright students (during their Post-graduate or under-graduate study):
Research & Development groups