Avatar

Somak Aditya

Postdoc Researcher

Microsoft Research

Biography

I have joined Microsoft Research India as a Postdoctoral Researcher where I will be working with the NLP team (primarily with Dr. Monojit Choudhury), exploring applications of model-based knowledge integration approaches for natural language inferencing. Knowledge integration has three aspects: knowledge acqusition, representation and reasoning. While my former efforts had a higher concentration on the latter two; at MSR, I plan to work on some aspects of acquisition such as weighted rule learning in probabilistic logics.

Prior to this, I completed my Ph.D. in Computer Science from CIDSE, Arizona State University on June 27, 2018. For my doctoral studies, I worked on Image Understanding using a combination of Deep Learning, Commonsense Reasoning and Knowledge Representation Techniques under the supervision of Prof. Chitta Baral (Past President of KR.inc, 2016-2018). I was also co-advised by Dr. Yezhou Yang (Assistant Professor, ASU). My current efforts have been published in AAAI, IJCAI, UAI, NAACL, CVIU (journal), WACV.

I have completed my Masters (ME) in Computer Science from the Department of CSA in Indian Institute of Science, Bangalore in 2011 with a concentration in Machine Learning under the supervision of Prof. M Narasimha Murty (Dean, Faculty of Engineering, IISc). I have done my Bachelors in CS from Jadavpur University in 2009. After a brief stint at Yahoo, I joined Strand Life Sciences where I worked in the NGS team for nearly 2.5 years before joining ASU to pursue PhD.

Interests

  • Knowledge Representation and Reasoning
  • Probabilistic Logical Reasoning
  • Natural Language Processing

Education

  • PhD in Computer Science, 2018

    Arizona State University

  • MEng in Computer Science, 2011

    Indian Institute of Science, Bangalore

  • BE in Computer Science, 2009

    Jadavpur University, Kolkata

News

⭐️ [Mar 2020] LANTERN@COLING-20: Invited as PC Member.

⭐️ [Jan 2020] ACL-20: Invited as PC Member.

⭐️ [Dec 2019] USPTO: "Knowledge-sharing between cross-domain Agents" work approved internally to be filed..

⭐️ [Dec 2019] AAAI-20: "Uncovering Relations for Marketing Knowledge Representation" accepted in StarAI workshop full paper.

⭐️ [Dec 2019] IJCAI-20: Invited as PC Member.

⭐️ [Oct 2019] AAAI-20: Exploratory Navigation and Selective Readoing got accepted as AAAI demo.

⭐️ [Sep 2019] Adobe News: Knowledge Graph Research appears in Adobe News !

⭐️ [Aug 2019] AAAI-20: Invited as an AAAI 2020 PC Member!

⭐️ [Aug 2019] IJCAI-19: Invited as an IJCAI DC Career Panelist!

⭐️ [Aug 2019] IJCAI-19: Our work on Integrating Knowledge and Reasoning in Image Understanding" got accepted in IJCAI 2019 Survey!

⭐️ [May 2019] USPTO: First patent on Marketing Knowledge Graph Creation approved!

⭐️ [Nov 2018] WACV-19: Our work on "Spatial Knowledge Distillation on Visual Reasoning" got accepted in WACV 2019!

⭐️ [Oct 2018] KR-19: We had a successful workshop filled with intersting talks from researchers from University of Leeds, IBM Research US, University of Adelaide and Army Research Lab. Their talks are avaibale at: .

⭐️ [Aug 2018] My doctoral dissertation is now publicly available for download in the ASU Digital Repostory.

⭐️ [Aug 2018] UAI-18: We presented this poster for "Combining Knowledge and Reasoning through Probabilistic Soft Logic for Image Puzzle Solving" in UAI 2018.

⭐️ [June 2018] Successfully defended my thesis. My slides are available on dropbox.

⭐️ [June 2018] Published the Image Riddles code for public use that was used in UAI-18 work. Visit Github.

⭐️ [June 2018] Published the PSL engine code for public use that was used in AAAI-18 work. Visit Github.

⭐️ [May 2018] UAI-18: Our paper on Image Riddles is accepted in UAI 2018 (30% acceptance rate).

⭐️ [May 2018] Invited as a reviewer in Robotics and Autonomus Systems journal.

⭐️ [May 2018] Our Website for KR-2018 workshop is live! Please consider submitting to the workshop.

⭐️ [Mar 2018] We are organizing the first workshop on "Induce and Deduce: Integrating learning of representations and models with deductive, explainable reasoning that leverages knowledge" in KR 2018 (Phoenix, 27-29 Oct). Website coming soon!

⭐️ [Mar 2018] I am awarded the University Graduate Fellowship for Spring 2018 for the third time. Thank you ASU, CIDSE!

⭐️ [Feb 2018] AAAI-18: Presented our work on "Explicit Reasoning over End-to-End Neural Architectures" in AAAI 2018.

⭐️ [Jan 2018] ASU SW Robotics Symposium-18: Presented our work on "Explicit Reasoning over End-to-End Neural Architectures" in ASU SouthWest Robotics Symposium. The work was nominated for Best Abstract award.

⭐️ [Dec 2017] CVIU-17: Our accepted manuscript in CVIU is now available online: "Image Understanding using Vision and Reasoning through Scene Description Graph"

⭐️ [Dec 2017] CVIU-17: Our work "Image Understanding using Vision and Reasoning through Scene Description Graph" has been accepted in the reputed Computer Vision and Image Understanding (CVIU) journal.

⭐️ [Nov 2017] Our Work on Explicit Reasoning over End-To-End Neural Architectures has been accepted in AAAI 2018 (Acceptance Rate: 24.5%, 933 accepted out of 3.8k).

⭐️ [Nov 2017] Vision and Reasoning Website is live.

⭐️ [Oct 2017] Invited as a reviewer for The Visual Computer journal.

⭐️ [July 2017] Work on Image Riddles accepted as Extended Abstract on Vision Meets Cognition Workshop, CVPR 2017.

⭐️ [May 2017] Thesis proposal accepted, and officially advanced to candidacy.

⭐️ [May 2017] Joined JDE, Verisk Analytics as Cognitive Analytics and Machine Learning Research Intern, under Dr. Maneesh Singh, Director, JDE, Cognitive Analytics.

⭐️ [May 2017] Unofficially a Ph.D. Candidate, after successfully defending my proposal on "Knowledge and Reasoning in Image Understanding".

⭐️ [May 2017] Invited as a review-assistant for IJCAI 2017.

⭐️ [March 2017] Awarded University Graduate Fellowship for Spring 2017 from ASU, for the third time.

⭐️ [Feb 2017] Attended AAAI-2017 (DC and the main Conference). Great to know that people are interested in Vision and Reasoning approaches. Here is the poster I presented at the main conference.

Experience

 
 
 
 
 

Postdoctoral Researcher

Microsoft Research India

Feb 2020 – Present Bangalore
I am continuing my explorations on different aspects of knowledge integration approaches to natural language inferencing with Dr. Monojit Choudhury. I will be also exploring few fundamental problems such as structure learning in probabilistic logic
 
 
 
 
 

Research scientist

Adobe Research

Sep 2018 – Feb 2020 Bangalore
As a Research Scientist, I extensively collaborated with other researchers and product managers to understand product needs, formulate research problems that revolves around business use-cases. Interesting projects include marketing knowledge graph creation, diversity in sequence recommendation, and storytelling from data. My other responsibilities include interviewing interns and incoming researchers, running summer internships and mentoring research associates.
 
 
 
 
 

Specialist Software III

Strand Life Sciences

Jun 2014 – Dec 2011 Bangalore
 
 
 
 
 

Senior Software Engineer

Yahoo!

Jun 2011 – Nov 2011 Bangalore

Projects

Spatial Knowledge Distillation to aid Visual Reasoning

In this work, we propose a way to integrate spatial commonsense knowledge to aid visual reasoning external_link.

Solving Visual QA using Reasoning and Deep Learning

In this work, we propose an exlicit reasoning layer over Deep Neural Architectures to solve VQA. external_link.

Solving Image Puzzles

In this work, we propose image puzzles that require background knowledge to solve. This project is also aimed to advocates logically …

From Images to Sentences

In this project, we aim to achieve a deeper understanding of images and videos with the help of background or common-sense knowledge. …

K-Parser: A Knowledge Parser

We build a semantic parser to extract semantic knowledge from natural language sentences. external_link.

Softwares

  • PSL engine used for AAAI 2018 work (Gihub Link)
  • Image Riddles code for UAI 2018 paper (Gihub Link)
  • K-Parser (First Author- Arpit Sharma), used in IJCAI-15 work (Online Demo)

Teaching and Mentoring

I have served as a teaching assistant for the following courses at Arizona State University:

  • CSE-576 Natural Language Processing, Fall 2015 and Fall 2016
    • Responsibilities included: Creating Homework assignments, proposing class projects, and mentoring multiple groups.
  • CSE-471 Introduction To Artificial Intelligence, Spring 2016
  • CSE-310 Data Structures and Algorithms, Spring 2015

I mentored and collaborated with the following Masters Students:

  • Rudra Saha (2017 – 2018), Graduated, MS Student, Computer Science, ASU, Currently Researcher@Verisk
    • Spatial Knowledge Distillation to aid Visual Reasoning
  • Divyanshu Bandil (2016 – 2017), Graduated MS Student, Computer Engineering. linkedin profile
    • Visual Question Categorization.
    • Visual Question Answering in Dynamic Environments
  • Trideep Rath (2015 – 2017), Graduated, MS, Computer Science, ASU. Currently Data Scientist, Kayak

Internship Mentoring:

  • (2019) Pranil Joshi (IIT-B), Abhinav Mishra (IIT-G), Bhavy Khatri (IIT-K): Knowledge-sharing between Cross-domain Agents
    • Mentored with Kushal Chawla (USC), Sharmila Nangi Reddy
    • (Feb 2020]) Patent accepted and to be filed in USPTO.

Affiliations

Research & Development groups

Industrial Organizations

Universities

Contact