Avatar

Somak Aditya

Researcher

Adobe Research

Biography

I have joined Adobe Research (BEL) as a Research Scientist. I have completed my Ph.D. in Computer Science from CIDSE, Arizona State University. I have successfully defended my thesis on June 27, 2018!

For my doctoral studies, I have worked on Image Understanding using a combination of Deep Learning, Commonsense Reasoning and Knowledge Representation Techniques under the supervision of Prof. Chitta Baral (President of KR.inc, 2016-Present). I have also closely collaborated with and partially funded by Dr. Yezhou Yang (Assistant Professor, ASU). My current efforts have been published in AAAI, IJCAI, UAI, NAACL, CVIU (journal), WACV.

I have completed my Masters (ME) in Computer Science from the Department of CSA in Indian Institute of Science, Bangalore in 2011 with a concentration in Machine Learning under the supervision of Prof. M Narasimha Murty (Dean, Faculty of Engineering, IISc and author of Data Clustering: A Review which has more than 13,000 citations). I have done my Bachelors in CS from Jadavpur University in 2009. After a brief stint at Yahoo, I joined Strand Life Sciences where I worked in the NGS team for nearly two and half years before joining ASU to pursue PhD.

Interests

  • Knowledge Representation and Reasoning
  • Natural Language Processing
  • Probabilistic Logical Reasoning

Education

  • PhD in Computer Science, 2018

    Arizona State University

  • MEng in Computer Science, 2011

    Indian Institute of Science, Bangalore

  • BE in Computer Science, 2009

    Jadavpur University, Kolkata

News

⭐️ [Jan 2020] ACL-20: Invited as PC Member.

⭐️ [Dec 2019] USPTO: "Knowledge-sharing between cross-domain Agents" work approved internally to be filed..

⭐️ [Dec 2019] AAAI-20: "Uncovering Relations for Marketing Knowledge Representation" accepted in StarAI workshop full paper.

⭐️ [Dec 2019] IJCAI-20: Invited as PC Member.

⭐️ [Oct 2019] AAAI-20: Exploratory Navigation and Selective Readoing got accepted as AAAI demo.

⭐️ [Sep 2019] Adobe News: Knowledge Graph Research appears in Adobe News !

⭐️ [Aug 2019] AAAI-20: Invited as an AAAI 2020 PC Member!

⭐️ [Aug 2019] IJCAI-19: Invited as an IJCAI DC Career Panelist!

⭐️ [Aug 2019] IJCAI-19: Our work on Integrating Knowledge and Reasoning in Image Understanding" got accepted in IJCAI 2019 Survey!

⭐️ [May 2019] USPTO: First patent on Marketing Knowledge Graph Creation approved!

⭐️ [Nov 2018] WACV-19: Our work on "Spatial Knowledge Distillation on Visual Reasoning" got accepted in WACV 2019!

⭐️ [Oct 2018] KR-19: We had a successful workshop filled with intersting talks from researchers from University of Leeds, IBM Research US, University of Adelaide and Army Research Lab. Their talks are avaibale at: .

⭐️ [Aug 2018] My doctoral dissertation is now publicly available for download in the ASU Digital Repostory.

⭐️ [Aug 2018] UAI-18: We presented this poster for "Combining Knowledge and Reasoning through Probabilistic Soft Logic for Image Puzzle Solving" in UAI 2018.

⭐️ [June 2018] Successfully defended my thesis. My slides are available on dropbox.

⭐️ [June 2018] Published the Image Riddles code for public use that was used in UAI-18 work. Visit Github.

⭐️ [June 2018] Published the PSL engine code for public use that was used in AAAI-18 work. Visit Github.

⭐️ [May 2018] UAI-18: Our paper on Image Riddles is accepted in UAI 2018 (30% acceptance rate).

⭐️ [May 2018] Invited as a reviewer in Robotics and Autonomus Systems journal.

⭐️ [May 2018] Our Website for KR-2018 workshop is live! Please consider submitting to the workshop.

⭐️ [Mar 2018] We are organizing the first workshop on "Induce and Deduce: Integrating learning of representations and models with deductive, explainable reasoning that leverages knowledge" in KR 2018 (Phoenix, 27-29 Oct). Website coming soon!

⭐️ [Mar 2018] I am awarded the University Graduate Fellowship for Spring 2018 for the third time. Thank you ASU, CIDSE!

⭐️ [Feb 2018] AAAI-18: Presented our work on "Explicit Reasoning over End-to-End Neural Architectures" in AAAI 2018.

⭐️ [Jan 2018] ASU SW Robotics Symposium-18: Presented our work on "Explicit Reasoning over End-to-End Neural Architectures" in ASU SouthWest Robotics Symposium. The work was nominated for Best Abstract award.

⭐️ [Dec 2017] CVIU-17: Our accepted manuscript in CVIU is now available online: "Image Understanding using Vision and Reasoning through Scene Description Graph"

⭐️ [Dec 2017] CVIU-17: Our work "Image Understanding using Vision and Reasoning through Scene Description Graph" has been accepted in the reputed Computer Vision and Image Understanding (CVIU) journal.

⭐️ [Nov 2017] Our Work on Explicit Reasoning over End-To-End Neural Architectures has been accepted in AAAI 2018 (Acceptance Rate: 24.5%, 933 accepted out of 3.8k).

⭐️ [Nov 2017] Vision and Reasoning Website is live.

⭐️ [Oct 2017] Invited as a reviewer for The Visual Computer journal.

⭐️ [July 2017] Work on Image Riddles accepted as Extended Abstract on Vision Meets Cognition Workshop, CVPR 2017.

⭐️ [May 2017] Thesis proposal accepted, and officially advanced to candidacy.

⭐️ [May 2017] Joined JDE, Verisk Analytics as Cognitive Analytics and Machine Learning Research Intern, under Dr. Maneesh Singh, Director, JDE, Cognitive Analytics.

⭐️ [May 2017] Unofficially a Ph.D. Candidate, after successfully defending my proposal on "Knowledge and Reasoning in Image Understanding".

⭐️ [May 2017] Invited as a review-assistant for IJCAI 2017.

⭐️ [March 2017] Awarded University Graduate Fellowship for Spring 2017 from ASU, for the third time.

⭐️ [Feb 2017] Attended AAAI-2017 (DC and the main Conference). Great to know that people are interested in Vision and Reasoning approaches. Here is the poster I presented at the main conference.

Experience

 
 
 
 
 

Research scientist

Adobe Research

Sep 2018 – Present Bangalore
 
 
 
 
 

Specializt Software III

Strand Life Sciences

Jun 2014 – Dec 2011 Bangalore
 
 
 
 
 

Senior Software Engineer

Yahoo!

Jun 2011 – Nov 2011 Bangalore

Projects

Spatial Knowledge Distillation to aid Visual Reasoning

In this work, we propose a way to integrate spatial commonsense knowledge to aid visual reasoning external_link.

Solving Visual QA using Reasoning and Deep Learning

In this work, we propose an exlicit reasoning layer over Deep Neural Architectures to solve VQA. external_link.

Solving Image Puzzles

In this work, we propose image puzzles that require background knowledge to solve. This project is also aimed to advocates logically …

From Images to Sentences

In this project, we aim to achieve a deeper understanding of images and videos with the help of background or common-sense knowledge. …

K-Parser: A Knowledge Parser

We build a semantic parser to extract semantic knowledge from natural language sentences. external_link.

Softwares

  • PSL engine used for AAAI 2018 work (Gihub Link)
  • Image Riddles code for UAI 2018 paper (Gihub Link)
  • K-Parser (First Author- Arpit Sharma), used in IJCAI-15 work (Online Demo)

Teaching and Mentoring

I have served as a teaching assistant for the following courses at Arizona State University:

  • CSE-576 Natural Language Processing, Fall 2015 and Fall 2016
    • Responsibilities included: Creating Homework assignments, proposing class projects, and mentoring multiple groups.
  • CSE-471 Introduction To Artificial Intelligence, Spring 2016
  • CSE-310 Data Structures and Algorithms, Spring 2015

I mentored and collaborated with the following Masters Students:

  • Rudra Saha (2017 – 2018), Graduated, MS Student, Computer Science, ASU, Currently Researcher@Verisk
    • Spatial Knowledge Distillation to aid Visual Reasoning
  • Divyanshu Bandil (2016 – 2017), Graduated MS Student, Computer Engineering. linkedin profile
    • Visual Question Categorization.
    • Visual Question Answering in Dynamic Environments
  • Trideep Rath (2015 – 2017), Graduated, MS, Computer Science, ASU. Currently Data Scientist, Kayak

Internship Mentoring:

  • (2019) Pranil Joshi (IIT-B), Abhinav Mishra (IIT-G), Bhavy Khatri (IIT-K): Knowledge-sharing between Cross-domain Agents
    • Mentored with Kushal Chawla (USC), Sharmila Nangi Reddy

Affiliations

Research & Development groups

Industrial Organizations

Universities

Contact