Investigating Multiple facets of communication skill assessment and feedback

Communication skill is an important soft skill that candidates need and what employers look for, to succeed in teams. From candidate's point of view, automatic feedback to aid behavior change is helpful, and for interviewers interviewing 100 is easier than 1000. Automatic methods to assess and select candidates for an in depth interview or a training program is a relevant problem in social computing, involving analysis of nonverbal and verbal cues, using speech, spoken text and visual behavior analysis.

In our research, we have systematically investigated Asynchronous Video Interviews (AVIs) (starting to be widely deployed by companies like Hirevue) for interviewing, vis-a-vis face-to-face interviews, in terms of interviewer perception, performance of automatic assessment methods and interviewee setting preferences. Face-to-face interviews serve as benchmark setting, while AVIs are relatively new and less understood. Unlike Video resumes which don't allow prompting, AVIs are both scalable (i.e. can be done anywhere anytime) and allow prompting. Later we have also compared spoken vs written interviews - Written in text and hand written form. Apart from this, we will also discuss works on Automatic feedback prediction, and assessment in human agent interaction setting. This leads to automatic follow up question generation, an interesting text generation problem. Finally, we will conclude with some preliminary work in behavior generation in the context of Indian Sign Language Synthesis, and show some demos of the works discussed.

Biography
Dr. Dinesh Babu Jayagopi is an Assistant Professor at IIIT Bangalore since Dec 2013, where he heads the Multimodal Perception Lab. Currently he is visiting Prof. Marianne Schmid Mast at the University of Lausanne. His research interests are in Audio-Visual Signal Processing, Applied Machine Learning, and Social Computing. He obtained his doctorate from Ecole Polytechnic Federale Lausanne (EPFL), Switzerland, beginning of 2011, working with Dr. Daniel Gatica Perez at Idiap. He continued for a Post doc on Human robot interactions, working with Daniel and Jean-Marc. He received the Outstanding paper award in the International Conference on Multimodal Interaction (ICMI), 2012, Idiap PhD student research award for the year 2009. More recently, his PhD student's work was nominated for Best student paper in ICMI 2016 Tokyo, Japan. Another work received Best student paper award at MedPRAI 2018. He also received Department of Science and Technology (DST) Young Scientist Start up Grant in 2016. In the past, he has successfully collaborated and executed sponsored research projects with CAIR, DRDO (Defence Research and Development Organization) and NI Systems.