IC Colloquium: Human-AI Systems for Making Video Useful
Event details
| Date | 01.03.2021 |
| Hour | 16:00 › 17:00 |
| Location | Online |
| Category | Conferences - Seminars |
By: Amy Pavel - Carnegie Mellon University
IC Faculty candidate
Abstract
Video is becoming a core medium for communicating a wide range of content, including educational lectures, vlogs, and how-to tutorials. While videos are engaging and informative, they lack the familiar and useful affordances of text for browsing, skimming,and flexibly transforming information. This severely limits who can interact with video content and how they can interact with it, makes editing a laborious process, and means that much of the information in videos is not accessible to everyone.
But, what future systems will make videos useful for all users?
In this talk, I’ll share my work creating interactive Human-AI systems that leverage multiple mediums of communication (e.g., text, video, and audio) across two main research areas: 1) helping domain-experts surface content of interest through interactive video abstractions, and 2) making videos non-visually accessible through interactions for video accessibility. First, I will discuss core challenges of seeking information in videos from interviews with domain experts. Then, I will present new interactive systems that leverage AI, and evaluations that demonstrate system efficacy. I will conclude with how hybrid HCI-AI breakthroughs will make digital communication more effective and accessible in the future, and how new interactions can help us to realize the full potential of recent AI/ML advances.
Bio
Amy Pavel is a Postdoctoral Fellow at Carnegie Mellon University and a Research Scientist in AI/ML at Apple. Her research explores AI-driven interactive techniques for making digital communication effective and accessible for all. Her work creating Human-AI systems to improve communication has appeared at top ACM/IEEE conferences including UIST, CHI, ASSETS, and VR. She recently served as an associate chair for the UIST and CHI program committees and was selected as a Rising Star in EECS. She previously received her Ph.D. in Computer Science at UC Berkeley, where her work developing interactive video abstractions was supported by an NDSEG fellowship.
More information
IC Faculty candidate
Abstract
Video is becoming a core medium for communicating a wide range of content, including educational lectures, vlogs, and how-to tutorials. While videos are engaging and informative, they lack the familiar and useful affordances of text for browsing, skimming,and flexibly transforming information. This severely limits who can interact with video content and how they can interact with it, makes editing a laborious process, and means that much of the information in videos is not accessible to everyone.
But, what future systems will make videos useful for all users?
In this talk, I’ll share my work creating interactive Human-AI systems that leverage multiple mediums of communication (e.g., text, video, and audio) across two main research areas: 1) helping domain-experts surface content of interest through interactive video abstractions, and 2) making videos non-visually accessible through interactions for video accessibility. First, I will discuss core challenges of seeking information in videos from interviews with domain experts. Then, I will present new interactive systems that leverage AI, and evaluations that demonstrate system efficacy. I will conclude with how hybrid HCI-AI breakthroughs will make digital communication more effective and accessible in the future, and how new interactions can help us to realize the full potential of recent AI/ML advances.
Bio
Amy Pavel is a Postdoctoral Fellow at Carnegie Mellon University and a Research Scientist in AI/ML at Apple. Her research explores AI-driven interactive techniques for making digital communication effective and accessible for all. Her work creating Human-AI systems to improve communication has appeared at top ACM/IEEE conferences including UIST, CHI, ASSETS, and VR. She recently served as an associate chair for the UIST and CHI program committees and was selected as a Rising Star in EECS. She previously received her Ph.D. in Computer Science at UC Berkeley, where her work developing interactive video abstractions was supported by an NDSEG fellowship.
More information
Practical information
- General public
- Free
- This event is internal
Contact
- Host: Amir Zamir