Kernel density estimation techniques and their applications in ML
Event details
| Date | 05.07.2024 |
| Hour | 14:00 › 16:00 |
| Speaker | Ekaterina Kochetkova |
| Location | |
| Category | Conferences - Seminars |
EDIC candidacy exam
Exam president: Prof. Mika Göös
Thesis advisor: Prof. Michael Kapralov
Co-examiner: Prof. Ola Svensson
Abstract
The Kernel Density Estimation (KDE) problem finds applications in many practical tasks involving data analysis and approximate fast computations. Naturally, it has become important to machine learning, and attracted great research interest. We present two papers showing how different techniques from this line of work can be applied to obtain practical tools for training large language models, as well as one recent paper providing a result on a problem used as a building block in a particular approach to the KDE problem.
Background papers
Exam president: Prof. Mika Göös
Thesis advisor: Prof. Michael Kapralov
Co-examiner: Prof. Ola Svensson
Abstract
The Kernel Density Estimation (KDE) problem finds applications in many practical tasks involving data analysis and approximate fast computations. Naturally, it has become important to machine learning, and attracted great research interest. We present two papers showing how different techniques from this line of work can be applied to obtain practical tools for training large language models, as well as one recent paper providing a result on a problem used as a building block in a particular approach to the KDE problem.
Background papers
- Janardhan Kulkarni, Victor Reis, Thomas Rothvoss. "Optimal Online Discrepancy Minimization." https://arxiv.org/pdf/2308.01406
- Moses Charikar, Beidi Chen, Christopher Re, Erik Waingarten. "Fast Algorithms for a New Relaxation of Optimal Transport". Proceedings of Machine Learning Research vol 195:1–32, 2023. https://proceedings.mlr.press/v195/charikar23a/charikar23a.pdf
- Josh Alman, Zhao Song. "Fast Attention Requires Bounded Entries". 37th Conference on Neural Information Processing Systems (NeurIPS 2023). https://proceedings.neurips.cc/paper_files/paper/2023/file/c72861451d6fa9dfa64831102b9bb71a-Paper-Conference.pdf
Practical information
- General public
- Free