Designed and built with care, filled with creative elements

Top
Image Alt

Unpicking Data at the Seams: VAEs, Disentanglement and Independent Components

  /  Évènements
Chargement Évènements

« Tous les Évènements

Unpicking Data at the Seams: VAEs, Disentanglement and Independent Components

12 novembre 2024 | 14h00 15h00

Disentanglement, or identifying salient statistically independent factors of the data, is of interest in many areas of machine learning and statistics, with relevance to synthetic data generation with controlled properties, robust classification of features, parsimonious encoding, and a greater understanding of the generative process underlying the data. Disentanglement arises in several generative paradigms, including Variational Autoencoders (VAEs), Generative Adversarial Networks and diffusion models. Particular progress has recently been made in understanding disentanglement in VAEs, where the choice of diagonal posterior covariance matrices is shown to promote mutual orthogonality between columns of the decoder’s Jacobian. We continue this thread to show how such linear independence implies statistical independence, completing the chain in understanding how a VAE’s objective leads to the identification of independent components of, i.e. disentangling, the data.

Détails

Date :
12 novembre 2024
Heure :
14h00 – 15h00
Catégorie d’Évènement:

Speaker

Carl Allen

CSD Conference room