GeistHaus
log in · sign up

Tutorial - What is a variational autoencoder? – Jaan Lı 李

jaan.io

Understanding Variational Autoencoders (VAEs) from two perspectives: deep learning and graphical models.

8 pages link to this URL
Generating music in the waveform domain

This is a write-up of a presentation on generating music in the waveform domain, which was part of a tutorial that I co-presented at ISMIR 2019 earlier this month.

1 inbound link article en musicaudiowaveformraw audiodeep learninggenerative models
Generating music in the waveform domain

This is a write-up of a presentation on generating music in the waveform domain, which was part of a tutorial that I co-presented at ISMIR 2019 earlier this month.

4 inbound links article en musicaudiowaveformraw audiodeep learninggenerative models
A Practical guide to Autoencoders using Keras - reckoning.dev

An autoencoder is a type of artificial neural network used to learn efficient codings of unlabeled data. An autoencoder learns two functions: an encoding function that transforms the input data, and a decoding function that recreates the input data from the encoded representation.

0 inbound links article en astroblogpersonalmachine learningdeep learningaillmsagentsalgorithms
From Autoencoder to Beta-VAE

[Updated on 2019-07-18: add a section on VQ-VAE & VQ-VAE-2.] [Updated on 2019-07-26: add a section on TD-VAE.] Autocoder is invented to reconstruct high-dimensional data using a neural network model with a narrow bottleneck layer in the middle (oops, this is probably not true for Variational Autoencoder, and we will investigate it in details in later sections). A nice byproduct is dimension reduction: the bottleneck layer captures a compressed latent encoding. Such a low-dimensional representation can be used as en embedding vector in various applications (i.e. search), help data compression, or reveal the underlying data generative factors.

2 inbound links article en posts autoencodergenerative-modelimage-generation
Variational Autoencoder in PyTorch, commented and annotated.

I have recently become fascinated with (Variational) Autoencoders and with PyTorch. Kevin Frans has a beautiful blog post online explaining variational autoencoders, with examples in TensorFlow and, importantly, with cat pictures. Jaan Altosaar’s blog post takes an even deeper look at VAEs from both the deep learning perspective and the perspective of graphical models. Both of these posts, as well as Diederik Kingma’s original 2014 paper Auto-Encoding Variational Bayes, are more than worth your time.

0 inbound links article en howto AutoencodersDeep LearningNeural NetworksPytorchVariational Autoencoders