The primal goal of generative models is learning a density estimator for a given data like sound, pictures and sentences.
Thanks to the recently appeared bridge between deep learning and machine learning, many conventional machine learning problems have been solved with astonishing results.
We have explored generative models in various aspects to get well generalized realistic samples from data.
- Suwon Suh and Seungjin Choi (2016), "Gaussian copula variational autoencoders for mixed data," arXiv:1604.04960.
- Suwon Suh, Daniel Chae, Hyon-Goo Kang, and Seungjin Choi (2016), "Echo-state conditional variational auto-encoder for anomaly detection," in Proceedings of the International Joint Conference on Neural Networks (IJCNN-2016), Vancouver, Canada, July 24-29, 2016.
Bayesian optimization is a method to optimize expensive black-box functions. It finds global optimum, evaluating the given domain space with Bayesian models. Applications of Bayesian optimization are hyperparameter optimization, architecture searching, experimental design, robotics, and etc.
We are interested in solving the following issues in Bayesian optimization: (1) developing acquisition function for balancing exploration and exploitation, (2) transferring prior knowledge to new task for Bayesian optimization, and (3) optimizing automatically machine learning models.
- Jungtaek Kim and Seungjin Choi (2018), "Clustering-guided GP-UCB for Bayesian optimization," in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-2018), Calgary, Alberta, Canada, April 15-20, 2018.
- Jungtaek Kim, Saehoon Kim, and Seungjin Choi (2017), "Learning to transfer initialization for Bayesian hyperparameter optimization," NIPS 2017 Workshop on Bayesian Optimization, December 9, 2017.
Any learning algorithm depends on its underlying assumptions about data, otherwise known as its inductive bias.
We are developing methods that can learn such assumptions from related datasets, thus creating learners that can (meta-) learn their own learning algorithms.
- Yoonho Lee and Seungjin Choi (2018),
"Gradient-Based Meta-Learning with Learned Layerwise Metric and Subspace,"
in Proceedings of the Thirty-Fifth International Conference on Machine Learning (ICML-2018),
Stockholm, Sweden, July 10-15, 2018.
Last updated: 2019/04/18
[Jungtaek Kim, Youngseok Yoon, Nayeong Kim, Seungjin Choi, Beomjo Shin, Seungho Lee, Jinhwi Lee]
Dropout as a Structured Shrinkage Prior (ICML 2019)
Presenter: Seungho Lee
Presentation Link
Key Instance Detection in Multi-Instance Learning (ACML 2012)
Presenter: Beomjo Shin
Presentation Link
My 5 Favorite Papers at ICML 2019
Presenter: ICML Participants
Presentation Link
Meta-Learning Acquisition Functions for Bayesian Optimization
Presenter: Jungtaek Kim
Presentation Link
Lifelong Learning with Dynamically Expandable Networks (ICLR 2018)
Presenter: Jinhwi Lee
Presentation Link
Amortized Bayesian Meta-Learning (ICLR 2019)
Presenter: Seungjin Choi
Presentation Link
Neural Tangent Kernel: Convergence and Generalization in Neural Networks (NeurIPS 2018)
Presenter: Youngseok Yoon
Presentation Link
TADAM: Task dependent adaptive metric for improved few-shot learning
Presenter: Jungtaek Kim
Presentation Link
Deep Online Learning Via Meta-Learning: Continual Adaptation for Model-Based RL
Presenter: Jinhwi Lee
Presentation Link
Towards Robust Interpretability with Self-Explaining Neural Networks
Presenter: Nayeong Kim
Presentation Link
The Parallel Knowledge Gradient Method for Batch Bayesian Optimization
Presenter: Youngseok Yoon
Presentation Link
Neural Architecture Search with Bayesian Optimisation and Optimal Transport
Presenter: Jungtaek Kim
Presentation Link
Overcoming catastrophic forgetting in neural networks. Kirkpatrick, James, et al. Proceedings of the national academy of sciences (2017): 201611835.
Presenter: Jinhwi Lee
Presentation Link
Generalized Zero-Shot Learning with Deep Calibration Network Liu, Kun, et al. NeurlPS (2018).
Presenter: Youngnam Kim
Presentation Link
Visualizing deep neural network decisions: Prediction difference analysis. Zintgraf, Luisa M., et al. ICLR (2017).
Presenter: Nayeong Kim
Presentation Link
Self-Supervised Feature Learning by Learning to Spot Artifacts (CVPR 2018), Simon Jenni and Paolo Favaro
Presenter: Wonbin Kim
Presentation Link
Probabilistic Model-Agnostic Meta-Learning (arXiv 2018), Chelsea Finn, Kelvin Xu, and Sergey Levine
Presenter: Youngseok Yoon
Presentation Link
Recent works on Batch Bayesian Optimization
Presenter: Jungtaek Kim
Presentation Link
Attention is all you need. Vaswani, Ashish, et al. Advances in Neural Information Processing Systems. 2017.
Presenter: Nayeong Kim
Presentation Link
GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training, (arXiv 2018), Samet Akcay et al
Presenter: Youngnam Kim
Presentation Link
Progress : Learning to warm-start Bayesian hyperparameter optimization and task-adaptive ensemble of meta-learners
Presenter: Jungtaek Kim
Presentation Link
Progress : Reimplementation – MAML and CNP (Conditional Neural Process)
Presenter: Youngseok Yoon
Presentation Link
Progress : Papers read in summer semester
Presenter: Nayeong Kim
Presentation Link
Progress : Towards developing improved GAN-based anomaly detection methods
Presenter: Youngnam Kim
Presentation Link
Progress : Auto-encoder based anomaly detection with auxiliary classification
Presenter: Wonbin Kim
Presentation Link
Anomaly Detection with Robust Deep Autoencoders (KDD, 2017), Chong Zhou, Randy C. Paffenroth
Presenter: Wonbin Kim
Presentation Link
Attention-based Deep Multiple Instance Learning (arXiv 2018), Maximilian Ilse, Jakub M. Tomczak, and Max Welling
Presenter: Youngseok Yoon
Presentation Link
On First-Order Meta-Learning Algorithms (arXiv 2018), Alex Nichol, Joshua Achiam, and John Schulman
Additional Link
Presenter: Yoonho Lee
Presentation Link
Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection. (arXiv preprint 2018), Brown, A., Tuor, A., Hutchinson, B., & Nichols, N.
Presenter: Nayeong Kim
Presentation Link
Implicit Causal Models for Genome-wide Association Studies (arXiv preprint 2017), Dustin Tran, David M. Blei.
Presentation Link
Presenter: Youngnam Kim
On Unifying Deep Generative Models(To appear in ICLR 2018), Zhiting Hu, Zichao Yang, Ruslan Salakhutdinov, Eric P. Xing.
Presentation Link
Presenter: Wonbin Kim
Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithm(ICML, 2018), Chelsea Finn, Sergey Levine.
Presentation Link
Presenter: Youngseok Yoon
New insights and perspectives on the natural gradient method(arXiv preprint 2014), James Martens.
Presentation Link
Presenter: Yoonho Lee
InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations(NIPS 2017), Li, Y., Song, J., & Ermon, S.
Presentation Link
Presenter: Nayeong Kim
Hybrid computing using a neural network with dynamic external memory(Nature, 2016), Alex Graves et al
Presentation Link
Presenter: Youngnam Kim
A Maximum Entropy Framework for Semisupervised and Active Learning With Unknown and Label-Scarce Classes (IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, VOL.28, NO.4, APRIL 2017), Zhicong Qiu, David J.Miller, and George Kesidis
Presentation Link
Presenter: Wonbin Kim
Stochastic Neural Networks for Hierarchical Reinforcement Learning (ICLR 2017), Carlos Florensa, Yan Duan, Pieter Abbeel
Presentation Link
Presenter: Youngseok Yoon
Meta Learning Shared Hierarchies (ICLR 2018 Review), Kevin Frans, Jonathan Ho, Xi Chen, Pieter Abbeel, John Schulman
Presentation Link
Presenter: Yoonho Lee
Reinforcement Learning with Unsupervised Auxiliary Tasks (ICLR 2017), Max Jaderberg, Volodymyr Mnih, Wojciech Marian Czarnecki, Joel Z Leibo, David Silver, Koray Kavukcuoglu
Presentation Link
Presenter: Youngnam Kim
Towards Open Set Deep Networks (CVPR 2017), Abhijit Bendale, Terrance Boult
Presentation Link
Presenter: Wonbin Kim
Input Switched Affine Networks: An RNN Architecture Designed for Interpretability (ICML 2017), Foerster, J.N., Gilmer, J., Sohl-Dickstein, J. Chorowski, J., Sussillo, D.
Presentation Link
Presenter: Nayeong Kim
Deep Reinforcement Learning with Double Q-Learning (AAAI 2016), Hado van Hasselt, Arthur Guez, David Silver
Presentation Link
Presenter: Youngseok Yoon
Continuous Adaptation via Meta-Learning in Nonstationary and Competitive Environments (arXiv 2017), Maruan Al-Shedivat, Trapit Bansal, Yuri Burda, Ilya Sutskever, Igor Mordatch, Pieter Abbeel
Presentation Link
Presenter: Yoonho Lee
Variational Inference using Implicit Distributions (published in arXiv), Ferenc Huszár
Presentation Link
Presenter: Suwon Suh
Scalable Adaptive Stochastic Optimization Using Random Projections (NIPS 2016), Gabriel Krummenacher, Brian McWilliams, Yannic Kilcher, Joachim M. Buhmann, and Nicolai Meinshausen
Presenter: Saehoon Kim
Gradient Estimation Using Stochastic Computation Graphs (NIPS 2015), John Schulman, Nicolas Heess, Theophane Weber, and Pieter Abbeel
Presentation Link
Presenter: Yoonho Lee
Building Machines That Learn and Think Like People (published in arXiv), Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, and Samuel J. Gershman
Presenter: Aren Siekmeier
Improving Generative Adversarial Networks with Denoising Feature Matching (ICLR 2017), David Warde-Farley and Yoshua Bengio
Presentation Link
Presenter: Inhyuk Cho
Neural GPUs Learn Algorithms (ICLR 2016), Lukasz Kaiser and Ilya Sutskever
Presentation Link
Presenter: Minseop Park
Random Forest for the Contextual Bandit Problem (AISTATS 2016), Raphaël Féraud, Robin Allesiardo, Tanguy Urvoy, Fabrice Clérot
Presentation Link
Presenter: Jungtaek Kim
DelugeNets: Deep Networks with Massive and Flexible Cross-layer Information Inflows (published in arXiv), Jason Kuen, Xiangfei Kong, Gang Wang
Presentation Link
Presenter: Jiyuu Yi
Wasserstein GAN (published in arXiv), Martin Arjovsky, Soumith Chintala, Léon Bottou
Presentation Link
Presenter: Juho Lee
A Connection Between GANs, Inverse Reinforcement Learning, and Energy-Based Models (NIPS 2016 Workshop on Adversarial Training), Finn, Christiano, Abbeel and Levine
Presentation Link
Presenter: Suwon Suh
Stacked Generative Adversarial Networks (under review for CVPR 2017), X. Huang et al.
Presentation Link
Presenter: Saehoon Kim
Manipulation of Rat Movement by Nigrostriatal Stimulation Commanded by Human Visually Evoked Potential Presenter: Bonkon Koo
The Predictron: End-to-end Learning and Planning (under review for ICLR 2017) David Silver et al.
Presentation Link
Presenter: Yoonho Lee
Coupled Generative Adversarial Networks (NIPS 2016) Ming-Yu Liu and Oncel Tuzel
Presentation Link
Presenter: Inhuyk Cho
Siamese Neural Networks for One-shot Image Recognition (ICML 2015 Deep Learning Workshop) Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov
Presentation Link
Presenter: Minseop Park
Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangian (NIPS 2016) Victor Picheny, Robert B. Gramacy, Stefan M. Wild, and Sebastien Le Digabel
Presentation Link
Presenter: Jungtaek Kim
Recurrect Convolutional Neural Network for Object Recognition (CVPR 2015) Ming Liang, and Xiaolin Hu
Presentation Link
Presenter: Jiyuu Yi
Composing graphical models with neural networks for structured representation and fast inference (NIPS 2016) M. J. Johnson, D. Duvenaud, A. B. Wiltschko, S. R. Datta and R. P. Adams
Presentation Link
Presenter: Juho Lee
An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections (ICCV 2015) Yu Cheng, Felix X. Yu, Rogerio S. Feris, Sanjiv Kumar, Alok Choudhary, Shih-Fu Chang
Presentation Link
Presenter: Saehoon Kim
Dueling Network Architectures for Deep Reinforcement Learning (ICML 2016) Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt, Marc Lanctot, and Nando de Freitas
Presentation Link
Presenter: Yoonho Lee
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets (NIPS 2016) Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel
Presentation Link
Presenter: Inhyuk Cho
One-Shot Generaliztion in Deep Generative Models (ICML 2016) Danilo J. Rezende, Shakir, Mohamed, Ivo Danihelka, Karol Gregor, and Daan Wierstra
Presentation Link
Presenter: Minseop Park
Robust Random Cut Forest Based Anomaly Detection On Streams (ICML 2016) Sudipto Guha, Nina Mishra, Gourav Roy, and Okke Schrijvers
Presentation Link
Presenter: Jungtaek Kim
Deep Networks with Stochastic Depth Gao Huang, Yu Sun, Zhuang Liu, Daniel Sedra, and Kilian Q. Weinberger
Presentation Link
Presenter: Jiyuu Yi
The Variational Gaussian Process (ICLR 16) Dustin Tran, Rajesh Ranganath, and David M. Blei
Presentation Link
Presenter: Juho Lee
Deep Kernel Learning (AISTATS 16) Andrew Gordon Wilson, Zhiting Hu, Ruslan Salakhutdinov, and Eric P. Xing
Presentation Link
Presenter: Saehoon Kim