Neural Architechture Search with Reinforcement Learning
Neural Architecture Search with Reinforcement Learning
Recent Trends in Automated Machine Learning Technische Universit?t M?nchen
Xiongyu Xie May 26th, 2021
1. Motivation and problem statement
? Neural networks are powerful and widely used. ? A good model structure of NN will be beneficial.
? Many modern neural networks perform well/better only with specific structures, e.g., LSTM in RNN and skip connections in CNN
? Those specific structures are difficult to design manually.
2
2. Overview
? Generate model descriptions by the controller (RNN) ? Train the controller via Reinforcement Learning (policy gradient ascent) maximize the
prediction accuracy on a validation dataset. ? The generated models reach the same performance level as the previous state-of-the-
art models.
Figure: An overview of Neural Architecture Search
Figure from Barret Zoph and Quoc V. Le, `Neural Architecture Search with Reinforcement Learning`, 2017.
3
3. The core idea behind each step
Working flows:
Generate structure from the controller
? Generation of network structures in arbitrary length
? Stop criterion is a predefined layer number
Calculate accuracy on a validationset as reward
? Generate, build and train many architectures
? At convergence, calculate an accuracy R from the networks
Update the parameters of the
controller
? RL with gradient ascent
4
3. The core idea behind each step
Working flows:
Generate structure from the controller
? Generation of network structures in arbitrary length
? Stop criterion is a predefined layer number
Calculate accuracy on a validationset as reward
Update the parameters of the
controller
? Generate, build and train many architectures
? At convergence, calculate an accuracy R from the networks
? RL with gradient ascent
Figure: The controller samples a simple convolutional network
Figure from Barret Zoph and Quoc V. Le, `Neural Architecture Search with Reinforcement Learning`, 2017.
5
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- progressive neural architecture search
- automatic search of neural network architectures
- graphnas graph neural architecture search with
- improvingneuralarchitecture searchwithreinforcementlearning
- neural architecture search
- graph neural architecture search ijcai
- neural architecture search for dense prediction tasks
- neural architecture meta learning via reinforcement
- reinforcement learning based neural architecture search
- neural architechture search with reinforcement learning
Related searches
- make a word search with these letters
- word search with certain letters
- make a word search with these words
- best free people search with no fees
- deep learning neural network
- machine learning neural networks
- machine learning vs neural network
- neural networks and learning machines
- learning convolutional neural networks for graphs
- deep learning neural network tutorial
- alabama inmate search with mugshot
- sequence to sequence learning with neural networks