deep-learning-1.md

Deep Learning

• Complete Guide to TensorFlow for Deep Learning with Python

• Deep Learning Specialization

• Deep Learning with Python and Keras

• Deep Learning and Computer Vision A-Z™: OpenCV, SSD & GANs

• Deep Learning A-Z™: Hands-On Artificial Neural Networks

• Natural Language Processing with Deep Learning in Python

• Deep Learning by Andrew Ng (Coursera)

• IBM Data Science Professional Certificate (Coursera)

• Deep Learning by IBM (edX)

• Data Science by Harvard University (edX)

• Microsoft Professional Program in Data Science (edX)

• fast.ai - Practical Deep Learning For Coders

• fast.ai - Cutting Edge Deep Learning For Coders

• A curated list of awesome Deep Learning tutorials, projects and communities

• Deep Learning Papers Reading Roadmap

• Lots of Deep Learning Resources

• Interesting Deep Learning and NLP Projects (Stanford), Website

• Core Concepts of Deep Learning

• Understanding Natural Language with Deep Neural Networks Using Torch

• Stanford Deep Learning Tutorial

• Deep Learning FAQs on Quora

• Google+ Deep Learning Page

• Recent Reddit AMAs related to Deep Learning, Another AMA

• Where to Learn Deep Learning?

• Deep Learning nvidia concepts

• Introduction to Deep Learning Using Python (GitHub), Good Introduction Slides

• Video Lectures Oxford 2015, Video Lectures Summer School Montreal

• Deep Learning Software List

• Hacker's guide to Neural Nets

• Top arxiv Deep Learning Papers explained

• Geoff Hinton Youtube Vidoes on Deep Learning

• Awesome Deep Learning Reading List

• Deep Learning Comprehensive Website, Software

• deeplearning Tutorials

• AWESOME! Deep Learning Tutorial

• Deep Learning Basics

• Intuition Behind Backpropagation

• Stanford Tutorials

• Train, Validation & Test in Artificial Neural Networks

• Artificial Neural Networks Tutorials

• Neural Networks FAQs on Stack Overflow

• Deep Learning Tutorials on deeplearning.net

• Neural Networks and Deep Learning Online Book

• Neural Machine Translation

  • Machine Translation Reading List
  • Introduction to Neural Machine Translation with GPUs (part 1), Part 2, Part 3
  • Deep Speech: Accurate Speech Recognition with GPU-Accelerated Deep Learning

• Deep Learning Frameworks

  • • Torch vs. Theano
  • dl4j vs. torch7 vs. theano
  • Deep Learning Libraries by Language
  • Theano
    • Website
    • Theano Introduction
    • Theano Tutorial
    • Good Theano Tutorial
    • Logistic Regression using Theano for classifying digits
    • MLP using Theano
    • CNN using Theano
    • RNNs using Theano
    • LSTM for Sentiment Analysis in Theano
    • RBM using Theano
    • DBNs using Theano
    • All Codes
    • Deep Learning Implementation Tutorials - Keras and Lasagne
  • Torch
    • Torch ML Tutorial, Code
    • Intro to Torch
    • Learning Torch GitHub Repo
    • Awesome-Torch (Repository on GitHub)
    • Machine Learning using Torch Oxford Univ, Code
    • Torch Internals Overview
    • Torch Cheatsheet
    • Understanding Natural Language with Deep Neural Networks Using Torch
  • Caffe
    • Deep Learning for Computer Vision with Caffe and cuDNN
  • TensorFlow
    • Website
    • TensorFlow Examples for Beginners
    • Stanford Tensorflow for Deep Learning Research Course
      • GitHub Repo
    • Simplified Scikit-learn Style Interface to TensorFlow
    • Learning TensorFlow GitHub Repo
    • Benchmark TensorFlow GitHub
    • Awesome TensorFlow List
    • TensorFlow Book
    • Android TensorFlow Machine Learning Example
      • GitHub Repo
    • Creating Custom Model For Android Using TensorFlow
      • GitHub Repo

• Feed Forward Networks

  • • A Quick Introduction to Neural Networks
  • Implementing a Neural Network from scratch, Code
  • Speeding up your Neural Network with Theano and the gpu, Code
  • Basic ANN Theory
  • Role of Bias in Neural Networks
  • Choosing number of hidden layers and nodes,2,3
  • Backpropagation in Matrix Form
  • ANN implemented in C++ | AI Junkie
  • Simple Implementation
  • NN for Beginners
  • Regression and Classification with NNs (Slides)
  • Another Intro

• Recurrent and LSTM Networks

  • • awesome-rnn: list of resources (GitHub Repo)
  • Recurrent Neural Net Tutorial Part 1, Part 2, Part 3, Code
  • NLP RNN Representations
  • The Unreasonable effectiveness of RNNs, Torch Code, Python Code
  • Intro to RNN, LSTM
  • An application of RNN
  • Optimizing RNN Performance
  • Simple RNN
  • Auto-Generating Clickbait with RNN
  • Sequence Learning using RNN (Slides)
  • Machine Translation using RNN (Paper)
  • Music generation using RNNs (Keras)
  • Using RNN to create on-the-fly dialogue (Keras)
  • Long Short Term Memory (LSTM)
    • Understanding LSTM Networks
    • LSTM explained
    • Beginner’s Guide to LSTM
    • Implementing LSTM from scratch, Python/Theano code
    • Torch Code for character-level language models using LSTM
    • LSTM for Kaggle EEG Detection competition (Torch Code)
    • LSTM for Sentiment Analysis in Theano
    • Deep Learning for Visual Q&A | LSTM | CNN, Code
    • Computer Responds to email using LSTM | Google
    • LSTM dramatically improves Google Voice Search, Another Article
    • Understanding Natural Language with LSTM Using Torch
    • Torch code for Visual Question Answering using a CNN+LSTM model
    • LSTM for Human Activity Recognition
  • Gated Recurrent Units (GRU)
    • LSTM vs GRU
  • Time series forecasting with Sequence-to-Sequence (seq2seq) rnn models

• Recursive Neural Network (not Recurrent)

  • Recursive Neural Tensor Network (RNTN)
  • word2vec, DBN, RNTN for Sentiment Analysis

• Restricted Boltzmann Machine

  • • Beginner's Guide about RBMs
  • Another Good Tutorial
  • Introduction to RBMs
  • Hinton's Guide to Training RBMs
  • RBMs in R
  • Deep Belief Networks Tutorial
  • word2vec, DBN, RNTN for Sentiment Analysis

• Autoencoders: Unsupervised (applies BackProp after setting target = input)

  • • Andrew Ng Sparse Autoencoders pdf
  • Deep Autoencoders Tutorial
  • Denoising Autoencoders, Theano Code
  • Stacked Denoising Autoencoders

• Convolutional Neural Networks

  • • An Intuitive Explanation of Convolutional Neural Networks
  • Awesome Deep Vision: List of Resources (GitHub)
  • Intro to CNNs
  • Understanding CNN for NLP
  • Stanford Notes, Codes, GitHub
  • JavaScript Library (Browser Based) for CNNs
  • Using CNNs to detect facial keypoints
  • Deep learning to classify business photos at Yelp
  • Interview with Yann LeCun | Kaggle
  • Visualising and Understanding CNNs

• Network Representation Learning

  • • Awesome Graph Embedding
  • Awesome Network Embedding
  • Network Representation Learning Papers
  • Knowledge Representation Learning Papers
  • Graph Based Deep Learning Literature