Skip to content
0:00 / 0:00

#word2vec#nlp#wordvectors

Lecture 1 | Natural Language Processing with Deep Learning

Stanford University School of Engineering

215K subscribers • 2 videos on Hallway

YouTube
  • Recommended by 3 people: 3 on Hacker News.
  • Presented by Chris Manning, Professor of Computer Science and Linguistics at Stanford
  • May be out of date. Uploaded 9 years ago, in an area where tools change fast.

Intermediate. Assumes working knowledge.

820K views9 years ago3 recommendations

AI and machine learningNeural networks and deep learningClassic machine learning

Chris Manning introduces natural language processing and the concept of representing words as numeric vectors using Word2Vec and SVD.

Lecture 1 introduces the concept of Natural Language Processing (NLP) and the problems NLP faces today. The concept of representing words as numeric vectors is then introduced, and popular approaches to designing word vectors are discussed. Key phrases: Natural Language Processing. Word Vectors. Singular Value Decomposition. Skip-gram. Continuous Bag of Words (CBOW). Negative Sampling. Hierarchical Softmax. Word2Vec. ------------------------------------------------------------------------------- Natural Language Processing with Deep Learning Instructors: - Chris Manning - Richard Socher Natural language processing (NLP) deals with the key artificial intelligence technology of understanding complex human language communication. This lecture series provides a thorough introduction to the cutting-edge research in deep learning applied to NLP, an approach that has recently obtained very high performance across many different NLP tasks including question answering and machine translation. It emphasizes how to implement, train, debug, visualize, and design neural network models, covering the main technologies of word vectors, feed-forward models, recurrent neural networks, recursive neural networks, convolutional neural networks, and recent models involving a memory component. For additional learning opportunities please visit: stanfordonline.stanford.edu/

Why it's here

3 people recommend this

What people say. Recommended as an excellent, comprehensive introduction to natural language processing and word embeddings.

neel8986on Hacker News • Recommends

On “Ask HN: How to Seriously Start with Machine Learning and AI”

…s You can get more in-depth knowledge of Machine learning from following sources 1)Nando machine learning course ( link ) 2)Bishops book ( link ) Especially Bishops book is really deep and covers almost all basic concepts. Now for recent advances in Deep learning. I will suggest two brilliant courses from Stanford 1) Vision ( link ) 2) NLP ( link to this video ) The Vision course by Karparthy can be a very good introduction to Deep learning. Also, the mother book for deep learning ( link )is good…

ahussainon Hacker News • Recommends

On “Theoretical Machine Learning Lecture Series: Deep Learning and Cognition”

For those who like Prof Manning's style and want to get more in depth, here are the lecture videos for the NLP course he teaches at Stanford: link to this video

moruginon Hacker News • Recommends

On “Amazon Is Hiring More Developers for Alexa Than Google Is Hiring for Everything”

I have read like 1/3 of the comments but its interesting that the most interesting problem of everything we are talking about was only noticed by a non-programmer (so far). Everything that was talked about in the comments all hinge on the state of the art (SOTA) of ai in natural language processing (nlp). John Carmack recommended link to this video stanford's nlp class (i didnt know who he was until i saw that post on hn). That class is good. it should take a long time to grok. you'll be solid up to LSTMs a general current standard.