Chennai Mathematical Institute · Computer Science

Applied Natural Language Processing

Prof. Ramaseshan R · 92 free video lectures

92 video lectures. Topics: Introduction; Operations on a Corpus; Probability and NLP; Vector Space models; Sequence Learning; Machine Translation; Preprocessing; Statistical Properties of Words - Part 01; Statistical Properties of Words - Part 02; Statistical Properties of Words - Part 03; Vector…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Introduction
  2. Operations on a Corpus
  3. Probability and NLP
  4. Vector Space models
  5. Sequence Learning
  6. Machine Translation
  7. Preprocessing
  8. Statistical Properties of Words - Part 01
  9. Statistical Properties of Words - Part 02
  10. Statistical Properties of Words - Part 03
  11. Vector Space Models for NLP
  12. Document Similarity - Demo, Inverted index, Exercise
  13. Vector Representation of words
  14. Contextual understanding of text
  15. Co-occurence matrix, n-grams
  16. Collocations, Dense word Vectors
  17. SVD, Dimensionality reduction, Demo
  18. Query Processing
  19. Topic Modeling
  20. Examples for word prediction
  21. Introduction to Probability in the context of NLP
  22. Joint and conditional probabilities, independence with examples
  23. The definition of probabilistic language model
  24. Chain rule and Markov assumption
  25. Generative Models
  26. Bigram and Trigram Language models -peeking indide the model building
  27. Out of vocabulary words and curse of dimensionality
  28. Exercise
  29. Naive-Bayes, classification
  30. Machine learning, perceptron, linearly separable
  31. Linear Models for Claassification
  32. Biological Neural Network
  33. Perceptron
  34. Perceptron Learning
  35. Logical XOR
  36. Activation Functions
  37. Gradient Descent
  38. Feedforward and Backpropagation Neural Network
  39. Why Word2Vec?
  40. What are CBOW and Skip-Gram Models?
  41. One word learning architecture
  42. Forward pass for Word2Vec
  43. Matrix Operations Explained
  44. CBOW and Skip Gram Models
  45. Building Skip-gram model using Python
  46. Reduction of complexity - sub-sampling, negative sampling
  47. Binay tree, Hierarchical softmax
  48. Mapping the output layer to Softmax
  49. Updating the weights using hierarchical softmax
  50. Discussion on the results obtained from word2vec
  51. Recap and Introduction
  52. ANN as a LM and its limitations
  53. Sequence Learning and its applications
  54. Introuduction to Recurrent Neural Network
  55. Unrolled RNN
  56. RNN - Based Language Model
  57. BPTT - Forward Pass
  58. BPTT - Derivatives for W,V and U
  59. BPTT - Exploding and vanishing gradient
  60. LSTM
  61. Truncated BPTT
  62. GRU
  63. Introduction and Historical Approaches to Machine Translation
  64. What is SMT?
  65. Noisy Channel Model, Bayes Rule, Language Model
  66. Translation Model, Alignment Variables
  67. Alignments again!
  68. IBM Model 1
  69. IBM Model 2
  70. Introduction to Phrase-based translation
  71. Symmetrization of alignments
  72. Extraction of Phrases
  73. Learning/estimating the phrase probabilities using another Symmetrization example
  74. Introduction to evaluation of Machine Translation
  75. BLEU - "A short Discussion of the seminal paper"
  76. BLEU Demo using NLTK and other metrics
  77. Encoder-Decoder model for Neural Machine Translation
  78. RNN Based Machine Translation
  79. Recap and Connecting Bloom Taxonomy with Machine Learning
  80. Introduction to Attention based Translation
  81. Research Paper discussion on "Neural machine translation by jointly learning to align and translate"
  82. Typical NMT architecture architecture and models for multi-language translation
  83. Beam Search
  84. Variants of Gradient Descend
  85. Introduction to Conversation Modeling
  86. A few examples in Conversation Modeling
  87. Some ideas to Implement IR-based Conversation Modeling
  88. Discussion of some ideas in Question Answering
  89. Hyperspace Analogue to Language - HAL
  90. Correlated Occurence Analogue to Lexical Semantic - COALS
  91. Global Vectors - Glove
  92. Evaluation of Word vectors

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from Chennai Mathematical Institute.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights