Full search page →

Paper guides

Optional reading guides to the papers behind NLP 03 · Neural Networks for NLP, one page each: the problem, the idea, what it showed and what to check when you read it.

Navigate: this page and this track: Navigate: this page and this track

These optional guides connect the chapter to original papers. Read the challenge and figure first, then unfold the method, evidence and limitations.

  1. TextCNN — Convolutional Neural Networks for Sentence Classification

    Can a sentence classifier learn useful phrase detectors without a full syntactic parser or a recurrent network?

References

  1. M. Hagiwara, Real-World Natural Language Processing: Practical Applications with Deep Learning, Manning, 2021; Chapters 2–4, 7 and 10–11. publisher
  2. S. McRoy, Principles of Natural Language Processing, open textbook, 2021; Chapter 6, “Benchmark Tasks for Language Modelling.” chapter
  3. Scikit-learn developers, “Text feature extraction,” scikit-learn documentation, current online edition. documentation
  4. Scikit-learn developers, “Logistic regression,” scikit-learn documentation, current online edition. documentation
  5. Y. Goldberg, “A primer on neural network models for natural language processing,” Journal of Artificial Intelligence Research 57, 2016. paper
  6. M. Iyyer, V. Manjunatha, J. Boyd-Graber and H. Daumé III, “Deep unordered composition rivals syntactic methods for text classification,” ACL-IJCNLP, 2015. paper
  7. A. Joulin, E. Grave, P. Bojanowski and T. Mikolov, “Bag of tricks for efficient text classification,” EACL, 2017. paper
  8. Y. Bengio, R. Ducharme, P. Vincent and C. Jauvin, “A neural probabilistic language model,” Journal of Machine Learning Research 3, 2003. paper
  9. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa, “Natural language processing (almost) from scratch,” Journal of Machine Learning Research 12, 2011. paper
  10. Y. Kim, “Convolutional neural networks for sentence classification,” EMNLP, 2014. paper
  11. Y. Zhang and B. Wallace, “A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification,” IJCNLP, 2017. paper
  12. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research 15, 2014. paper
  13. Scikit-learn developers, “Classification metrics,” scikit-learn documentation, current online edition. documentation
  14. C. Guo, G. Pleiss, Y. Sun and K. Q. Weinberger, “On calibration of modern neural networks,” ICML, 2017. paper
  15. S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu and J. Gao, “Deep learning-based text classification: a comprehensive review,” ACM Computing Surveys 54(3), 2021. survey
  16. W. X. Zhao et al., “A survey of large language models,” Frontiers of Computer Science, 2026; online manuscript updated March 2026. survey
  17. Y. Chang et al., “A survey on evaluation of large language models,” ACM Transactions on Intelligent Systems and Technology, 2024. survey
  18. G. Sperduti and A. Moreo, “Misspellings in natural language processing: a survey,” arXiv:2501.16836, 2025. survey