Tokenization in Spacy: NLP Tutorial For Beginners - S1 E8

Word and sentence tokenization can be done easily using the spacy library in python. In this NLP tutorial, we will cover tokenization and a few related topics. NLP platform: https://www.firstlanguage.in/ ⭐️ Timestamps ⭐️ 00:00 What is tokenization 02:35 Install spacy 02:49 Coding starts 03:23 Basic English word tokenization 14:15 Span object 15:00 Token attributes 18:40 Grab emails from the student information doc 23:58 Tokenization in Hindi 26:13 Customize tokenization rule 29:52 Sentence tokenization (or segmentation) 33:15 Exercise Code: https://github.com/codebasics/nlp-tut... Exercise: In the above code, go to the end and you will find exercises Complete NLP Playlist:    • NLP Tutorial Python   🔖Hashtags🔖 #nlp #nlptutorial #nlppython #spacytutorial #spacytutorialnlp #spacytutorialnlp #wordtokenization #tokenizerspacy #tokenizationnlp #wordtokenizerspacy #tokenizationandspacy #spacynlp Do you want to learn technology from me? Check https://resources.codebasics.io/sTn7Nr for my affordable video courses. Need help building software or data analytics and AI solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website. 🎥 Codebasics Hindi channel:    / @codebasicshindi   #️⃣ Social Media #️⃣ 🔗 Discord:   / discord   📸 Instagram:   / codebasicshub   🔊 Facebook:   / codebasicshub   📱 Twitter:   / codebasicshub   📝 Linkedin (Personal):   / dhavalsays   📝 Linkedin (Codebasics):   / codebasics   🔗 Patreon: https://www.patreon.com/codebasics?fa... ❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers'.