Update 4_1_Lexical_Processing.ipynb

Merge pull request #4 from gsi-upm/dveni-patch-1
Update 3_3_Data_Munging_with_Pandas.ipynb
2025-09-13 02:12:21 +00:00 · 2019-11-26 15:14:40 +01:00 · 2019-09-19 10:46:19 +02:00
1 changed files with 1 additions and 1 deletions
--- a/nlp/4_1_Lexical_Processing.ipynb
+++ b/nlp/4_1_Lexical_Processing.ipynb
@@ -326,7 +326,7 @@
    "def preprocess(words, type='doc'):\n",
    "    if (type == 'tweet'):\n",
    "        tknzr = TweetTokenizer(strip_handles=True, reduce_len=True)\n",
-    "        tokens = tknzr.tokenize(tweet)\n",
+    "        tokens = tknzr.tokenize(words)\n",
    "    else:\n",
    "        tokens = nltk.word_tokenize(words.lower())\n",
    "    porter = nltk.PorterStemmer()\n",
Author	SHA1	Message	Date
Dani Vera	19ea5dff09	Update 4_1_Lexical_Processing.ipynb	2019-11-26 15:14:40 +01:00
Carlos A. Iglesias	e70689072f	Merge pull request #4 from gsi-upm/dveni-patch-1 Update 3_3_Data_Munging_with_Pandas.ipynb	2019-09-19 10:46:19 +02:00