output from one module is not being inserted to other function

[rakesh23]

from __future__ import print_function
import os, codecs, mysql, mysql.connector, re, string
 
#Reading files with txt extension
def get_sentences():
    for root, dirs, files in os.walk("/Users/document/test1"):
        for file in files:
            if file.endswith(".txt"):
                x_ = codecs.open(os.path.join(root,file),"r", "utf-8-sig")
                for lines in x_.readlines():
                    yield lines
formoreprocessing = get_sentences()
 
#Tokenizing sentences of the text files
from nltk.tokenize import sent_tokenize
for i in formoreprocessing:
    raw_docs = sent_tokenize(i)
    tokenized_docs = [sent_tokenize(i) for sent in raw_docs]
#    print (tokenized_docs)
 
#Removing stop words
stopword_removed_sentences = []
from nltk.corpus import stopwords
stopset = stopwords.words("English")
 
def strip_stopwords(sentence):
    return ' '.join(word for word in sentence.split() if word not in stopset)
stopword_removed_sentences = (strip_stopwords(sentence) for sentence in raw_docs)
 
'''Removing punctation marks'''
regex = re.compile('[%s]' % re.escape(string.punctuation))
nw = []
for review in stopword_removed_sentences:
    new_review = ''
    for token in review: 
        new_token = regex.sub(u'', token)
        if not new_token == u'':
            new_review += new_token
    nw.append(new_review)
--------------
--------------
 
 

I am getting the output upto tokenized_docs but not after that..
Output from tokenized_docs is not being inserted into next module as input.
Please help me to figure out the problem.
Thanks

[dwblas]

tokenized_docs is not used anywhere in the program. What were you expecting that the program should do. What does this mean?

not being inserted into next module as input

[rakesh23]

Thanks. I just want to remove the stop words from the output of tokenized_docs for which the ouput of tokenized_docs must be inserted as the input of # Removed stop_word module. I tried my bes t but unable to do so.