Split function to split sentence into words

[fellya]

Hi,

i don't have enough experience in writing codes in Python but now i'm trying to see how i can start using Python.
I've tried to write a simple program that can display a sentence. now my problem is how to write a code using split function to split that sentence into words then print out each word separately. let me give u an example:

>>>sentence=" My question is to know how to write a code in Python"

then the output of this sentece must give:

sentence[1]=My
sentence[2]=question
sentence[3]=is
sentence[4]=to
sentence[5]=know
......
.......

Can someone help me in this?

[oler1s]

Always check the documentation, for something interesting. In this case, look at possible string methods ( http://www.python.org/doc/2.5.2/lib/string-methods.html ) and you will see a split function. Here’s a quick example.

>>> sent = "Jack ate the apple."
>>> splitsent = sent.split(' ')
>>> splitsent
['Jack', 'ate', 'the', 'apple.']

Simple as that.

[fellya]

thank you for the help but the question is not fully answered! with this program it will split the sentence but i would like the output to be lets say if we have a= jack ate the apple, i would like the output to be:
a[0]=jack
a[1]=ate
a[2]=the
a[3]=apple

can you please see if its possible to get the above output?

[bvdet]

thank you for the help but the question is not fully answered! with this program it will split the sentence but i would like the output to be lets say if we have a= jack ate the apple, i would like the output to be:
a[0]=jack
a[1]=ate
a[2]=the
a[3]=apple

can you please see if its possible to get the above output?

The answer is: string formatting!

Example:

>>> sentence = "The dog ate my homework"
>>> for i,word in enumerate(sentence.split()):
...     print "Word #%d: %s" % (i, word)
...     
Word #0: The
Word #1: dog
Word #2: ate
Word #3: my
Word #4: homework
>>> 

[fellya]

thank you for the help, but as u can see with the output below when i do the command sentence[0] to show me the first word it is showing me "T" this is not what i want!!! for me i would like to see if i type the command sentence[0]; to display "The" and if i type again sentence[1]; it has to give me "dog"


can you plz help!

>>> sentence="The dog ate my homework"
>>> for i, word in enumerate(sentence.split()):
...             print " word #%d: %s" % (i,word)
...
 word #0: The
 word #1: dog
 word #2: ate
 word #3: my
 word #4: homework
>>> sentence[0]
'T'
>>> sentence[1];
'h'
>>>
 

[bvdet]

How about this?

>>> split_sentence = sentence.split()
>>> split_sentence[0]
'The'
>>> split_sentence[1]
'dog'
>>> 

[fellya]

ohhhh thank you so much.
thats what i wanted.
may God bless U.
once again thank you

[fellya]

hi, i have another question related to the above:
I have created a file of more than 100 sentences in it then i saved it with extension .py , then i'm using the operations to open the file which are:

f=open("example.py")
try:
    for line in f:
                    print line
finally:
          f.close()
 

so after using the above commands im able to open my file. Now i know how to split a sentence into words, the problem comes now how can i do it on a file containing more than 100 sentences in it? with 1 or 2 senteces i can write the sentences and split them, now how about a file with many sentences?

can someone help me?

[bvdet]

Please use code tags around code. It will make your code much easier to read.

[CODE]..code goes here..[/CODE]

In your code, you are iterating on each line in the file. Each iteration, the variable line represents a sentence. Do you want to save the sentence in a list? What do you want to do with 100 sentences?

The following will save a list of lists. You can access each word by list index.

lineList = [line.strip().split() for line in open("your_file").readlines()]
# print the first word in the first line.
print lineList[0][0]

[fellya]

i dont need to save a sentence in a list. what i want to do is : i take a document which has like any number of sentences then by using Python i would like to split the document of any number of sentences into words where each word has a number e.g., word1=the, word2= apple ect. then by this output i will use an other program that can help me to identify if word1 is a noun or not and son on. Brief after getting all the words in a document , I will try to identify only noun and extract only nouns from the doc.

[bvdet]

The previous code I posted above will work fine for your purpose. To get all the words in a single list:

wordList = reduce(lambda x,y: x+y, lineList, [])

Now you have a list of all the words. To iterate on the list of words:

>>> lineList = [['1','2','3'],['4','5','6']]
>>> reduce(lambda x,y: x+y, lineList, [])
['1', '2', '3', '4', '5', '6']
>>> wordList = reduce(lambda x,y: x+y, lineList, [])
>>> for i,word in enumerate(wordList):
...     print "Word[%d]: %s" % (i,word)
...     
Word[0]: 1
Word[1]: 2
Word[2]: 3
Word[3]: 4
Word[4]: 5
Word[5]: 6
>>> 

[fellya]

hey thanks for the help.
my dear your last solution works perfectly with numbers!!!
but the one that i was lookin for is the solution u gave me in your reply number 9 :

lineList = [line.strip().split() for line in open("your_file").readlines()] 
# print the first word in the first line. 
print lineList[0][0]
 

this solution is helping me to find one word at a time. imagine i have a doc of two pages, the above codes will take time. because when i'm typing like print lineList[0][3] it is giving me the third word in my doc which is perfect, but the problem i have to type print lineList[0][1] upto print lineList[0][n] with n the last word in my doc!!! i want codes like the above one but which will not ask me to type print lineList[][] to get only one word in my doc.
can u please help? i know the codes u gave me are working but the problem i have to type print lineList[][] for each word.

[bvdet]

If you have a list of lists:

>>> list_of_lists = [[1,2,3],[4,5,6],[7,8,9]]
>>> for i, item in enumerate(list_of_lists):
...     for j, word in enumerate(item):
...         print "List item #%d, Word #%d: %s" % (i,j,word)
...         
List item #0, Word #0: 1
List item #0, Word #1: 2
List item #0, Word #2: 3
List item #1, Word #0: 4
List item #1, Word #1: 5
List item #1, Word #2: 6
List item #2, Word #0: 7
List item #2, Word #1: 8
List item #2, Word #2: 9
>>> 

[fellya]

okay thank you so much for the help bvdet!!!
but i think u didn't get my question. Ok let me be clear and simple. let us assume i have a file called ex1.py, then in this doc i have more than one paragraph. to open the file i know the pocedure to open a file. now I would like to know if there is a way i can open the file, then read like one sentence or paragraph of the doc then after readin the sentence, i split that sentence such that if the sentence was "jack is a hard worker" i want to have the output like :
word 1: jack
word 2: is
word 3: a
word 4: hard
word 5: worker.

then after reading and splitting that sentence, i go to the next sentence in the file and do the same thing.

is there any way to do it in python?
I need help please!!!

[bvdet]

You will need to establish rules for determining what is a sentence. If the file is not too big, you can read the entire file into a string and split on the periods.

>>> import re
>>> s = 'This is a paragraph. How will we split it? We can use re module split()! We should get four sentences.'
>>> sList = [item.strip() for item in re.split('[!?.]', s) if item]
>>> sList
['This is a paragraph', 'How will we split it', 'We can use re module split()', 'We should get four sentences']
>>> 

[fellya]

thank you for ths answer but that is not want i want,
i have a file called ex1.py then to open it i do:

f=open("ex1.py")
try:
........................
 

then after all the procedures of opening a file i have:

jack is a brother of carine, .................................................. ...


My question is: is there anyway after opening this file which contain like 5 paragraph, to be splited into words?

[bvdet]

It seems that we already covered this:

import re
s = open('your_file').read()
wordList = []
for sentence in [item.strip() for item in re.split(r'[!?.]', s.replace('\n',' ')) if item]:
    wordList.append(sentence.split())

[fellya]

ohhhh thank you but using the codes i couldn't get anything. maybe i used it wrong. what do u mean when u put [! ? .] or ' '
it seems like i was supposed to put something instead of those symbols.
please look at what i did in the below code. ntbs1.py is my file.

>>> import re
>>> s=open('ntbs1.py').read()
>>> wordList=[]
>>> for sentence in [item.strip() for item in re.split(r'[!?.]', s.replace('\n',
'')) if item]:
...       wordList.append(sentence.split())
...
>>>
 

[bvdet]

The sentences are split on the characters inside the brackets (!?.). Each newline character (\n) is replaced with a space character.

[NeoPa]

Fellya,

You have been asked to enclose all your code within [ CODE ] tags. We have rules on this site that demand you do that. Please pay attention in future to making sure all your code is posted that way to ensure it is easier to understand and doesn't waste the time of our experts trying to decipher it.

-Administrator.