473,320 Members | 1,969 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

strtok problem

Hi,
I need to split the value stored in a string and store them to another
charrecter array.I am using strtok function.But i am getting invalid
output when there is no value between delimiter

my code
#include<stdio.h>
#include<string.h>
#include<stdlib.h>
void main()
{

char *pch;
char *parameters[4];
int paramcount=0;

char b[]="mani,raju,musa,kumar";

pch=strtok(b,",");
while (pch != NULL)
{
//parameters[paramcount]=pch;
parameters[paramcount]=(char*)malloc(strlen(pch) + 1);
strcpy(parameters[paramcount],pch);
paramcount++;
pch = strtok (NULL, ",");
}//while (pch != NULL)

for(int t=0;t<4;t++)
printf("\n%s\n",parameters[t]);

}
the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
How to free the memory allocated?
how to handle strtok when there is no value between delimiter

Regards,
Manikandan

Mar 29 '06 #1
5 7636
pl**********@gmail.com wrote:
[snip]
pch=strtok(b,","); [snip] the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
How to free the memory allocated?
how to handle strtok when there is no value between delimiter


I am convinced that the main purpose of the strtok function being
in the library is to catch new coders in the knees.

Carefully read up on the strtok function in your compiler's docs.
Note what happens when there are multiple delimeters with
nothing between them. So, your "not working" input will be
equivalent to

char b[]="mani,kumar"

that is, there's no way for you to use strtok to get those missing
fields in the middle.

Also, read up in your docs about the various warnings and caveats
about using strtok. The security warning that should be there, for
example. And the warning about a static variable being used so that
multiple overlapping calls with different strings to tokenize will
interfere with eachother.

My opinion: Don't use strtok. Roll up your own parsing class,
preferably using std::string instead of char arrays. But even if
you can't use std::string, drop the use of strtok.

Write yourself a class that takes your input, copies it to an
internal buffer, then parses it out to a vector of tokens. Give
it the behaviour you need it to have with regard to missing
entries. Make sure you follow all the "motherhood" rules
about class design such as the rule of 3, and so on. Then
give it a small number of "get" funcs that pull out the number
of items in the vector, and the "nth" item in the list. You
can then have a really good time deciding what to do about
such things as asking for an element past the end (the
7th element when there are only 4, as an example.)

You can even have such things as multiple delimeters,
delims that are more than one char, even calculated delims
that depend on rules such as a space after a period is a
delim, but a space after anything else is not.
Socks

Mar 29 '06 #2
pl**********@gmail.com wrote:
the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
Well, that depends on what "correct" means. According to the definition
of strotk, the new input has two data fields, separated by three commas.
strtok swallows all consecutive occurrences of characters in the
delimiter string.
How to free the memory allocated?
Same way you allocated it: step through the array and call delete[] on
each allocated block.
how to handle strtok when there is no value between delimiter


strtok doesn't do that. You can use strcspn if you don't mind doing a
little more bookkeeping. Or you can use the STL algorithm find_first_of
to find the next occurrence of the delimiter in a C string. Or, at the
cost of a little more overhead, copy the text into a C++ string object,
and use its member function find_first_of.

--

Pete Becker
Roundhouse Consulting, Ltd.
Mar 29 '06 #3
Puppet_Sock wrote:
pl**********@gmail.com wrote:
[snip]
pch=strtok(b,",");

[snip]
the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
How to free the memory allocated?
how to handle strtok when there is no value between delimiter


I am convinced that the main purpose of the strtok function being
in the library is to catch new coders in the knees.

Carefully read up on the strtok function in your compiler's docs.
Note what happens when there are multiple delimeters with
nothing between them. So, your "not working" input will be
equivalent to

char b[]="mani,kumar"

that is, there's no way for you to use strtok to get those missing
fields in the middle.

Also, read up in your docs about the various warnings and caveats
about using strtok. The security warning that should be there, for
example. And the warning about a static variable being used so that
multiple overlapping calls with different strings to tokenize will
interfere with eachother.

My opinion: Don't use strtok. Roll up your own parsing class,
preferably using std::string instead of char arrays. But even if
you can't use std::string, drop the use of strtok.

Write yourself a class that takes your input, copies it to an
internal buffer, then parses it out to a vector of tokens. Give
it the behaviour you need it to have with regard to missing
entries. Make sure you follow all the "motherhood" rules
about class design such as the rule of 3, and so on. Then
give it a small number of "get" funcs that pull out the number
of items in the vector, and the "nth" item in the list. You
can then have a really good time deciding what to do about
such things as asking for an element past the end (the
7th element when there are only 4, as an example.)

You can even have such things as multiple delimeters,
delims that are more than one char, even calculated delims
that depend on rules such as a space after a period is a
delim, but a space after anything else is not.
Socks


Better yet, use John Bandela's Boost tokenizer (www.boost.org). From
there, you'll likely discover other boost delicacies that will make the
library almost indispensable.

-York
Mar 29 '06 #4
In article <11**********************@g10g2000cwb.googlegroups .com>,
pl**********@gmail.com wrote:
Hi,
I need to split the value stored in a string and store them to another
charrecter array.I am using strtok function.But i am getting invalid
output when there is no value between delimiter

my code
#include<stdio.h>
#include<string.h>
#include<stdlib.h>
void main()
{

char *pch;
char *parameters[4];
int paramcount=0;

char b[]="mani,raju,musa,kumar";

pch=strtok(b,",");
while (pch != NULL)
{
//parameters[paramcount]=pch;
parameters[paramcount]=(char*)malloc(strlen(pch) + 1);
strcpy(parameters[paramcount],pch);
paramcount++;
pch = strtok (NULL, ",");
}//while (pch != NULL)

for(int t=0;t<4;t++)
printf("\n%s\n",parameters[t]);

}
the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
How to free the memory allocated?
how to handle strtok when there is no value between delimiter


I'm thinking your confused as accidentally posted this in a C++
newsgroup instead of a C newsgroup. Could that be the case? If not...

I suggest you use some standard C++ components:

#include <algorithm> // for copy & find
#include <iostream> // for cout
#include <iterator> // for ostream_iterator
#include <string>
#include <vector>

using namespace std;

int main()
{
//char b[]="mani,raju,musa,kumar";
char b[]="mani,,,kumar";

vector<string> vec;
const char* first = b;
const char* last = b + strlen( b );
while ( first != last ) {
const char* next = find( first, last, ',' );
vec.push_back( string( first, next - first ) );
first = min( next + 1, last );
}
copy( vec.begin(), vec.end(),
ostream_iterator<string>( cout, "\n" ) );
}
--
Magic depends on tradition and belief. It does not welcome observation,
nor does it profit by experiment. On the other hand, science is based
on experience; it is open to correction by observation and experiment.
Mar 30 '06 #5
In article
<11**********************@g10g2000cwb.googlegroups .com>,
pl**********@gmail.com wrote:
Hi,
I need to split the value stored in a string and store them to another charrecter array.I am using strtok function.But i am getting invalid
output when there is no value between delimiter

my code
#include<stdio.h
#include<string.h
#include<stdlib.h
void main()
{

char *pch;
char *parameters[4];
int paramcount=0;

char b[]="mani,raju,musa,kumar";

pch=strtok(b,",");
while (pch != NULL)
{
//parameters[paramcount]=pch;
parameters[paramcount]=(char*)malloc(strlen(pch) + 1);
strcpy(parameters[paramcount],pch);
paramcount++;
pch = strtok (NULL, ",");
}//while (pch != NULL)

for(int t=0;t<4;t++)
printf("\n%s\n",parameters[t]);

}
the above code works fine.when i change the input as follows
char b[]="mani,,,kumar"
The output is not correct.
How to free the memory allocated?
how to handle strtok when there is no value between delimiter

I'm thinking your confused as accidentally posted this in a C++
newsgroup instead of a C newsgroup. Could that be the case? If not...

I suggest you use some standard C++ components:

#include <algorithm> // for copy & find
#include <iostream> // for cout
#include <iterator> // for ostream_iterator
#include <string>
#include <vector>

using namespace std;

int main()
{
//char b[]="mani,raju,musa,kumar";
char b[]="mani,,,kumar";

vector<string> vec;
const char* first = b;
const char* last = b + strlen( b );
while ( first != last ) {
const char* next = find( first, last, ',' );
vec.push_back( string( first, next - first ) );
first = min( next + 1, last );
}
copy( vec.begin(), vec.end(),
ostream_iterator<string>( cout,
"\n" ) );
}
--
Magic depends on tradition and belief. It does not welcome
observation,
nor does it profit by experiment. On the other hand, science is based
on experience; it is open to correction by observation and experiment.

Mar 30 '06 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

2
by: Ram Laxman | last post by:
Hi all, I have written the following code: /* strtok example */ #include <stdio.h> #include <string.h> static const char * const resultFileName = "param.txt";
3
by: alef | last post by:
Hi, I have the following code which is driving me crazy. I compile it on MacOSX and it keeps crashing upon entering a command in the program (ran trough gdb) pwd Program received signal...
12
by: ern | last post by:
I'm using it like this: char * _command = "one two three four"; char * g_UserCommands; const char * delimeters = " "; g_UserCommands = strtok(_command, delimeters); g_UserCommands =...
13
by: ern | last post by:
I'm using strtok( ) to capture lines of input. After I call "splitCommand", I call strtok( ) again to get the next line. Strtok( ) returns NULL (but there is more in the file...). That didn't...
20
by: bubunia2000 | last post by:
Hi all, I heard that strtok is not thread safe. So I want to write a sample program which will tokenize string without using strtok. Can I get a sample source code for the same. For exp:...
2
by: manochavishal | last post by:
Hi I am writing a Program in which i get input as #C1012,S,A#C1013,S,U I want to get C1012,S,A using strtok and then pass this to function CreateCopies which will further strtok this...
4
by: Michael | last post by:
Hi, I have a proble I don't understand when using strtok(). It seems that if I make a call to strtok(), then make a call to another function that also makes use of strtok(), the original call is...
29
by: Pietro Cerutti | last post by:
Hello, here I have a strange problem with a real simple strtok example. The program is as follows: ### BEGIN STRTOK ### #include <string.h> #include <stdio.h>
11
by: Lothar Behrens | last post by:
Hi, I have selected strtok to be used in my string replacement function. But I lost the last token, if there is one. This string would be replaced select "name", "vorname", "userid",...
4
by: ohaqqi | last post by:
Hi everybody. I haven't programmed anything in about 8 years, I've read up a little bit on C and need to write a shell in C. I want to use strtok() to take an input from a user and parse it into the...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
0
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.