473,320 Members | 2,177 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

CSV problems

Here's one for you.
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the
whole thing bugs out.
I am wondering of it is possible to replace these commas in the fields
without replacing the CSV structure.

Any help greatly appreciated.

Regards
Richard Grove
http://shopbuilder.org - ecommerce systems
Become a Shop Builder re-seller:
http://www.affiliatewindow.com/affil...ls.php?mid=611
http://www.affiliatewindow.com/a.pl?590

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.536 / Virus Database: 331 - Release Date: 03/11/2003
Jul 17 '05 #1
5 4869
In message <3f*********************@mercury.nildram.net>, Richard Grove
<info@[at].invalid> writes
Here's one for you.
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the
whole thing bugs out.
I am wondering of it is possible to replace these commas in the fields
without replacing the CSV structure.


In general a CSV format file should have double-quote marks around the
field data if it has commas in it.

E.g.

1,2,3,some test data,5
1,2,3,"some, test data",5

fgetcsv() should then read this correctly.

--
Rob Allen
Jul 17 '05 #2
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> writes:
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the
whole thing bugs out.
What exactly happens when "the whole thing bugs out"? Are the
commas in the fields inside quotation marks? Are there quotation
marks in the file that could be confusing fgetcsv()?

Could you post a line from the CSV file and the code you're using
to read it? That way we could see exactly what's happening.
I am wondering of it is possible to replace these commas in the fields
without replacing the CSV structure.


Let's get all the facts before looking for a solution.

--
Michael Fuhr
http://www.fuhr.org/~mfuhr/
Jul 17 '05 #3
"Michael Fuhr" <mf***@fuhr.org> wrote in message
news:3f**********@omega.dimensional.com...
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> writes:
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the whole thing bugs out.


What exactly happens when "the whole thing bugs out"? Are the
commas in the fields inside quotation marks? Are there quotation
marks in the file that could be confusing fgetcsv()?

Could you post a line from the CSV file and the code you're using
to read it? That way we could see exactly what's happening.
I am wondering of it is possible to replace these commas in the fields
without replacing the CSV structure.


Let's get all the facts before looking for a solution.

--
Michael Fuhr
http://www.fuhr.org/~mfuhr/


My CSV file doesn't have quotes.
When it bugs out, what I meant to say was that when it populates the
databse, it skips columns and puts values in the wrong place.
Not really bugging out I suppose.

Regards
Richard Grove
01892 546979
http://shopbuilder.org - ecommerce systems
Become a Shop Builder re-seller:
http://www.affiliatewindow.com/affil...ls.php?mid=611
http://www.affiliatewindow.com/a.pl?590

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.536 / Virus Database: 331 - Release Date: 03/11/2003
Jul 17 '05 #4
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> writes:
"Michael Fuhr" <mf***@fuhr.org> wrote in message
news:3f**********@omega.dimensional.com...
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> writes:
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the whole thing bugs out.
What exactly happens when "the whole thing bugs out"? Are the
commas in the fields inside quotation marks? Are there quotation
marks in the file that could be confusing fgetcsv()?

Could you post a line from the CSV file and the code you're using
to read it? That way we could see exactly what's happening.


My CSV file doesn't have quotes.


If a comma is the field separater, and if a field's value contains
commas, then that field needs to be quoted. Without some way to
distinguish which commas are part of a field and which commas
separate different fields, you'll get unexpected results.
When it bugs out, what I meant to say was that when it populates the
databse, it skips columns and puts values in the wrong place.
Not really bugging out I suppose.


Make sure you're reading the data correctly before worrying about
how it's inserted into a database.

As I asked before, please post a troublesome line from the CSV file
and the code you're using to read it. If we can see what you're
doing then we might be able to offer advice on how to fix the
problem.

--
Michael Fuhr
http://www.fuhr.org/~mfuhr/
Jul 17 '05 #5
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> wrote in message
news:3f*********************@mercury.nildram.net.. .
"Michael Fuhr" <mf***@fuhr.org> wrote in message
news:3f**********@omega.dimensional.com...
"Richard Grove" <info[at]redeyemedia[dot]co[dot]uk> writes:
I import a CSV file which is then read using fgetcsv();
My problem is that if the fields in the CSV file have commas in them, the whole thing bugs out.


What exactly happens when "the whole thing bugs out"? Are the
commas in the fields inside quotation marks? Are there quotation
marks in the file that could be confusing fgetcsv()?

Could you post a line from the CSV file and the code you're using
to read it? That way we could see exactly what's happening.
I am wondering of it is possible to replace these commas in the fields
without replacing the CSV structure.


Let's get all the facts before looking for a solution.

--
Michael Fuhr
http://www.fuhr.org/~mfuhr/


My CSV file doesn't have quotes.
When it bugs out, what I meant to say was that when it populates the
databse, it skips columns and puts values in the wrong place.
Not really bugging out I suppose.


Sounds like the csv is not being properly generated. Without those quotes,
there's really no way to know where you're trying to separate the fields.
Jul 17 '05 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: Jerome Lefebvre | last post by:
Hello, Hope this will interest a few. I been working with a friend on the problems given out during the "International Collegiate Programming Contest" (ICPC) http://icpc.baylor.edu/icpc/ ....
14
by: Jim Hubbard | last post by:
Are you up to speed on the difficulties in using the 1.1 .Net framework? Not if you are unaware of the 1,596 issues listed at KBAlertz (http://www.kbalertz.com/technology_3.aspx). If you are...
1
by: 3f | last post by:
Hello; We have made a web application that people can download from our web site and installed on: Windows XP Windows 2000 Professional Windows 2003 Server Windows 2000 Server
5
by: Corky | last post by:
This works: db2 SELECT DISTINCT PROBLEM_OBJECTS.PROBLEM_ID FROM PROBLEM_OBJECTS INNER JOIN PROBLEMS ON PROBLEM_OBJECTS.PROBLEM_ID = PROBLEMS.PROBLEM_ID WHERE INTEGER(DAYS(CURRENT DATE) -...
2
by: Ellen Graves | last post by:
I am having a lot of problems with DB2 8.3.1 on RH Linux AS2.1. Installing and running stored procedures is problematic. Stored procedures I have used for years on V7 on WinNT are now failing...
19
by: Jim | last post by:
I have spent the past few weeks designing a database for my company. The problem is I have started running into what I believe are stack overflow problems. There are two tab controls on the form...
10
by: BBFrost | last post by:
We just recently moved one of our major c# apps from VS Net 2002 to VS Net 2003. At first things were looking ok, now problems are starting to appear. So far ... (1) ...
19
by: Dales | last post by:
I have a custom control that builds what we refer to as "Formlets" around some content in a page. These are basically content "wrapper" sections that are tables that have a colored header and...
2
by: Brian | last post by:
NOTE ALSO POSTED IN microsoft.public.dotnet.framework.aspnet.buildingcontrols I have solved most of my Server Control Collection property issues. I wrote an HTML page that describes all of the...
0
by: Sergistm | last post by:
Hello World, :D I have a problem that it is making me crazy, I hope you can help me. I'm trying to execute a .exe file with the Procces.Start, and there is no problem when the file is on my...
0
by: DolphinDB | last post by:
The formulas of 101 quantitative trading alphas used by WorldQuant were presented in the paper 101 Formulaic Alphas. However, some formulas are complex, leading to challenges in calculation. Take...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.