I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben 14  2869 
Well that's odd...
If I place the exact same Insert statement elswhere in the program it
works as intended.
That would suggest it is never being run in its old position, but the
statements either side of it are printing...
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Ben wrote:
Well that's odd...
If I place the exact same Insert statement elswhere in the program it
works as intended.
That would suggest it is never being run in its old position, but the
statements either side of it are printing...
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
Well, it would appear to be some kind of autocommit problem. I had
autocommit off, bus committed when I disconnected from the database.
For some reason although all the other statements seemed ok, multiple
statements in that loop were'nt every commiting. For the moment I've
turned autocommit on and that has sorted things out, but it slows
things down too so I'll try to fix it :-)
Ben
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
It wouldn't explain why the NOT EXISTS line is being ignored though...
Ben
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
>
I first connect to the database...
>
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
>
All the neccesary tables are created...
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
>
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
>
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
>
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
>
I have, for debugging, set "i" up as a counter variable.
>
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
>
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
>
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
>
Cheers,
>
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Each time my script is run, the following is called:
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
Ben
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
It wouldn't explain why the NOT EXISTS line is being ignored though...
Ben
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
>
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
>
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
Ben wrote:
Each time my script is run, the following is called:
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
Ben
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
It wouldn't explain why the NOT EXISTS line is being ignored though...
Ben
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
>
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
>
I'll go back and see what I can find...
Cheers,
Ben
>
>
johnf wrote:
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
>
I first connect to the database...
>
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
>
All the neccesary tables are created...
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
>
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
>
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
>
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
>
I have, for debugging, set "i" up as a counter variable.
>
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
>
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
>
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
>
Cheers,
>
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Well, I've checked the SQL log, and my insert statements are certainly
being logged. The only option left open is that the table in question
is being replaced, but I can't see why it should be...
Ben wrote:
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
Ben wrote:
Each time my script is run, the following is called:
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
Ben
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
>
It wouldn't explain why the NOT EXISTS line is being ignored though...
>
Ben
>
>
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
>
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
>
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
I have found the problem, but not the cause.
I tried setting the database up manually before hand, which let me get
rid of the "IF NOT EXISTS" lines, and now it works!
But why the *** should it not work anyway? The first time it is run, no
database or tables, so it creates them. That works. But apparentlyu on
subsequent runs it decides the tables it created arent' actually there,
and overwrites them. Grrrrrrrrrrrrr.
Ben
Ben wrote:
Well, I've checked the SQL log, and my insert statements are certainly
being logged. The only option left open is that the table in question
is being replaced, but I can't see why it should be...
Ben wrote:
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
Ben wrote:
Each time my script is run, the following is called:
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
>
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
>
Ben
>
>
>
>
>
>
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
It wouldn't explain why the NOT EXISTS line is being ignored though...
Ben
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
>
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
>
I'll go back and see what I can find...
Cheers,
Ben
>
>
johnf wrote:
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
>
I first connect to the database...
>
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
>
All the neccesary tables are created...
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
>
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
>
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
>
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
>
I have, for debugging, set "i" up as a counter variable.
>
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
>
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
>
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
>
Cheers,
>
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Perhaps when I'm checking for table existance using mysql through
python I have to be more explicit:
Where I did have:
USE database;
IF NOT EXISTS CREATE table(.....
Perhaps I need:
USE database;
IF NOT EXISTS CREATE database.table(.....
I'll try it after lunch. Does anyoone know whether this might be the
problem?
Ben
Ben wrote:
I have found the problem, but not the cause.
I tried setting the database up manually before hand, which let me get
rid of the "IF NOT EXISTS" lines, and now it works!
But why the *** should it not work anyway? The first time it is run, no
database or tables, so it creates them. That works. But apparentlyu on
subsequent runs it decides the tables it created arent' actually there,
and overwrites them. Grrrrrrrrrrrrr.
Ben
Ben wrote:
Well, I've checked the SQL log, and my insert statements are certainly
being logged. The only option left open is that the table in question
is being replaced, but I can't see why it should be...
Ben wrote:
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
>
>
Ben wrote:
Each time my script is run, the following is called:
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
Ben
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
>
It wouldn't explain why the NOT EXISTS line is being ignored though...
>
Ben
>
>
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
>
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
>
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
Not sure if this will help, as you said you already tried autocommit,
but did you try to commit after creating the table, then doing all the
inserts before commiting on disconnect?
(I'm no MySQL or Python guru, but I do use it with python and MySQLdb .)
Ask Ben, he might know, although he's out to lunch.
Ben wrote:
I'll try it after lunch. Does anyoone know whether this might be the
problem?
Ben
Ben wrote:
I have found the problem, but not the cause.
I tried setting the database up manually before hand, which let me get
rid of the "IF NOT EXISTS" lines, and now it works!
But why the *** should it not work anyway? The first time it is run, no
database or tables, so it creates them. That works. But apparentlyu on
subsequent runs it decides the tables it created arent' actually there,
and overwrites them. Grrrrrrrrrrrrr.
Ben
Ben wrote:
Well, I've checked the SQL log, and my insert statements are certainly
being logged. The only option left open is that the table in question
is being replaced, but I can't see why it should be...
>
>
Ben wrote:
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
Ben wrote:
Each time my script is run, the following is called:
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
>
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
>
Ben
>
>
>
>
>
>
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
It wouldn't explain why the NOT EXISTS line is being ignored though...
Ben
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
>
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
>
I'll go back and see what I can find...
Cheers,
Ben
>
>
johnf wrote:
Ben wrote:
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
>
I first connect to the database...
>
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
>
All the neccesary tables are created...
>
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
>
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
>
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
>
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
>
I have, for debugging, set "i" up as a counter variable.
>
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
>
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
>
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
>
Cheers,
>
Ben
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
:-) Ok, point taken!
I fixed it in the end. It was nothing interesting at all - just a
wayward line of code that was doing exactly what I feared - replacing
the database each time rather than just when it was needed.
Ben
Leo Kislov wrote:
Ask Ben, he might know, although he's out to lunch.
Ben wrote:
I'll try it after lunch. Does anyoone know whether this might be the
problem?
Ben
Ben wrote:
I have found the problem, but not the cause.
>
I tried setting the database up manually before hand, which let me get
rid of the "IF NOT EXISTS" lines, and now it works!
>
But why the *** should it not work anyway? The first time it is run, no
database or tables, so it creates them. That works. But apparentlyu on
subsequent runs it decides the tables it created arent' actually there,
and overwrites them. Grrrrrrrrrrrrr.
>
>
Ben
>
>
>
Ben wrote:
Well, I've checked the SQL log, and my insert statements are certainly
being logged. The only option left open is that the table in question
is being replaced, but I can't see why it should be...
Ben wrote:
Nope... that can't be it. I tried running those commands manually and
nothing went wrong.
But then again when I execute the problematic command manually nothing
goes wrong. Its just not executing until the last time, or being
overwritten.
>
>
Ben wrote:
Each time my script is run, the following is called:
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS table_name ( ....
The idea being that stuf is only created the first time the script is
run, and after that the original tables and database is used. This
might explain my pronblem if for some reason the old tables are being
replaced... can anyone see anything wrong with the above?
Ben
Ben wrote:
One partial explanation might be that for some reason it is recreating
the table each time the code runs. My code says "CREATE TABLE IF NOT
EXISTS" but if for some reason it is creating it anyway and dropping
the one before that could explain why there are missing entires.
>
It wouldn't explain why the NOT EXISTS line is being ignored though...
>
Ben
>
>
Ben wrote:
I initially had it set up so that when I connected to the database I
started a transaction, then when I disconnected I commited.
I then tried turning autocommit on, but that didn't seem to make any
difference (althouh initially I thought it had)
I'll go back and see what I can find...
Cheers,
Ben
johnf wrote:
Ben wrote:
>
I don't know whether anyone can help, but I have an odd problem. I have
a PSP (Spyce) script that makes many calls to populate a database. They
all work without any problem except for one statement.
I first connect to the database...
self.con = MySQLdb.connect(user=username, passwd =password)
self.cursor = self.con.cursor()
self.cursor.execute("SET max_error_count=0")
All the neccesary tables are created...
self.cursor.execute("CREATE DATABASE IF NOT EXISTS "+name)
self.cursor.execute("USE "+name)
self.cursor.execute("CREATE TABLE IF NOT EXISTS networks (SM
varchar(20),DMC int,DM varchar(50),NOS int,OS varchar(50),NID
varchar(20))
Then I execute many insert statements in various different loops on
various tables, all of which are fine, and result in multiple table
entries. The following one is executed many times also. and seems
identical to the rest. The print statements output to the browser
window, and appear repeatedly, so the query must be being called
repeatedly also:
print "<p><b>SQL query executing</b><p>"
self.cursor.execute("INSERT INTO networks VALUES ('a',' "+i+"
','c','2','e','f','g')")
print "<p><b>SQL query executed</b><p>"
I have, for debugging, set "i" up as a counter variable.
No errors are given, but the only entry to appear in the final database
is that from the final execution of the INSERT statement (the last
value of i)
I suspect that this is to vague for anyone to be able to help, but if
anyone has any ideas I'd be really grateful :-)
It occured to me that if I could access the mysql query log that might
help, but I was unsure how to enable logging for MysQL with python.
Cheers,
Ben
>
Not sure this will help but where is the "commit"? I don't use MySQL but
most SQL engines require a commit.
Johnf
"Ben" <Be*************@gmail.comwrote:
>Perhaps when I'm checking for table existance using mysql through
python I have to be more explicit:
Where I did have:
USE database;
IF NOT EXISTS CREATE table(.....
Perhaps I need:
USE database;
IF NOT EXISTS CREATE database.table(.....
I'll try it after lunch. Does anyoone know whether this might be the
problem?
The "IF NOT EXISTS" clauses are not standard SQL; they are MySQL
extensions. Although my reasons are nebulous and more related to principle
than to practicality, I try never to use them, because they might not be
available in my next database.
After all, you should have a pretty good idea at any given time whether
your database and table already exist.
I do occasionally allow myself a "DROP TABLE IF NOT EXISTS", which then
allows the unadulterated "CREATE TABLE" command.
--
Tim Roberts, ti**@probo.com
Providenza & Boekelheide, Inc. This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Jack |
last post by:
I have a text file of data in a file (add2db.txt) where the entries are
already entered on separate lines in the following form:
INSERT INTO `reviews` VALUES("", "Tony's", "Lunch", "Great...
|
by: Philip Boonzaaier |
last post by:
I want to be able to generate SQL statements that will go through a list of
data, effectively row by row, enquire on the database if this exists in the
selected table- If it exists, then the colums...
|
by: kristof.loots |
last post by:
Hi all,
Somehow I want to transfer data from an mysql database on the web to an
local offline access database. Note: tables and types do not match.
So, I toughed, generating sql commands to...
|
by: Kevin Lawrence |
last post by:
Hi all
I want to do "INSERT INTO Table (Blob) Values('blobdataasstring')".
...rather than using the parameter driven method, is it possible? And if so
what encoder do I use to convert the...
|
by: David Eades |
last post by:
Hi all
Complete newbie here, so apologies if this is the wrong forum.
I've been asked to use mysql and asp to make a simple bidding system (rather
like a simple ebay), whereby users can use a...
|
by: speralta |
last post by:
My tired old eyes may be failing me, but the following insert
statements look correct to me, but I can't seem to get a clean insert
from a fairly large text file database into mysql. I was...
|
by: Dmitri |
last post by:
Hello!
I have a developer that is playing around with some SQL statements
using VB.NET. He has a test table in a SQL 2000 database, and he has
about 2000 generated INSERT statements.
When the...
|
by: Red |
last post by:
If auto-format is turned off in VS2008, there is apparently no way to
indent a line. Under Tools->Options->Text Editor->C#->Formatting,
there are three checkboxes. Unchecking those seems to cause...
|
by: brianrpsgt1 |
last post by:
I am attempting to insert data from a HTML form using a .psp script.
I can not find how to link the data that is inserted into the form to
the variables in the .psp script to then insert into the...
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: BarryA |
last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: Hystou |
last post by:
There are some requirements for setting up RAID:
1. The motherboard and BIOS support RAID configuration.
2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
| |
