It's taking forever to upload 400,000 records to the database through
access/odbc, and I've tried phpMyAdmin's interface but it seems to timeout
during import of a CSV file. Is there a better way to import 400,000+
records?
7  9296 
Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it like
you said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******** *******@read3.i net.fi... jj wrote:
It's taking forever to upload 400,000 records to the database through
access/odbc, and I've tried phpMyAdmin's interface but it seems to
timeout during import of a CSV file. Is there a better way to import 400,000+
records?
If it is possible for you to get the data into sql command-form like this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
Don't listen to the previous guy.
Use LOAD DATA CONCURRENT INFILE
Loading of several megs of data will take only a few seconds.
On Fri, 19 Dec 2003 19:30:04 GMT, "jj" <jj@test.net> wrote: Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it like
you said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******* ********@read3. inet.fi... jj wrote:
> It's taking forever to upload 400,000 records to the database through
> access/odbc, and I've tried phpMyAdmin's interface but it seems totimeout > during import of a CSV file. Is there a better way to import 400,000+
> records?
If it is possible for you to get the data into sql command-form like this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
jj wrote: It's taking forever to upload 400,000 records to the database through
access/odbc, and I've tried phpMyAdmin's interface but it seems to timeout
during import of a CSV file. Is there a better way to import 400,000+
records?
If it is possible for you to get the data into sql command-form like this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
from Access via MyODBC for MySQL to my local MySQL server it took only a
minute or so. But through ODBC to a remote server, it takes hours then
finally dies. We have a high speed connection. Weird...
<us******@tampa bay.rr.com> wrote in message
news:av******** *************** *********@4ax.c om... Don't listen to the previous guy.
Use LOAD DATA CONCURRENT INFILE
Loading of several megs of data will take only a few seconds.
On Fri, 19 Dec 2003 19:30:04 GMT, "jj" <jj@test.net> wrote:
Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it
likeyou said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******* ********@read3. inet.fi... jj wrote:
> It's taking forever to upload 400,000 records to the database through
> access/odbc, and I've tried phpMyAdmin's interface but it seems to
timeout > during import of a CSV file. Is there a better way to import
400,000+ > records?
If it is possible for you to get the data into sql command-form like
this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it like
you said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******** *******@read3.i net.fi... jj wrote:
It's taking forever to upload 400,000 records to the database through
access/odbc, and I've tried phpMyAdmin's interface but it seems to
timeout during import of a CSV file. Is there a better way to import 400,000+
records?
If it is possible for you to get the data into sql command-form like this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
Don't listen to the previous guy.
Use LOAD DATA CONCURRENT INFILE
Loading of several megs of data will take only a few seconds.
On Fri, 19 Dec 2003 19:30:04 GMT, "jj" <jj@test.net> wrote: Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it like
you said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******* ********@read3. inet.fi... jj wrote:
> It's taking forever to upload 400,000 records to the database through
> access/odbc, and I've tried phpMyAdmin's interface but it seems totimeout > during import of a CSV file. Is there a better way to import 400,000+
> records?
If it is possible for you to get the data into sql command-form like this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt
from Access via MyODBC for MySQL to my local MySQL server it took only a
minute or so. But through ODBC to a remote server, it takes hours then
finally dies. We have a high speed connection. Weird...
<us******@tampa bay.rr.com> wrote in message
news:av******** *************** *********@4ax.c om... Don't listen to the previous guy.
Use LOAD DATA CONCURRENT INFILE
Loading of several megs of data will take only a few seconds.
On Fri, 19 Dec 2003 19:30:04 GMT, "jj" <jj@test.net> wrote:
Thanks that gave me an idea. I'm importing all the records to my local
MySQL database and will create an extract of that which will format it
likeyou said. Then take that .sql file and import it onto the server. We'll
see...
"Aggro" <sp**********@y ahoo.com> wrote in message
news:X9******* ********@read3. inet.fi... jj wrote:
> It's taking forever to upload 400,000 records to the database through
> access/odbc, and I've tried phpMyAdmin's interface but it seems to
timeout > during import of a CSV file. Is there a better way to import
400,000+ > records?
If it is possible for you to get the data into sql command-form like
this:
-----filename.txt--------
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
insert into tablename(colum n1,column2) values(xx,yy);
-----filename.txt--------
You can insert it into database using mysql console like this:
c:\mysql\bin\my sql -u username databasename < filename.txt This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: Bulba! |
last post by:
One of the posters inspired me to do profiling on my newbie script
(pasted below). After measurements I have found that the speed
of Python, at least in the area where my script works, is surprisingly
high.
This is the experiment: a script recreates the folder hierarchy
somewhere else and stores there the compressed versions of
files from source hierarchy (the script is doing additional backups
of the disk of file server at the company...
|
by: Shailesh Humbad |
last post by:
I just posted an article I wrote called ASP Speed Tricks. It covers
techniques to optimize output of database data in HTML, for
both simple tables and complex tables. More advanced ASP authors might
be interested in the complex table optimizations. Please check it out at:
http://www.somacon.com/aspdocs/
Hope you enjoy,
Shailesh
|
by: Creigh Shank |
last post by:
Using an Apache/PHP/MySQL/Linux (Redhat 8.0) solution, PHPList, to create
an e-mailing list for our 5.6 million book club members. Unfortunately,
the import speed for importing records (at record number 150,000 the rate
is about 2,000 records per hour). We're running on the following:
P4 (1.5 Ghz), 1.2 Gbytes RAM (650 Mbytes RAM Disk using ramfs), IDE drive
(72,00 rpm)
So far we've moved the MySQL data files (var/lib/mysql), PHP /tmp...
|
by: jj |
last post by:
It's taking forever to upload 400,000 records to the database through
access/odbc, and I've tried phpMyAdmin's interface but it seems to timeout
during import of a CSV file. Is there a better way to import 400,000+
records?
|
by: David Mitchell |
last post by:
I use the above function in queries for a number of forms and reports.
The reports take approx 20 seconds to open. There are only 100
product id's in tblProducts. My concern is that the time will
increase as products are added.
Any suggestions to speed it up?
TIA
David
| | |
by: Reddy |
last post by:
The sql query for my datagrid returns 100, 000 records. But the datagrid
should display 20 records per page. I am using datagrid paging, but it is
taking too much time for the page to load. Is there any way I can optimize
the speed. Any sample code would be great.
Thanks,
Reddy
|
by: Sezai YILMAZ |
last post by:
Hello
I need high throughput while inserting into PostgreSQL. Because of that I
did some PostgreSQL insert performance tests.
------------------------------------------------------------
-- Test schema
create table logs (
logid serial primary key,
ctime integer not null,
|
by: Paul |
last post by:
I have a process that I want to speed up. It first was written in
Microsoft Access then converted to VB.NET. I would like to hear some
suggestions on how to speed it up. The process is to match names using
a Soundex function. It reads through a table of about 20,000 records
and matches it with a table of about 9,000 records. That is all done
in code. The tables are stored in SQL Server 2005.
Soundex is a numerical formula to...
|
by: SaltyBoat |
last post by:
Needing to import and parse data from a large PDF file into an Access
2002 table: I start by converted the PDF file to a html file. Then
I read this html text file, line by line, into a table using a code
loop and an INSERT INTO query. About 800,000 records of raw text.
Later, I can then loop through and parse these 800,000 strings into
usable data using more code.
The problem I have is that the conversion of the text file, using a...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
| | |
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| | |
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| | |
