473,810 Members | 2,935 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

large db update

Excuseme if it isn't a strictly PHP related post...
I've a local database (ms access) wich has all the stock information
(nearly 10000 daily-changing records), and I want to keep this info on
line as well (I've an PHP-mySql on-line catalog of the same products).
What would be the best aproach to achieve this? I mean, this can't be
done with a php form-window which updates the article's quantity one by
one... (it would takes 100 years:)

Any kind of tips, advices, links,... would be apreciated

Note that I can't upload the access db and work directly with it,
beacause there is no permanent internet connection where it is placed.
The update proccess should/will be performed once a day, maybe twice...

regards - julian

Aug 17 '05 #1
2 1162
In article <11************ **********@f14g 2000cwb.googleg roups.com>,
"julian_m" <ju***********@ gmail.com> wrote:
Excuseme if it isn't a strictly PHP related post...
I've a local database (ms access) wich has all the stock information
(nearly 10000 daily-changing records), and I want to keep this info on
line as well (I've an PHP-mySql on-line catalog of the same products).
What would be the best aproach to achieve this? I mean, this can't be
done with a php form-window which updates the article's quantity one by
one... (it would takes 100 years:)

Any kind of tips, advices, links,... would be apreciated

Note that I can't upload the access db and work directly with it,
beacause there is no permanent internet connection where it is placed.
The update proccess should/will be performed once a day, maybe twice...

regards - julian


The only way I can think of is to perform a "export" to a Tab or comma
separated file for each table and use phpMyAdmin to read the files in as
often as you need to do this. I see no way to automate this which make
this a process highly prone to errors. I'd look at changing the Access
database (put it on a network and develop some way to update the MySQL
database) or just drop the on-line MySQL altogether and rethink what
business solution you're trying to solve with it.

--
DeeDee, don't press that button! DeeDee! NO! Dee...

Aug 17 '05 #2
julian_m wrote:
Excuseme if it isn't a strictly PHP related post...
I've a local database (ms access) wich has all the stock information
(nearly 10000 daily-changing records), and I want to keep this info on
line as well (I've an PHP-mySql on-line catalog of the same products).
What would be the best aproach to achieve this? I mean, this can't be
done with a php form-window which updates the article's quantity one by
one... (it would takes 100 years:)

Any kind of tips, advices, links,... would be apreciated

Note that I can't upload the access db and work directly with it,
beacause there is no permanent internet connection where it is placed.
The update proccess should/will be performed once a day, maybe twice...

regards - julian


First off, you'll be very happy after you've gotten rid of that Access
database and done this for real, but since that's not today's project, what
can you do today?

One thing you can do if you have PHP on the Access machine is write a little
script that opens the db, pulls out the data, and submits it as a file
upload to a server routine that processes it and adds it to your 'real'
database (the PHP-mySQL system). You can then either time this process to
happen from time to time or you can have somebody do it manually.

The other way is to do it entirely from the server. Even though you don't
have 24-hour connection, you must have the connection at some point to do
whatever kind of transfer it will be, so at that point have the server
connect to the Access database via ODBC, pull the data, and put it into the
PHP-mySQL system.

Hope this helps.

--
Kenneth Downs
Secure Data Software, Inc.
(Ken)nneth@(Sec )ure(Dat)a(.com )
Aug 18 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
1431
by: Chris | last post by:
When you have to read a big file (5-30MB) and throw the data into the database, ofcourse some logics inbetween (doesn't matter) which of the ADO methods is recommended. 1. read line by line and do the execute for each line 2. Consolidate the files into a dataset for example and use the dataset update method ie for each line .addnew in the dataset end
6
2658
by: Greg | last post by:
I am working on a project that will have about 500,000 records in an XML document. This document will need to be queried with XPath, and records will need to be updated. I was thinking about splitting up the XML into several XML documents (perhaps 50,000 per document) to be more efficient but this will make things a lot more complex because the searching needs to go accross all 500,000 records. Can anyone point me to some best practices...
0
793
by: David Helgason | last post by:
I think those best practices threads are a treat to follow (might even consider archiving some of them in a sort of best-practices faq), so here's one more. In coding an game asset server I want to keep a large number of file revisions of varying sizes (1Kb-50Mb) inside the database. Naturally I want to avoid having to allocate whole buffers of 50Mb too often.
5
5613
by: Louis LeBlanc | last post by:
Hey folks. I'm new to the list, and not quite what you'd call a DB Guru, so please be patient with me. I'm afraid the lead up here is a bit verbose . . . I am working on an application that uses very high volume DB transactions - in the order of tens of millions per day . . . Anyway, the current database which will remain nameless, but begins with O and rymes with debacle (sorta), has a problem with high volume work when it comes to...
20
4314
by: mike | last post by:
I help manage a large web site, one that has over 600 html pages... It's a reference site for ham radio folks and as an example, one page indexes over 1.8 gb of on-line PDF documents. The site is structured as an upside-down tree, and (if I remember correctly) never more than 4 levels. The site basically grew (like the creeping black blob) ... all the pages were created in Notepad over the last
2
2439
by: =?Utf-8?B?UHJpeWE=?= | last post by:
Hi, I'm faced with a classic problem of how to update a large number of records from a web page. I;m trying to build an interface that will display recordset in the order of 3000 rows and allow the user to edit and update records from that interface. I have cached some static lists in the page but the main recordset should reflect updated data so it can't be cached. I also compute some control functions over the whole data. This will...
5
1931
by: troy | last post by:
Could someone please point me in the right direction on how to read in a large query with .net. I am trying to emulate a legacy database system so I don't know the upper bounds of the sql query. An example query would be something like: Select * from invoices where year 1995 the query must be updatable and only return say 10 to 100 rows at a
0
2395
by: eduardasm | last post by:
Hello, I have a problem with XML schema update for one XML column (problem exists in both SP1 and SP2 for SQL Server 2005). 1. I have a table that looks like this: CREATE TABLE .( NOT NULL DEFAULT (newid()), (500) NOT NULL, NULL,
4
1362
by: MLH | last post by:
Suppose you're using a query to update or append many records in a large table. And suppose one of those fields is a T/D stamp table and you're using Now() to write its value. It is conceivable that a large number of records could take a few milliseconds to write and that the time could change from 13:00:00 to 13:00:01 between the time the first record was modified and the time the last was modified. Now I've never seen that happen. But...
3
7339
by: ireallyneedtoknow2007 | last post by:
hello i am using c# in visual studio 2005 and need to insert a large number of records contained in a dataset into an access database. the following is too slow. how can i update my DataAdapter with all the rows(150000) at one time? thanks foreach (DataRow row in ds.Tables.Rows) { DataRow dr = ds1.Tables.NewRow(); dr = ds1.Tables.NewRow(); dr = row;
0
9722
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9603
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10644
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
10379
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
0
10124
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
9200
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7664
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5550
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
3
3015
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.