473,320 Members | 2,112 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

File format for a new application

(I know it's a seond post, but I think I explain it better this way)
--

On my own I'm writting an application for the general public.
(a bit like word, except it has nothing to do with word ;-)

So far I used an embeded database engine to store the data (SQLite), I like
the concept because this way I could load/delete/updata whatever data I need
incrementally on demand. And I could also easily perform search.

What gets me more and more concerned is that creating a new (empty) file
(with just about 10 table, 30 index & triggers) takes up to 7 seconds!
Very bad user experience.

I'm considering my options and will gladly takes advice as I'm a bit daunted
by the work involve just to test.

- I was thinking to try an other embeded database engine, such as Firefox.
- I was thinking to use tar-gzipped serialized file (think XML serialization
should be better as it would be probably be better at version resistance
(but worst perf?)), but I was wondering about the wisdom of having all my
data in memory...
- any other ideas?
Aug 31 '05 #1
5 1175
> - I was thinking to try an other embeded database engine, such as Firefox.
Oops...
I mean Firebird, of course!
Aug 31 '05 #2
Hi!
I really don't know how SQLite works, but can't you keep a template file and
use it to create clones for eache new project? In this way it will only take
the copy time, and I suppose that it is less than 7 seconds

Regards
Cristian Mori

"Lloyd Dupont" wrote:
(I know it's a seond post, but I think I explain it better this way)
--

On my own I'm writting an application for the general public.
(a bit like word, except it has nothing to do with word ;-)

So far I used an embeded database engine to store the data (SQLite), I like
the concept because this way I could load/delete/updata whatever data I need
incrementally on demand. And I could also easily perform search.

What gets me more and more concerned is that creating a new (empty) file
(with just about 10 table, 30 index & triggers) takes up to 7 seconds!
Very bad user experience.

I'm considering my options and will gladly takes advice as I'm a bit daunted
by the work involve just to test.

- I was thinking to try an other embeded database engine, such as Firefox.
- I was thinking to use tar-gzipped serialized file (think XML serialization
should be better as it would be probably be better at version resistance
(but worst perf?)), but I was wondering about the wisdom of having all my
data in memory...
- any other ideas?

Sep 1 '05 #3
Lloyd Dupont wrote:
(I know it's a seond post, but I think I explain it better this way)
--

On my own I'm writting an application for the general public.
(a bit like word, except it has nothing to do with word ;-)

So far I used an embeded database engine to store the data (SQLite), I like
the concept because this way I could load/delete/updata whatever data I need
incrementally on demand. And I could also easily perform search.

What gets me more and more concerned is that creating a new (empty) file
(with just about 10 table, 30 index & triggers) takes up to 7 seconds!
Very bad user experience.

[snip rest]
Could you not have your File->New start a new thread which does the
initialisation, while your UI just says "Okay, I've done that, what
next?". Even if you need to interact immediately, surely the addition
of indexes can happen seperately. How fast would it be if those were
done by a background thread instead of immediately?

Damien

Sep 1 '05 #4
drh
Lloyd Dupont wrote:

What gets me more and more concerned is that creating a new (empty) file
(with just about 10 table, 30 index & triggers) takes up to 7 seconds!
Very bad user experience.


Your are probably processing each CREATE as a separate transaction.
It will go *much* faster if you do all the creating as a single
transaction but wrapping all your CREATE statements inside a single
pair of BEGIN and COMMIT statements.

Sep 1 '05 #5
great idea, I'll try that, thanks!

--
"A preoccupation with the next world pretty clearly signals an inability to
cope credibly with this one."

<dr*@hwaci.com> wrote in message
news:11**********************@g47g2000cwa.googlegr oups.com...
Lloyd Dupont wrote:

What gets me more and more concerned is that creating a new (empty) file
(with just about 10 table, 30 index & triggers) takes up to 7 seconds!
Very bad user experience.


Your are probably processing each CREATE as a separate transaction.
It will go *much* faster if you do all the creating as a single
transaction but wrapping all your CREATE statements inside a single
pair of BEGIN and COMMIT statements.

Sep 1 '05 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Cengiz Ulku | last post by:
Hi all, As a general question: Is it possible to create custom file formats? I do not mean changing the attribute of a known file. For ex: A text file transformed into a .xyz will still be...
1
by: Bethany Holliday | last post by:
Hi all, I have a file with an extension of .sdf. I "believe" it is a text file of some sort but I am uncertain. The source agency hasn't returned any of my calls so I'm wondering if anyone is...
11
by: Dale | last post by:
How to recognize whether file has XML format or not? Here is the code segment: XmlDocument* pDomDocument = new XmlDocument(); try { pDomDocument->Load(strFileName ) ; } catch(Exception* e) {
1
by: cab2 | last post by:
We currently have an application built in Access that takes in a csv file using docmd.transfertext. We allow users to export their data to a file for later use (csv format). Users are also...
10
by: Aaron | last post by:
Hello, I have a small application that I need to save data from 7 text boxes in to a csv file. This will entail btnNext_Click function that will create a new csv file and enter the 7 data fields...
0
by: Lokkju | last post by:
I am pretty much lost here - I am trying to create a managed c++ wrapper for this dll, so that I can use it from c#/vb.net, however, it does not conform to any standard style of coding I have seen....
8
by: Krishnan Margabandhu | last post by:
I'm writing a Pocket PC app that will run when a device is first powered on. I want this program to get some data from the user and invoke a CAB file to install a software on the device. How do I...
9
by: JimmyKoolPantz | last post by:
IDE: Visual Studio 2005 Language: VB.NET Fox Pro Driver Version: 9.0.0.3504 Problem: I currently have a problem altering a DBF file. I do not get any syntax errors when running the program. ...
3
by: forest demon | last post by:
for example, let's say I do something like, System.Diagnostics.Process.Start("notepad.exe","sample.txt"); if the user does a SaveAs (in notepad), how can i capture the path that the user...
1
by: Neo007 | last post by:
**File Conversion from CSV format to Excel(.xsl) C# Detailed Requirement is : Requirements for File Conversion Application: 1.My Application must be command-line it should indicate success...
0
by: DolphinDB | last post by:
The formulas of 101 quantitative trading alphas used by WorldQuant were presented in the paper 101 Formulaic Alphas. However, some formulas are complex, leading to challenges in calculation. Take...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
0
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.