473,402 Members | 2,055 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,402 software developers and data experts.

ready-made file format for "file pibes"?

I am writing an application that does a lot of filtering of much data
through a sequence of filters.

After some thinking and wasting a lot of time with an object oriented design
with GUI and all, I decided that the Real Way to do this is to create the
filters as independent programs that take input and produce output in the
good, olde UNIX way, using good olde MAKE to track what needs to be done
next.

Now, I need to simplify even further and leach on even more common knowledge
:) so it is obvious to anyone how to extend the collection of filtering
methods.

Is there a Python library for defining and using a good (i.e. humanly
readable), text-based format that one can use for the intermediate files?

ZConfig is - as I understand it - read-only and it is difficult (for me) to
completely understand what the general principles are because anything
appears possible with it. I am unsure of Pyxie mainly because the
documentation does not describe the "philosophy" and I would rather not hack
up a parser for XML myself for my very-own-xml-format-that-no-one
understands.

If the experience with ZConfig is good, then maybe one can sidestep this and
simply write files that can later be read by ZConfig?

I need to save state between filter runs too and I would like to use the
same mechanism everywhere.

I also need some form of hierachi, i.e. for including information from
further up the chain to know what triggered a filter so that downstream
tools can get that information.

Something as simple as a stansa-format (like .netrc) will probably be
servicable with a little work - but if someone has already defined a better,
more commonly-used format, I am all game.

Any Clues??

mvh,
frithiof jensen.
Sep 20 '05 #1
0 1080

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Cengiz Ulku | last post by:
Hi all, As a general question: Is it possible to create custom file formats? I do not mean changing the attribute of a known file. For ex: A text file transformed into a .xyz will still be...
1
by: Wayne Aprato | last post by:
I have a client who is running several Access 97 databases that I have written for them. They are about to upgrade to Access 2003. Is the default file format of Access 2003 still Access 2000 the...
6
by: Nadav | last post by:
Hi, I am writing some kind of a file scanner, at certain time all of the files under a certain directory will be scanned, this scan require de-compression of common files formats such as ZIP and...
2
by: leahf via AccessMonster.com | last post by:
I upgraded from Access97 to Access2002 last year. I just noticed that the default file format is Access 2000. Can that be the reason that I sometimes get "Microsoft Access has encountered..."...
24
by: TChilton | last post by:
Hello, I am working on an Access database (version 2000) that allows front-end users to enter data into a form. I then created a macro that allows users to send these data to me which appears in my...
3
by: karthikla | last post by:
Hi Experts, Could you please help me on how to get access 2002 file format exactly while doing conversion from Access 97 file format by DBEngine.CompactDatabase() function? Code: Private...
4
by: Max2006 | last post by:
Hi, We are developing a SQL server based asp.net application. As part of requirement we should allow users import/export some relational data through web user interface. We are investigation...
2
by: jims | last post by:
Hi. I was wondering if anybody could piont me to a reference for the .bak file format. I need to upload a huge amount of data from a unix machine into an MS SQLServer database and have tried...
5
by: The Pipe | last post by:
Hello I have a table that I need to export to a .asc file format. I have had several attempts at getting this to work but with no luck. Basically the file would need to have every record...
4
by: doublemaster007 | last post by:
What you mean by ARM-ELF file format? Is this a binary format? If so what is the binay format of AIX, HP, Suse?? Is this the right place to ask this? or can u suggest better place?
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.