472,805 Members | 1,004 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 472,805 software developers and data experts.

ANNOUNCE: xlrd 0.5.2 -- extract data from Excel spreadsheets

I am pleased to announce a new general release (0.5.2) of xlrd, a Python
package for extracting data from Microsoft Excel spreadsheets.

CHANGES:

* Book and sheet objects can now be pickled and unpickled. Instead of
reading a large spreadsheet multiple times, consider pickling it once
and loading the saved pickle; can be much faster.

* Now works with Python 2.1. Backporting to Python 2.1 was partially
funded by Journyx - provider of timesheet and project accounting
solutions (http://journyx.com/)

* open_workbook() can be given the contents of a file instead of its name.

* Now more tolerant of files written in unexpected ways by 3rd party
software.

* Speed improvements. Minor bugfixes.

MAIN FEATURES OF xlrd:

* Library for developers; not a tool for end-users.

* Platform-independent pure Python you don't need Windows, Excel,
COM, ...

* Handles all Excel file versions back to 3.0.

* Strong support for Excel dates.

AVAILABLE FROM:

http://cheeseshop.python.org/pypi/xlrd

http://www.lexicon.net/sjmachin/xlrd

ENQUIRIES:

E-mail to sjmachin at lexicon.net with [xlrd] in the subject.

Cheers,
John

Mar 18 '06 #1
15 4049
John Machin wrote:
I am pleased to announce a new general release (0.5.2) of xlrd, a Python
package for extracting data from Microsoft Excel spreadsheets.


How does xlrd compare with pyexcelerator? At a glance they look pretty
similar.

Thanks,
Kent
Mar 18 '06 #2
On 19/03/2006 8:31 AM, Kent Johnson wrote:
John Machin wrote:
I am pleased to announce a new general release (0.5.2) of xlrd, a Python
package for extracting data from Microsoft Excel spreadsheets.

How does xlrd compare with pyexcelerator? At a glance they look pretty
similar.


I have an obvious bias, so I'll just leave you with a not-very-PC
analogy to think about:

Depending on the ambient light and the quantity of mead drunk in the
hall, Helen of Troy and Grendel's mum might at a glance look pretty
similar, too. Perhaps a more thorough investigation is needed. What
about your requirements: a partner for the graduation ball, or someone
to lift the truck off you when the jack collapses?

Cheers,
John
Mar 19 '06 #3
- xlrd seems to be focused on extracting data.
- pyexcelerator can also generate Excel files.

Mar 19 '06 #4
John Machin wrote:
On 19/03/2006 8:31 AM, Kent Johnson wrote:
How does xlrd compare with pyexcelerator? At a glance they look pretty
similar.


I have an obvious bias, so I'll just leave you with a not-very-PC
analogy to think about:

Depending on the ambient light and the quantity of mead drunk in the
hall, Helen of Troy and Grendel's mum might at a glance look pretty
similar, too. Perhaps a more thorough investigation is needed. What
about your requirements: a partner for the graduation ball, or someone
to lift the truck off you when the jack collapses?


That didn't shed much light. I'm interested in your biased opinion,
certainly you must have had a reason to write a new package.

I don't have current requirements for this, I'm curious.

Kent
Mar 19 '06 #5
On 19/03/2006 2:30 PM, Kent Johnson wrote:
John Machin wrote:
On 19/03/2006 8:31 AM, Kent Johnson wrote:
How does xlrd compare with pyexcelerator? At a glance they look
pretty similar.


I have an obvious bias, so I'll just leave you with a not-very-PC
analogy to think about:

Depending on the ambient light and the quantity of mead drunk in the
hall, Helen of Troy and Grendel's mum might at a glance look pretty
similar, too. Perhaps a more thorough investigation is needed. What
about your requirements: a partner for the graduation ball, or someone
to lift the truck off you when the jack collapses?

That didn't shed much light. I'm interested in your biased opinion,
certainly you must have had a reason to write a new package.

I don't have current requirements for this, I'm curious.


* It's not new. First public release was on 2005-05-15. When I started
writing it, there was no pure-Python Excel reading facility available at
all. Roman Kiseliov's pyExcelerator was first announced on c.l.py.ann
on 2005-03-22 (write only) and later with an import facility on 2005-05-12.

* I wrote it because I needed to get data out of Excel spreadsheets in a
production environment. I had tried COM, ODBC, and manual save-as-CSV
and all those approaches were unsatisfactory in terms of reliability and
robustness.

* Creating Excel files: xlrd doesn't do this. If you have Python 2.4,
pyExcelerator is the best choice. The alternative is PyXLWriter which
works with Python 2.2 onwards but is no longer maintained and writes
only the older Excel 5.0 / Excel 95 file format (no Unicode support,
limited to 16K rows).

* Herewith the biased comparison:
[I've CCed Roman on this & the previous posting, by the way]

** Python versions: xlrd 2.1 to 2.4, pyExcelerator 2.4 only

** Excel file versions: xlrd 3.0 onwards, pyExcelerator 5.0 onwards [I
doubt there are many 3.0, 4S and 4W files hanging about but I had some
Excel 4.0 files so I did it as a jeu d'esprit]

** Date support: Excel stores dates as real numbers of days sort-of
since some variable date ... a long shocking story, read the xlrd docs.
xlrd puts considerable effort into examining the formats used by number
cells so that they can be classifed as date or not-date. It provides
functions for converting between Excel date numbers and datetime tuples.

** Speed: On a 3.2GHz Intel P4 with 1 GB of RAM, xlrd loads a 128 Mb
spreadsheet [yes sir, real live user data] in a little over a minute,
while pyExcelerator takes a little over 3 minutes. Taking out half of
that memory doesn't bother xlrd at all, but ...

** Memory footprint: pyExcelerator can use from 2.5 to 4 times as much
memory as xlrd.

** Docs: xlrd has docs.

Hoping that shed some light :-)
Cheers,
John
Mar 19 '06 #6
John Machin wrote:
On 19/03/2006 2:30 PM, Kent Johnson wrote:
That didn't shed much light. I'm interested in your biased opinion,
certainly you must have had a reason to write a new package.


* It's not new. First public release was on 2005-05-15. When I started
writing it, there was no pure-Python Excel reading facility available at
all. Roman Kiseliov's pyExcelerator was first announced on c.l.py.ann
on 2005-03-22 (write only) and later with an import facility on 2005-05-12.


Ah, my mistake, sorry. I didn't recall hearing about xlrd before and
jumped to the conclusion that it was new, though your OP is very clear
that this is an update release.
* Herewith the biased comparison:


Thank you!

Kent
Mar 19 '06 #7
Kent Johnson wrote:
John Machin wrote:

* Herewith the biased comparison: ....


Thank you!


Thank you (John) as well. I realize you are a bit reluctant to toot
your own horn, but it is just this kind of biased comparison that
let's us know whether to investigate further. It also helps that
you mention what pyExcelerator is good at.

--
-Scott David Daniels
sc***********@acm.org
Mar 19 '06 #8
John

Thanks for walking us through the comparison. On the xlrd website I
saw that it does not import formulas from the Excel files, which is
what I'm looking for. Any suggestions?

Juan C.

Mar 20 '06 #9
On 20/03/2006 9:28 PM, jcmendez wrote:
John

Thanks for walking us through the comparison. On the xlrd website I
saw that it does not import formulas from the Excel files, which is
what I'm looking for. Any suggestions?

Juan C.

Juan, what do you want to do with the formulas after importing them?
Pretty-print them? Evaluate them?
Cheers,
John
Mar 20 '06 #10
Hi John

I'd like to create a dependency graph and plot it with Graphviz. I've
played a bit with exporting the sheet in XML format, and parsing the
XML. That somehow works, but it would be much better if the users
wouldn't need to save as the sheets, just put them is a shared
directory where I can get them with the script.

Thanks!!

Mar 20 '06 #11
On 20/03/2006 10:00 PM, jcmendez wrote:
Hi John

I'd like to create a dependency graph and plot it with Graphviz. I've
played a bit with exporting the sheet in XML format, and parsing the
XML. That somehow works, but it would be much better if the users
wouldn't need to save as the sheets, just put them is a shared
directory where I can get them with the script.

Thanks!!


I guess that you need, for each formula cell in a worksheet, a list of
the cells that are referred to by the formula ... is that correct?
Mar 20 '06 #12
Exactly. Once I get the formulas, I can do a weak parsing of them and
find the references.

Mar 20 '06 #13
On 20/03/2006 10:37 PM, jcmendez wrote:
Exactly.
Yes, your requirement is exactly that, a list of references.

Once I get the formulas, I can do a weak parsing of them and
find the references.


A formula is not stored as input e.g. "(A1+A2)*3.0+$Z$29"; it's kept as
an RPN stream of variable-length tokens. You don't need to parse it in
the sense you were probably thinking of; *ALL* [ho ho chuckle chuckle]
you need to do is step through the tokens and do something with the ones
that contain references. Have a peek at this:
http://sc.openoffice.org/excelfileformat.pdf -- formulas are covered in
40+ pages starting at about page 25.

Cheers,
John
Mar 20 '06 #14
Em Seg, 2006-03-20 *s 23:01 +1100, John Machin escreveu:
*ALL* [ho ho chuckle chuckle]
you need to do is step through the tokens and do something with the ones
that contain references.


And contribute back the code? =)

--
Felipe.

Mar 20 '06 #15
the 2nd url seems to be a dead link?

Mar 30 '06 #16

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

11
by: Tempo | last post by:
Hello. I am getting the error that is displayed below, and I know exactly why it occurs. I posted some of my program's code below, and if you look at it you will see that the error terminates the...
6
by: james.igoe | last post by:
I've been hired to produce a reporting database that takes data from numerous sources (5 financial products, from three regions, each with multiple tabs) and although I'm confident I can build...
2
by: BrendanC | last post by:
I've started learninhg Python and have developed a small Python app that imports Excel data into an Access mdb/jet database. This application has dependencies on the following: XLRD -...
2
by: kylancal | last post by:
I am trying to read an Excel book with XLRD and I am getting the following error Traceback (most recent call last): File "C:\temp\ReadGoldmanExcelFiles.py", line 62, in <module> startRow = 0,...
3
by: waldopat | last post by:
Hi all, I have an excel doc that has some information about various countries and I want to get a list of all the countries, which is in Column A. But, when I try to iterate over column A, I get...
1
by: Kelie | last post by:
Hello, I tried using xlrd to read an Excel file and kept getting this error: AttributeError: 'Book' object has no attribute 'mem' AttributeError: 'Book' object has no attribute 'mem' ...
1
by: Krishna | last post by:
I want to delete some rows (by creating a loop may be) using xlrd. Is this possible, if not how do I do that with python? Please help Thanks Krishna
1
by: Edwin.Madari | last post by:
here is working code that will read & display contents of all rows & columns in all the sheets, you need xlrd 0.6.1 import xlrd, os, sys book = xlrd.open_workbook(sys.argv) print "The number...
2
by: patrick.waldo | last post by:
Hi all, I am trying to figure out a way to read colors with xlrd, but I did not understand the formatting.py module. Basically, I want to sort rows that are red or green. My initial attempt...
2
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 2 August 2023 starting at 18:00 UK time (6PM UTC+1) and finishing at about 19:15 (7.15PM) The start time is equivalent to 19:00 (7PM) in Central...
0
by: erikbower65 | last post by:
Using CodiumAI's pr-agent is simple and powerful. Follow these steps: 1. Install CodiumAI CLI: Ensure Node.js is installed, then run 'npm install -g codiumai' in the terminal. 2. Connect to...
0
linyimin
by: linyimin | last post by:
Spring Startup Analyzer generates an interactive Spring application startup report that lets you understand what contributes to the application startup time and helps to optimize it. Support for...
0
by: erikbower65 | last post by:
Here's a concise step-by-step guide for manually installing IntelliJ IDEA: 1. Download: Visit the official JetBrains website and download the IntelliJ IDEA Community or Ultimate edition based on...
0
by: kcodez | last post by:
As a H5 game development enthusiast, I recently wrote a very interesting little game - Toy Claw ((http://claw.kjeek.com/))。Here I will summarize and share the development experience here, and hope it...
14
DJRhino1175
by: DJRhino1175 | last post by:
When I run this code I get an error, its Run-time error# 424 Object required...This is my first attempt at doing something like this. I test the entire code and it worked until I added this - If...
5
by: DJRhino | last post by:
Private Sub CboDrawingID_BeforeUpdate(Cancel As Integer) If = 310029923 Or 310030138 Or 310030152 Or 310030346 Or 310030348 Or _ 310030356 Or 310030359 Or 310030362 Or...
0
by: lllomh | last post by:
Define the method first this.state = { buttonBackgroundColor: 'green', isBlinking: false, // A new status is added to identify whether the button is blinking or not } autoStart=()=>{
0
by: Mushico | last post by:
How to calculate date of retirement from date of birth

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.