473,405 Members | 2,167 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,405 software developers and data experts.

Cleaning up LARGE text files before importing into Access

Hello. I have some very large text files that I need to import into
Access. These files are basically SAP system reports that can be up to
100,000 records but they contain a boatload of data I don't care about.
My thinking was to clean up as much as I can and edit the files into
columns, much like Excel would do, except I am exceeding the 60,000
record limit. Can anyone suggest a good free text editor that will
allow me to cleanup enough and be able to do a text to columns (like
Excel) to import into Access? Perhaps another method? I truly
appreciate.

Mark

Nov 13 '05 #1
7 5365
Mark,

If this data comes in a standard format each time then you can build an
import specification that only imports the fields you need. I use this
with a client that sends a file with way to much information. When I
import the file I have an import specification just for them that only
imports the fields I need.

You get to this specification area by getting the import process
started and then select advance in the lower right corner. Here you set
the layout information and the last item is skip which will allow you
to not import that information. Once you get it setup correctly save
the specification for later use. Works great...

Nov 13 '05 #2
"mpdsal" <m.*******@snet.net> wrote
Can anyone suggest a good free text editor that will
allow me to cleanup enough and be able to do a text to columns (like
Excel) to import into Access?


http://www.notetab.com/

Darryl Kerkeslager
Nov 13 '05 #3

Can anyone suggest a good free text editor that will
allow me to cleanup enough and be able to do a text to columns (like
Excel) to import into Access?


http://www.textpad.com/

Nov 13 '05 #4
Import the data into a temporary database and use the power of queries to
clean up the data. When cleaned up, import the data into your working
database and delete the temporary database.

--
PC Datasheet
Your Resource For Help With Access, Excel And Word Applications
re******@pcdatasheet.com
www.pcdatasheet.com
"mpdsal" <m.*******@snet.net> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
Hello. I have some very large text files that I need to import into
Access. These files are basically SAP system reports that can be up to
100,000 records but they contain a boatload of data I don't care about.
My thinking was to clean up as much as I can and edit the files into
columns, much like Excel would do, except I am exceeding the 60,000
record limit. Can anyone suggest a good free text editor that will
allow me to cleanup enough and be able to do a text to columns (like
Excel) to import into Access? Perhaps another method? I truly
appreciate.

Mark

Nov 13 '05 #5
I did download that. Is there a way to use the column separators or
breaks like you can in Excel? I am out there now trying to align the
data into columns. Thanks

Mark

Nov 13 '05 #6
"mpdsal" <m.*******@snet.net> wrote
I did download that. Is there a way to use the column separators or
breaks like you can in Excel? I am out there now trying to align the
data into columns. Thanks

Perhpas it's me, but threads seem to be not following in order nowadays.
You might want to quote, at least enough to tell for sure who you are
replying to.

If you are referring to NoteTab (again, I couln't tell), you can search for
and insert Tabs (^T), paragraphs /line breaks (^P), and other special
characters as needed.

Darryl Kerkeslager
Nov 13 '05 #7
Or just use an import spec, don't import the junk you don't want, and
then you're finished. I was thinking of using the power of queries
when I move...

INSERT INTO NewPlace
SELECT
FROM OldPlace
WHERE (((Stuff.WorthKeeping)=True));

(gotta be careful with the delete part... might inadvertently destroy
stuff I wanted!)

Nov 13 '05 #8

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
by: Pai | last post by:
Hello there, I have and small excel file, which when I try to import into SQl Server will give an error "Data for source column 4 is too large for the specified buffer size" I have four...
1
by: D Mat | last post by:
Hi, I'm trying to get MS Access 2000 to automatically import a series of (~200) flat text, tab delimited, data files into a single Access table, with consistent fields and rows. The files have...
0
by: Christoph Haas | last post by:
Hi, list... I have written an application in Perl some time ago (I was young and needed the money) that parses multiple large text files containing nested data structures and allows the user to...
2
by: veaux | last post by:
Peeked around here but didn't really see an explanation as to the varied "Invalid Argument" errors that appear in Access sometimes. I'm using Access 2003 and trying to import an Access table of...
1
by: gollumullog | last post by:
Good Day, I have been having this issue for quite a long time, and have yet to find an easy/elegant solution. I am trying to create tables in an Access database. I have these tables as CSV...
4
by: johnporter123 | last post by:
Does anyone have a method of importing a large "FLAT" CSV file into access. The file has well over 255 columns (Fields). Before anyone flames me over normalization, I do not have access to the...
16
by: Wayne | last post by:
I've read that one method of repairing a misbehaving database is to save all database objects as text and then rebuild them from the text files. I've used the following code posted by Lyle...
25
by: tekctrl | last post by:
Anyone: I have a simple MSAccess DB which was created from an old ASCII flatfile. It works fine except for something that just started happening. I'll enter info in a record, save the record,...
1
by: aconti74 | last post by:
Hello I am new to vba programming/coding. I am writing a program that goes through a directory of text files and imports them into the database. The problem is eventually the database gets to big...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.