473,671 Members | 2,290 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Archiving blobs

Hello -

Quick question - does anyone know of a good way to archive a blob?

Some background - Our application (Java Web Application) uses a DB2
table with a blob column of length 75000 to store some data. The data
in this table needs to be in the system for approximately 60 days and
then we want to archive the data "somewhere else" for legal purposes.
We have put together a archive process using some Cobol programs on the
mainframe to retrieve the data from the tables and write them out to
files that will then be shipped off to tape.

However, we have run into a slight problem with the blob table.
Through our Cobol program, the largest variable can be essentially 32K
in length. As such, our 75000 byte field doesn't fit into a variable.
We could put together some code to read the data out in multiple parts,
and then some how get it into files but the process of getting the data
back in (if necessary for legal review) is complicated.

I'm looking for ideas, or ideas for a solution to pulling this data out
in such a way that it would be easy to shove it back in again if
necessary. Any ideas are welcome - our environment consists of Java,
Cobol Programs, DB2 Stored procedures, and UNIX shell scripts on
Solaris and AIX.

If anyone has any ideas or has done this before - I would appreciate
some feedback.

Thanks in advance for your help!

Kevin

Nov 12 '05 #1
1 2574
Typically, blobs are internally structured to match the data - if so, just
map the structure to a COBOL structure.
Otherwise use an OCCURS DEPENDING ON byte array in Cobol to overcome the 32K
string length limit, and read into that array. (Isn't this how your COBOL's
SQL precompiler handles BLOB declarations anyway?)

We did the job using EXPORT utility to offload, TSM to archive, then DELETE
to remove the data after verifying that offloaded data has been dual copied.
ALl of this is driven by a pair of perl scripts.

"Kevin" <kd**@dcx.com > wrote in message
news:11******** **************@ c13g2000cwb.goo glegroups.com.. .
Hello -

Quick question - does anyone know of a good way to archive a blob?

Some background - Our application (Java Web Application) uses a DB2
table with a blob column of length 75000 to store some data. The data
in this table needs to be in the system for approximately 60 days and
then we want to archive the data "somewhere else" for legal purposes.
We have put together a archive process using some Cobol programs on the
mainframe to retrieve the data from the tables and write them out to
files that will then be shipped off to tape.

However, we have run into a slight problem with the blob table.
Through our Cobol program, the largest variable can be essentially 32K
in length. As such, our 75000 byte field doesn't fit into a variable.
We could put together some code to read the data out in multiple parts,
and then some how get it into files but the process of getting the data
back in (if necessary for legal review) is complicated.

I'm looking for ideas, or ideas for a solution to pulling this data out
in such a way that it would be easy to shove it back in again if
necessary. Any ideas are welcome - our environment consists of Java,
Cobol Programs, DB2 Stored procedures, and UNIX shell scripts on
Solaris and AIX.

If anyone has any ideas or has done this before - I would appreciate
some feedback.

Thanks in advance for your help!

Kevin

Nov 12 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
2882
by: Ole Hansen | last post by:
Hi, Is it at all possible to insert BLOBs using the Array Interface? Today I have an application using the array interface. It works fine but so far I haven't been using BLOBs. I insert 100-200 rows in one server round trip. Now I want to have one or more colums of type BLOB but I cant see how this can fit into my current application.
7
6928
by: Howard Lowndes | last post by:
My situation is that I am interacting PHP 4.1.2 to PostgreSQL 7.2.2 I have no difficulty inserting and managing BLOBs into the Large Object system table, and I have a user table called images which maintains the relationship between the BLOB loid and the identity that relates to it in my user tables. So far so good. When I RTFM obout psql it refers to the \lo_import, \lo_list, \lo_export and \lo_unlink functions.
7
4033
by: Nilabhra Banerjee | last post by:
Hi, I am still not sure whether the BLOBS are actually stored in the database or they have the pointer to the database for that file in the filesystem. If I remove the files (sources) for BLOBS from the directories with the BLOB still hold the data ? Also one more very intriguing part is that if BLOBS are not deleted if we delete them from tables how to
5
3407
by: SunSmile | last post by:
Hi, I am logging my exceptions to a word document(*.doc). After the size of word document is 5KB. I am archiving the word document to *.doc.1 Here when I am archiving the word document to *.doc.1, the new line characters("\r\n") are lost and the *.doc.1 document is instead displaying a null square space. I am using Log4Net to log the exceptions.
2
2807
by: Jerry LeVan | last post by:
Hi, I am just getting into large objects and bytea "stuff". I created a small db called pictures and loaded some large objects and then tried to do a restore. Here is how I got the dump. pg_dump -Fc -b pictures > /Users/jerry/desktop/db.comp
4
2511
by: Paul H | last post by:
Could some one give me some pointers on basic archiving techniques? I have developed several databases but never been faced with this issue. Here is the basic scenario.. Suppose I have the following two tables tblCustomers and tblOrders. I want to archive all orders over two years old. Is this how it is done?:
2
1680
by: Knokmans | last post by:
Hi, first, this concerns db2 v8 and v9 on AIX and Linux/intel Until now we used a "user exit" when we want to archive logfiles. We changed the user exit executable a bit so we receive an email when the archive fails for some reason. In the last releases of DB2 they improved the functionallity of log archiving.
3
4882
bvdet
by: bvdet | last post by:
Following is an example that may provide a solution to you: """ Function makeArchive is a wrapper for the Python class zipfile.ZipFile 'fileList' is a list of file names - full path each name 'archive' is the file name for the archive with a full path """ import zipfile, os def makeArchive(fileList, archive):
6
1684
by: Salad | last post by:
I'm going to implement an archival database for my app. I have Table1 and Table2. Table2 is a duplicate structure of Table1. I appended records with "ID between 1 and 100", then "ID between 300 and 400" then "ID between 225 and 250". It appears they keep the same ID. Is there anything I need to be concerned about when adding records from one table to another table with an identical structure when using autonumbers?
0
8473
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
8390
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
8911
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
8819
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
8597
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
8667
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
6222
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
4222
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
1
2808
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.