Google Mail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
comp.databases.oracle.server
+ new post
About this group
Subscribe to this group
This is a Usenet group - learn more
Export to compressed files?
Options
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
   4 messages - Expand all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Follow-up To:
Add Cc | Add Follow-up to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers that you hear
 
Tim Kearsley  
View profile   Translate to Translated (View Original)
 More options 11 Nov 2002, 15:11
Newsgroups: comp.databases.oracle.server
From: tim.kears...@milton-keynes.gov.uk (Tim Kearsley)
Date: 11 Nov 2002 07:11:29 -0800
Local: Mon 11 Nov 2002 15:11
Subject: Export to compressed files?
Forward | Print | Individual message | Show original | Report this message | Find messages by this author
Hi all,

Environment here is:

Oracle 8i (mostly 8.1.7)
AIX 4.3.3
RS6000 SP hardware

For a long time I've used the technique of exporting databases
directly to a compressed file by using a named pipe as the FILE
parameter in the export and running a compress command in the
background to read whatever comes into the pipe and write out a
compressed file.  This works very well.

The question is this:

Will a similar technique work for multiple files?  That is, if I want
to generate a number of compressed files from the export (in my case
to avoid hitting a 2 Gbyte file size limit in a non large file-enabled
AIX filesystem) can I specify several named pipes in the FILE
parameter for the export and fire off a number of background processes
to read from the pipes?  I'm not clear how the FILESIZE parameter for
the export would be used.  Would the export start writing to another
pipe once it had written FILESIZE bytes to the previous pipe?

I'll experiemnt in the meantime, but would be very interested to know
whether anyone has tried this and if they were successful.

Many thanks.

Tim Kearsley
Database Manager
Milton Keynes Council


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Tim Kearsley  
View profile   Translate to Translated (View Original)
 More options 12 Nov 2002, 08:33
Newsgroups: comp.databases.oracle.server
From: tim.kears...@milton-keynes.gov.uk (Tim Kearsley)
Date: 12 Nov 2002 00:33:49 -0800
Local: Tues 12 Nov 2002 08:33
Subject: Re: Export to compressed files?
Forward | Print | Individual message | Show original | Report this message | Find messages by this author

Well I *have* experimented and have a bit more information now.  It
seems you can use multiple named pipes in the FILE parameter for the
export and if you kick off a similar number of background processes to
read those pipes and compress what comes in to them then you get a set
of compressed export dumps.

For example, in the export parameter file:

FILE=/tmp/pipe1,/tmp/pipe2,/tmp/pipe3

Create the pipes with:

mknod /tmp/pipe1 p
mknod /tmp/pipe2 p
mknod /tmp/pipe3 p

And create background processes to compress what is read into the
pipe:

compress < /tmp/pipe1 > exp1.dmp.Z &
compress < /tmp/pipe2 > exp2.dmp.Z &
compress < /tmp/pipe3 > exp3.dmp.Z &

As I'm no Unix expert I wouldn't be at all surprised if there's a more
elegant way of doing this.  If so, I'd love to know!

Cheers.

Tim Kearsley
Database Manager
Milton Keynes Council


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
grjohnson  
View profile   Translate to Translated (View Original)
 More options 12 Nov 2002, 23:27
Newsgroups: comp.databases.oracle.server
From: Johnsog...@hotmail.com (grjohnson)
Date: 12 Nov 2002 15:27:55 -0800
Local: Tues 12 Nov 2002 23:27
Subject: Re: Export to compressed files?
Forward | Print | Individual message | Show original | Report this message | Find messages by this author
I use a named pipe to for export large amount of data into a
compressed file. It's compresses the data as it goes and doesn't leave
it till the end.

First I create the named pipe.

mknod gzip_pipe p

nohup gzip < gzip_pipe > export_data.dmp.Z &

exp parfile=param.par

Parfile INCLUDES...

file='gzip_pipe'

Indicating that the export will go to the pipe and then compress into
export_data.dmp.Z

Now to import the data do the following

nohup gunzip -c export_data.dmp.Z > gizip_pipe &

imp parfile=impparam.par

Parfile INCLUDES...

file='gzip_pipe'

Cheers,

Greg Johnson
Oracle Certified Professional
OCP 8i DBA / OCP 9i DBA
Brisbane, Queensland, Australia


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bass Chorng  
View profile   Translate to Translated (View Original)
 More options 14 Nov 2002, 21:25
Newsgroups: comp.databases.oracle.server
From: bcho...@yahoo.com (Bass Chorng)
Date: 14 Nov 2002 13:25:55 -0800
Local: Thurs 14 Nov 2002 21:25
Subject: Re: Export to compressed files?
Forward | Print | Individual message | Show original | Report this message | Find messages by this author
Ever thought about using split ? We have done it before,
  it goes something like this:

  exp userid=/ full=y file=NamePipe compress=y &
  cat NamePipe | compress -v > | split -b 1024M - ./full.dmp.Z

  This should generate several compressed files with 1 GB each.

  When you import you can do something like this:

  zcat full.dmp[a-z] > full.dmp.p &
  $ORACLE_HOME/bin/imp "USERID=SYSTEM/MANAGER BUFFER=256000 FULL=Y
FILE=full.dmp.p LOG=full.imp.log


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2010 Google