Dear SAS-L-ers,

Bruce B. Allen posted the following interesting problem:

> Hello SAS experts, > > I am having an issue with a data set and was hoping someone > may be able to help. I've searched everywhere but can't seem > to find the answer. Here goes the problem. > > I receiving this error when trying to merge a dataset: > > ERROR: An internal error has occurred while reading a > compressed file. Please call your SAS > Site Representative and report the following: compress > offset = 4406 , de-compress > offset = 4409 , compress buf = "" . > > > ERROR: Record in file P.RELS_APPR2.DATA is too long for buffer. > > Of course, calling my SAS Site Representative only prolonged > the issue I am having. I am using SAS 9.1. > > I've tried using option bufsize =27648 but that doesn't fix it either. > > I am merging a file that I loaded with a current table like this. > > rsubmit; > filename rels_2 pipe "unzip -pa > /users/apps/ssg1/data_archive/rels_appr2_&prev_day._nocr.zip" > lrecl=32767; > data load.rels_appr2; > infile rels_2 dlm='~' dsd flowover; > input > bunch of fields > run; > endrsubmit; > > Then I merge this with the current table: > > rsubmit; > data p.rels_appr2; > merge p.rels_appr2 > load.rels_appr2; > by res_order_no; > run; > endrsubmit; > > During this step I run into the error. > > Any thoughts? > > Thanks in advance for taking the time to look at my > problems...I suppose it's an easy life if this is the worst > of them though. > Bruce, I definitely agree with your last statement; life is good when these are the only things that one has to worry about!

My thought is to try to simplify things a bit and see if we can overcome this issue. Here is what I would do:

Make sure that both of your SAS data sets are not compressed SAS data sets before merging them together. That is; make sure that p.rels_appr2 and load.rels_appr2 are not compressed. You can do this by using the COMPRESS=NO option in your first RSUBMIT to take care of load.rels_appr2. You will have to re-create p.rels_appr2 with COMPRESS=NO in effect to get it in an un-compressed format... if it is currently compressed.

So, make sure both SAS data sets are uncompressed and then merge them together. If that works A-OK, then you can worry about what the issue is with compression and merging later.

Now, this is a workaround to get you out of the pickle that you are in. You shouldn't _HAVE_ to do these things, but... time and circumstance may dictate that you do. So, let's shoot first and ask questions later.

I hope that this suggestion proves helpful now, and in the future!

Of course, all of these opinions and insights are my own, and do not reflect those of my organization or my associates. All SAS code and/or methodologies specified in this posting are for illustrative purposes only and no warranty is stated or implied as to their accuracy or applicability. People deciding to use information in this posting do so at their own risk.

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Michael A. Raithel "The man who wrote the book on performance" E-mail: MichaelRaithel@westat.com

Author: Tuning SAS Applications in the MVS Environment

Author: Tuning SAS Applications in the OS/390 and z/OS Environments, Second Edition

http://www.sas.com/apps/pubscat/bookdetails.jsp?catid=1&pc=58172

Author: The Complete Guide to SAS Indexes

http://www.sas.com/apps/pubscat/bookdetails.jsp?catid=1&pc=60409

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No snappy quote; just a heartfelt Happy Thanksgiving holiday to one and all. - Michael A. Raithel +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++