Date:         Thu, 3 Feb 2011 12:20:16 -0800
Reply-To:     "Nordlund, Dan (DSHS/RDA)" <NordlDJ@DSHS.WA.GOV>
Sender:       "SAS(r) Discussion" <SAS-L@LISTSERV.UGA.EDU>
From:         "Nordlund, Dan (DSHS/RDA)" <NordlDJ@DSHS.WA.GOV>
Subject:      Re: Out of memory?
In-Reply-To:  <AANLkTimT7HZ2-VekZRnhB=0HSPAs6u302B3xg7=5nx1=@mail.gmail.com>
Content-Type: text/plain; charset=utf-8

Sterling,

Can you give us more detail about your date?  My first thought when I look at your code is: why is claim_id on the class statement?  How many claim_id values are there?  What are you trying to summarize, I mean what is the main task here?

Dan

Daniel J. Nordlund
Washington State Department of Social and Health Services
Planning, Performance, and Accountability
Research and Data Analysis Division
Olympia, WA 98504-5204


> -----Original Message-----
> From: SAS(r) Discussion [mailto:SAS-L@LISTSERV.UGA.EDU] On Behalf Of
> Sterling Paramore
> Sent: Thursday, February 03, 2011 11:55 AM
> To: SAS-L@LISTSERV.UGA.EDU
> Subject: Out of memory?
>
> Dear SAS-L,
>
> I assume the following is failing due to the system running out of
> memory
> (way to go SAS - not only do you not tell me what the problem is, this
> doesn't even register as a real ERROR, only a warning) because if I run
> it
> with an OBS= statement, it completes just fine.
>
> To solve the problem, I've tried first sorting the dataset (6 minutes),
> then
> doing proc means with a by (7 minutes).  I also tried using proc sql
> and it
> required only 5 minutes.
>
> Any other ideas?  I'd prefer not to have to rewrite a bunch of my proc
> means
> as sql.
>
> Thanks,
> Sterling
>
>
>
> 16
> 17         proc means noprint missing nway data =
> WORKERR._BMClaims_Concat;
> 18             var Claim_Counter ClaimLine_Counter ClaimLine_Paid_Amt
> ClaimLine_COB_Paid_Amt
> 19             Claim_Interest_Amt ClaimLine_Savings_Amt;
> 20             class Claim_Id Claim_Diag_Primary
> Claim_Prim_Hosp_Proc_Cd
> Claim_Bill_Type;
> 21             output out = WORK._BMClaims (drop = _TYPE_ _FREQ_)
> sum()=;
> 22         run;
>
> NOTE: The SAS System stopped processing this step because of errors.
> NOTE: There were 70619390 observations read from the data set
> WORKERR._BMCLAIMS_CONCAT.
> WARNING: The data set WORK._BMCLAIMS may be incomplete.  When this step
> was
> stopped there were 0 observations and 10 variables.
> NOTE: PROCEDURE MEANS used (Total process time):
>       real time           2:23.15
>       cpu time            3:08.01