| Date: | Wed, 2 Jul 2008 18:34:29 +0200 |
| Reply-To: | Christian Deindl <deindl@soziologie.uzh.ch> |
| Sender: | "SPSSX(r) Discussion" <SPSSX-L@LISTSERV.UGA.EDU> |
| From: | Christian Deindl <deindl@soziologie.uzh.ch> |
| Subject: | Re: AW: data preparation |
| In-Reply-To: | <5CFEFDB5226CB54CBB4328B9563A12EE097B343C@hqemail2.spss.com> |
| Content-Type: | text/plain; charset=UTF-8; format=flowed |
thanks a lot for your answers,
I will try python for sure.
since my syntax is realy large I split it into smaller parts and use
"include" to put it all together.
If I run the same syntax as huge file without include, it gets about 2
to 3 times faster.
how is this possible?
christian
Peck, Jon schrieb:
> Production Mode will not speed anything up, however, if you don't need the user interface and can run your syntax through a programmability job, it might make a large difference. While I can't offer any guarantees, we have had reports from users of between 4x and 10x speed improvement when taking this approach.
>
> Converting a large syntax job to run as a program can be very simple.
>
> If you have a block of syntax - let's assume it is in a file called clean.sps in temp, you can run this as a Python program (assuming the plugin is installed), by just doing, from a Python shell (notice the forward slashes),
>
> import spss
> spss.Submit("INSERT FILE='c:/temp/clean.sps'")
>
> The one problem with this is that you would just get the output as text streaming back to the console. So you could get this as html output with oms by wrapping your syntax with something like
>
> oms /destination outfile='c:/temp/clean.htm' format = html.
> <your syntax file>
> omsend.
>
> You could put that syntax in the Submit call above or add the OMS commands to your INSERT file.
>
> You might also want to call
> spss.SetOutput("off")
> ahead of the Submit to suppress echoing of the text to the console.
>
> If you have SPSS 16, you can generate a true Viewer document (spv format) from OMS instead of the html.
>
> As always, there are lots of programmability references at SPSS Developer Central (www.spss.com/devcentral).
>
> HTH,
> Jon Peck
>
> -----Original Message-----
> From: SPSSX(r) Discussion [mailto:SPSSX-L@LISTSERV.UGA.EDU] On Behalf Of Spousta Jan
> Sent: Wednesday, July 02, 2008 7:22 AM
> To: SPSSX-L@LISTSERV.UGA.EDU
> Subject: Re: [SPSSX-L] AW: data preparation
>
> You should tell us more details about the data file and the syntax. There are cases which can be easily speedied up, and there are cases where the only solution is a better computer + more specific software.
>
> General advices:
> * try to split the file into smaller pieces, use only those you need for a given task and handle the pieces separately (both separate variables and separate groups of cases are possible, depending on the task)
> * use EXECUTE only in case of necessity
> * save the raw data in SPSS sav files if possible
> * run the time-consuming tasks overnight
> * try to understand why the syntax is so slow - what is the most time-consuming part of it?
>
> Jan
>
>
> -----Original Message-----
> From: SPSSX(r) Discussion [mailto:SPSSX-L@LISTSERV.UGA.EDU] On Behalf Of Christian Deindl
> Sent: Wednesday, July 02, 2008 3:06 PM
> To: SPSSX-L@LISTSERV.UGA.EDU
> Subject: Re: AW: data preparation
>
> the problem is I need a prepared dataset to continue.
>
> more or less what I'm doing at the moment is to redo the preparation and get rid of smaller mistakes, typos, etc.
>
> I'm doing all analysis in stata (GLLAMM), so I could run my models while SPSS is busy, it's just I don't have my dataset ready.
> and every mistake I detect can result in 5 hour waiting.
>
> christian
>
> la volta statistics schrieb:
>> Hi Christian
>>
>> Did you try making a production job using SPSS's Production Facility.
>> I am not sure if this procedure is faster, but it at least allows you
>> just continuing to work on.
>> Hope this helps
>> Christian
>>
>>
>>
>> -----Ursprüngliche Nachricht-----
>> Von: SPSSX(r) Discussion [mailto:SPSSX-L@LISTSERV.UGA.EDU]Im Auftrag
>> von Christian Deindl
>> Gesendet: Mittwoch, 2. Juli 2008 12:07
>> An: SPSSX-L@LISTSERV.UGA.EDU
>> Betreff: data preparation
>>
>>
>> I'm working currently with a huge dataset. in order to do any analysis
>> I need to make a lot of adjustments.
>> my complete syntax-file needs 5! hours to run.
>>
>> is there a way to speed it up?
>>
>> I'm currently using spss 15 and a dual-core pc
>>
>> =====================
>> To manage your subscription to SPSSX-L, send a message to
>> LISTSERV@LISTSERV.UGA.EDU (not to SPSSX-L), with no body text except
>> the command. To leave the list, send the command SIGNOFF SPSSX-L For a
>> list of commands to manage subscriptions, send the command INFO
>> REFCARD
>>
>>
>>
>
> =====================
> To manage your subscription to SPSSX-L, send a message to LISTSERV@LISTSERV.UGA.EDU (not to SPSSX-L), with no body text except the command. To leave the list, send the command SIGNOFF SPSSX-L For a list of commands to manage subscriptions, send the command INFO REFCARD
>
>
>
> _____________
> Tato zpráva a všechny připojené soubory jsou důvěrné a určené výlučně adresátovi(-ům). Jestliže nejste oprávněným adresátem, je zakázáno jakékoliv zveřejňování, zprostředkování nebo jiné použití těchto informací. Jestliže jste tento mail dostali neoprávněně, prosím, uvědomte odesilatele a smažte zprávu i přiložené soubory. Odesilatel nezodpovídá za jakékoliv chyby nebo opomenutí způsobené tímto přenosem.
>
> Jste si jisti, že opravdu potřebujete vytisknout tuto zprávu a/nebo její přílohy? Myslete na přírodu.
>
>
> This message and any attached files are confidential and intended solely for the addressee(s). Any publication, transmission or other use of the information by a person or entity other than the intended addressee is prohibited. If you receive this in error please contact the sender and delete the message as well as all attached documents. The sender does not accept liability for any errors or omissions as a result of the transmission.
>
> Are you sure that you really need a print version of this message and/or its attachments? Think about nature.
>
> -.- --
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> LISTSERV@LISTSERV.UGA.EDU (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> LISTSERV@LISTSERV.UGA.EDU (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
=====================
To manage your subscription to SPSSX-L, send a message to
LISTSERV@LISTSERV.UGA.EDU (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
|