BenchMarking is a non-trivial pursuit:

Bench Marking Results Comparing v9-1 and v9-2

Tiny url: http://tinyurl.com/56nrr8

http://www.sascommunity.org/wiki/Bench_Marking_Results_Comparing_v9-1_and_v9-2

Ron Fehd the bench ... maven

-----Original Message----- From: owner-sas-l@listserv.uga.edu [mailto:owner-sas-l@listserv.uga.edu] On Behalf Of bbser 2009 Sent: Saturday, February 05, 2011 6:17 PM To: SAS-L@listserv.uga.edu Subject: checking efficiency by running codes, reliable?

We usually compare efficiency of different codes by direct running them. Do you think such a method is reliable? I doubt it based on this fact: I ran the same code three times and got three very distinct sets of cpu and real times. What happened? Thanks.

Max

==================

2873 proc sql; 2874 select 2875 destination, 2876 average, 2877 max, 2878 late/(late+early) as Prob 2879 from( select 2880 destination, 2881 avg(delay) as average, 2882 max(delay) as max, 2883 sum(delay>0) as late, 2884 sum(delay<=0) as early 2885 from sasuser.flightdelays 2886 group by destination) 2887 order by average 2888 ; NOTE: Writing HTML Body file: sashtml147.htm 2889 quit; NOTE: PROCEDURE SQL used (Total process time): real time 0.13 seconds cpu time 0.05 seconds

2901 proc sql; 2902 select 2903 destination, 2904 average, 2905 max, 2906 late/(late+early) as Prob 2907 from( select 2908 destination, 2909 avg(delay) as average, 2910 max(delay) as max, 2911 sum(delay>0) as late, 2912 sum(delay<=0) as early 2913 from sasuser.flightdelays 2914 group by destination) 2915 order by average 2916 ; NOTE: Writing HTML Body file: sashtml149.htm 2917 quit; NOTE: PROCEDURE SQL used (Total process time): real time 0.03 seconds cpu time 0.01 seconds

2918 proc sql; 2919 select 2920 destination, 2921 average, 2922 max, 2923 late/(late+early) as Prob 2924 from( select 2925 destination, 2926 avg(delay) as average, 2927 max(delay) as max, 2928 sum(delay>0) as late, 2929 sum(delay<=0) as early 2930 from sasuser.flightdelays 2931 group by destination) 2932 order by average 2933 ; NOTE: Writing HTML Body file: sashtml150.htm 2934 quit; NOTE: PROCEDURE SQL used (Total process time): real time 0.04 seconds cpu time 0.00 seconds