WTC and SToP benchmarks, June 10, 2012

WTC1 benchmark

       
 

StoP with C2fsm-10june

WTC with C2fsm-10june

name

locA

locB

loop level

time

diagnostic

time

diagnostic

aaron12.c

19

19

1

1.36069

NOT_SURE

0.49

DK

aaron2.c

25

21

1

1.54317

OK

0.75

OK

aaron3.c

24

22

1

1.67832

NOT_SURE

0.65

DK

ax.c

20

18

2

3.40904

OK

0.81

OK

complex.c

23

23

2

2.48568

OK

0.92

OK

counterex1a.c

32

28

1

3.11542

TOO_MUCH_VARS

2.03

tooMUCH

counterex1b.c

18

18

2

5.08195

OK

0.84

OK

cousot9.c

18

18

1

1.40112

OK

0.6

OK

easy1.c

18

17

1

1.35515

OK

0.6

OK

easy2.c

13

11

1

1.08927

OK

0.42

OK

exmini.c

16

16

1

1.29496

OK

0.47

OK

loops.c

24

20

2

2.92049

OK

0.68

OK

merge1Fixed.c

36

22

2

3.16822

OK

0.75

OK

merge2Fixed.c

45

26

3

5.20299

NOT_SURE

1.39

DK

ndecr.c

11

11

1

1.01236

OK

0.33

OK

nd-loop.c

20

18

1

1.15921

NOT_SURE

0.43

OK

nestedLoop.c

24

22

3

11.4635

NOT_SURE

1.8

DK

perfect1.c

27

16

1

0.633627

OK

0.9

OK

perfect2.c

37

31

2

6.37451

NOT_SURE

-

BUG

perfect.c

33

28

2

5.1873

OK

0.83

OK

perfectg.c

42

34

0

0.940485

NOT_SURE

1.15

DK

pgcd.c

16

16

1

1.30879

NOT_SURE

0.54

DK

random1d.c

23

14

1

1.09568

OK

0.52

OK

random2d.c

41

14

1

1.14665

OK

2.12

OK

realgcd.c

23

23

1

1.38264

OK

2

OK

relation1.c

20

18

1

1.15744

NOT_SURE

0.45

OK

rsd2Fixed.c

24

23

1

1.52331

NOT_SURE

0.73

OK

rsd2WithR.c

34

24

1

1.64976

OK

0.71

OK

rsd_bugFixed.c

34

24

1

1.63478

OK

0.71

OK

sipma91.c

35

28

1

2.73793

OK

1.87

OK

terminate.c

15

15

1

1.32927

OK

0.48

OK

unperfect.c

33

27

2

6.38363

NOT_SURE

-

BUG

wcet0.c

33

14

1

1.15551

OK

1.27

OK

wcet1.c

33

14

1

1.15301

OK

1.2

OK

wcet2.c

14

14

2

2.27885

OK

0.58

OK

while2.c

17

15

1

1.13835

OK

0.45

OK

wise.c

19

17

1

1.38622

OK

0.62

OK

zerpentFixed.c

27

23

1

2.79085

TOO_MUCH_VARS

2

tooMUCH

        

AVERAGE

25.42

20.05

1.32

2.45

 

0.92

 
        

WTC2 benchmark

       
 

StoP with C2fsm-10june

WTC with C2fsm-10june

name

locA

locB

loop level

time

diagnostic

time

diagnostic

heapsort.c

64

51

1

4.90473

OK

3.21

OK

realheapsort.c

55

22

1

0.952263

OK

-

tooMUCH*

realbubble.c

40

17

1

0.617025

OK

1.41

OK

sipmabubble.c

25

18

2

2.82118

OK

0.86

OK

sipmamergesort.c

94

91

3

22*

OK

11

tooMUCH

terminatorbubble.c

50

37

2

8.28932

OK

1.81

OK

        

AVERAGE

54.67

39.33

1.67

3.52

 

3.66

 
        
        

Remarks: