Monday, June 2, 2014

results Contrast set learner

55555 rounding
Before rounding:

 Techniques         -effort         -months        -defects          -risks    #
           T0 m              29              67              14               2    #
  T3 C25 N100 m               2              10               3               0    #
      T9:j/j_ m               0              35               0              21    #
-------------------------------------------------------------------------------------
           T0 q              26              16              20               6    #
  T3 C25 N100 q               3               0               5               1    #
      T9:j/j_ q               3              23               4              38    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              19    #
  T3 C25 N100 w              32              21              49               4    #
      T9:j/j_ w              32             100              56             100    #
-------------------------------------------------------------------------------------
            100         2687.38            41.4        17612.38             8.6    #
              0          117.21            1.93          381.83            0.05    #

After rounding:
Dataset rounded to integers:
 Techniques         -effort         -months        -defects          -risks    #
           T0 m              29              67              14               0    #
  T3 C25 N100 m               3              10              10               1    #
      T9:j/j_ m               0              35               0              22    #
-------------------------------------------------------------------------------------
           T0 q              28              17              24               2    #
  T3 C25 N100 q               3               0              13               2    #
      T9:j/j_ q               3              23               4              38    #
-------------------------------------------------------------------------------------
           T0 w             100              99             100              15    #
  T3 C25 N100 w              26              19              78               4    #
      T9:j/j_ w              32             100              59             100    #
-------------------------------------------------------------------------------------
            100          2695.0            41.4        16771.11             8.6    #
              0          117.21            1.85          381.83             0.0    # 
 
7777 Trees of all
 
http://unbox.org/things/var/nave/lpj/out/02_June_2014/dats/tree*
 
88888 Results for all models after rounding (makes sense):
 
flight:

     Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              12               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               4              46               1              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               0               0               2               1    #
    T9:j/jall q              10              29               6              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              31              21              47               7    #
    T9:j/jall w              32              97              35             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          172.58            1.92          892.87            0.04    #
 
ground:
 
Techniques         -effort         -months        -defects          -risks    #
           T0 m              15              55               8              10    #
  T3 C25 N100 m               2              12               6               0    #
 T9:j/jground m               4              42               0               9    #
-------------------------------------------------------------------------------------
           T0 q              12              13              13              24    #
  T3 C25 N100 q               0               0               6               0    #
 T9:j/jground q              15              47               2              15    #
-------------------------------------------------------------------------------------
           T0 w              68              84             100              54    #
  T3 C25 N100 w              26              21              44               4    #
 T9:j/jground w             100             100              98             100    #
-------------------------------------------------------------------------------------
            100          2819.5            43.9        27175.92             4.8    #
              0          155.25            1.55          806.33            0.12    # 
 
 
osp:
 
Techniques         -effort         -months        -defects          -risks    #
           T0 m              30              54              38              37    #
  T3 C25 N100 m               0               8               2               0    #
    T9:j/josp m               4              47               0              11    #
-------------------------------------------------------------------------------------
           T0 q               9               5              21              29    #
  T3 C25 N100 q               0               0               4               0    #
    T9:j/josp q               4              30              10              30    #
-------------------------------------------------------------------------------------
           T0 w              54              67             100              64    #
  T3 C25 N100 w              13              16              55              10    #
    T9:j/josp w             100             100              41             100    #
-------------------------------------------------------------------------------------
            100          3063.6            41.7        14504.17             7.5    #
              0           89.69            1.47          722.41            0.26    #
 
 
 
osp2:
 
      Techniques         -effort         -months        -defects          -risks    #
           T0 m              49              67              11               5    #
  T3 C25 N100 m               1              12               1               0    #
   T9:j/josp2 m               2              44               0               9    #
-------------------------------------------------------------------------------------
           T0 q               9               5               2               7    #
  T3 C25 N100 q               0               0               4               2    #
   T9:j/josp2 q              16              21              18              28    #
-------------------------------------------------------------------------------------
           T0 w              90              82              34              15    #
  T3 C25 N100 w              44              23              93              17    #
   T9:j/josp2 w             100             100             100             100    #
-------------------------------------------------------------------------------------
            100          1198.0            33.4          7610.0             5.1    #
              0          112.45            1.57           637.4            0.21    #
 
all:

Techniques         -effort         -months        -defects          -risks    #
           T0 m              20              54              11              21    #
  T3 C25 N100 m               0              12               5               0    #
    T9:j/jall m               2              42               0              14    #
-------------------------------------------------------------------------------------
           T0 q              20              18              19              35    #
  T3 C25 N100 q               0               0               7               2    #
    T9:j/jall q               8              26               4              40    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100             100    #
  T3 C25 N100 w              42              24              64              10    #
    T9:j/jall w              31              89              27              94    #
-------------------------------------------------------------------------------------
            100          2645.2           44.82        22300.72            5.08    #
              0          225.33            2.24         1028.96            0.12    #
 
99999 Cohen <=> Bootstrap
 
Bootstrap:
 
 Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              12               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               4              46               1              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               0               0               2               1    #
    T9:j/jall q              10              29               6              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              31              21              47               7    #
    T9:j/jall w              32              97              35             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          172.58            1.92          892.87            0.04    #
 
Cohen:
 
  Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              11               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               3              46               0              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               1               0               2               1    #
    T9:j/jall q               9              28               5              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              27              21              51               8    #
    T9:j/jall w              32              97              34             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          185.14            2.08          989.83            0.04    #
 
 
Runtimes:
 
Bootstrap:
real 1m51.292s
user 1m44.647s
sys 0m6.395s 
 
Cohen:
real 0m56.032s
user 0m52.087s
sys 0m3.737s
 

Summary

-555--Rounding dataset into integers makes more sense as it would be similar to the daataset we receive. Results indicate minor changes.

-777--Trees as indicated are very big. Working on axe to get it down.

-888--Results for other models are similar to flight. a little better.

-999--Swapping cohens to bootstrap gave little change to output. but runtime is reduced by half.

No comments:

Post a Comment