Tuesday, March 15, 2011

Active Learning via kNN-Based Popularity

The initial results for the active learning are here.
Defect EK Matrix.


Tuesday, March 8, 2011

Some terminology

Something that caused me a lot of time to correct..
When speaking of ABE, instance selection and instance retrieval correspond to entirely different things. Instance selection = filtering, whereas retrieval = analogy selection. Corrected ESEM paper is here.

If only I had perfect experts!

Here is a short report about the results of active learning experiments in effort estimation.
For full plots, refer here.
The moral of the story is:
1) When using 1NN as estimation method, (more or less) half of the instances are not closest neighbor to any other instances.
2) When project instances are labeled by an expert based on their popularity, MdMRE values very easily drop below regular 1NN (with LOO).
3) ASSUMPTION/CHEAT is that the expert perfectly predicts the project effort, which is (probably) never the case.

Monday, March 7, 2011

Even More on Business Intelligence

New runtime chart can be found at this location:


Empirical (not fitted) Weibull CDF of the effort distribution w/ you are here in red:


Takes on the 3 shot cycle: