Permalink
Commits on Mar 1, 2011
  1. RuleMiner now also uses the previously introduced Constraints class t…

    wimleers committed Mar 1, 2011
    …o apply rule consequent item constraints.
    
    FP-growth-based constrained association rule mining is now complete. Next up: FP-stream!
Commits on Feb 28, 2011
  1. Abstract the constraints functionality into a separate class, so it c…

    wimleers committed Feb 28, 2011
    …an be used by both FPGrowth and RuleMiner. In this initial commit, it's only being used by FPGrowth.
  2. Major refactoring of constraint-based frequent itemset generation and…

    wimleers committed Feb 28, 2011
    … association rule mining. This solves a logic bug that would always lead to rules with 100% confidence. Wildcard item constraints are now also supported.
    
    This commit adds support for four kinds of item constraints. It cleans up the item constraint support in the FP-growth implementation and makes it as efficient as possible. The RuleMiner constraint support has been corrected and been cleaned up, but still has room for cleanliness & performance improvements.
Commits on Feb 27, 2011
  1. The last three commits have caused empty items (empty strings, caused…

    wimleers committed Feb 27, 2011
    … by using QString::null) to be included in the generated transactions. Obviously this is pointless, so get rid of them.
Commits on Feb 26, 2011
  1. Don't include browsers twice in the transactions (once with the platf…

    wimleers committed Feb 26, 2011
    …orm, once without). This is unnecessarily detailed.
    
    Also only include an "ua:isMobile" item, not a "ua:isNotMobile" item as well.
  2. Don't include the city in the transactions. It's unnecessarily detail…

    wimleers committed Feb 26, 2011
    …ed. Only in extreme cases there will be enough traffic from one city to cause a city to show up in the results.
  3. Include only non-200 HTTP status codes in the transactions, since 200…

    wimleers committed Feb 26, 2011
    … is the default status code and does not reveal anything interesting.
  4. Added outline of general findings. This was written on February 9, 20…

    wimleers committed Feb 26, 2011
    …11 but was not yet committed.
Commits on Feb 22, 2011
  1. Fix typo.

    wimleers committed Feb 22, 2011
Commits on Feb 8, 2011
Commits on Feb 7, 2011
  1. Strongly refactored the FPGrowth class. Also optimized FPGrowth::opti…

    wimleers committed Feb 7, 2011
    …mizeTransaction. The entire current process is now about 10% faster.
Commits on Feb 5, 2011
Commits on Feb 4, 2011
  1. Clean up main.cpp.

    wimleers committed Feb 4, 2011
  2. - Added the ability to RuleMiner to accept required items for rule co…

    wimleers committed Feb 4, 2011
    …nsequents.
    
    - The above functionality severely limits the search space for rules, thereby greatly enhancing speed and very significantly reducing memory consumptions in the context of WPO Analytics, where we are only interested in rules that cause certain durations, i.e. we only want durations in the consequent. In this master thesis, we will even limit the scope to only deal with *slow* episodes.
    - Reduced minimum suport to 0.05.
  3. Fix comment indentation.

    wimleers committed Feb 4, 2011
  4. Initial integration between EpisodesParser and Analytics! Analytics/A…

    wimleers committed Feb 4, 2011
    …nalyst applies FPGrowth and RuleMiner to a set of transactions. Each chunk of the log file (4K lines right now) are expanded with relevant metadata and is then converted into a set of transactions. These transactions are then analyzed. At last, some demonstrable results! :)
Commits on Feb 3, 2011
  1. Applied the "Analytics" namespace to all code in the Analytics module…

    wimleers committed Feb 3, 2011
    … (FPNode, FPTree, FPGrowth, RuleMiner, typedefs and the unit tests).
  2. Minor code improvement.

    wimleers committed Feb 3, 2011
  3. Added ability to filter transactions to FPGrowth, to require *any* of…

    wimleers committed Feb 3, 2011
    … the given "filter items" to be present in a transaction.
Commits on Feb 2, 2011
  1. Added initial association rule miner implementation. RuleMiner comes …

    wimleers committed Feb 2, 2011
    …with full testing coverage.
  2. - Moved FPGrowth::calculateSupportCountsForFrequentItemsets() and FPG…

    wimleers committed Feb 2, 2011
    …rowth()::calculateSupportCountForFrequentItemset() to RuleMiner. Therefor also removed FPGrowth::calculatingPhase2().
    
    - Updated the test to no longer verify the results of FPGrowth::calculatingPhase2().
    - Updated the test verification now that Item's operator==() implementation only compares the item ID.