How to: re-execute experiment(s) from existing reports?

IndustryTermModelIndustry Term Model is working title for the Web Classification algorithm, and it refers to particular namespace within imbWBI (documentation). The namespace contains few classes that are just connecting different parts of imbWBI.Core (documentation), imbNLP.PartOfSpeech (documentation) and imbWEM.Core (documentation) libraries, together to perform classification of business entities, actually their web sites, using natural language processing, ontology construction and at the finale:... plugin (itmPlugin) supports execution of experimentSetup.xml files that are, by default included in every experiment report folder.

The first step in the console, is to open relevant IndustryTermModelIndustry Term Model is working title for the Web Classification algorithm, and it refers to particular namespace within imbWBI (documentation). The namespace contains few classes that are just connecting different parts of imbWBI.Core (documentation), imbNLP.PartOfSpeech (documentation) and imbWEM.Core (documentation) libraries, together to perform classification of business entities, actually their web sites, using natural language processing, ontology construction and at the finale:... project:

itm.Open "itm01";

If you are reproducing our experiments, make sure you specified correct project name: wcr , instead of itm01

To download our experimental results, check the Mendeley Data repository: http://dx.doi.org/10.17632/mg98ypgc8s.1

Then use command ImportExperiment to find all experimentSetup.xml files in directory with report folders.
Code below will execute all experiments from all reports stored at [imbWBIWeb Business Intelligence libraries of imbVeles Framework. Console path]\reports directory.

itm.ImportExperiment path="reports";execute=true;

ImportExperiment can be used just to check how many experiments you have in a folder with reports, then set: execute=false; 

You may specify rooted path as well.

itm.ImportExperiment path="D:\downloadedReports\";execute=false;silent=false;suffix="_redone";

Argument silent=true; can be set if you are calling the ImportExperiment from a script. It will give default answers to any questions that imbWBIWeb Business Intelligence libraries of imbVeles Framework. Console Tool might ask.

imbWBIWeb Business Intelligence libraries of imbVeles Framework. asks user to confirm multiple experiments execution, since: silent=false;

After you confirm, the experiments will be executed with all reporting options turned on.

Regarding the experiment execution times… depends on number of [k] folds that were configured for k-fold cross validation and of course on project and experiment parameters. In case of our Web Classification research: k=5 experiment (for 5 different StxSemantic Term Expansion, number of steps that a lemma (term) will be expanded using Semantic Cloud, part of Cosine SSRM computation model - semantic similarity computation, applied in Industry Term Model (imbWBI)... values, 17 classifier models) usually took about 30 min, k=10 about 50 min.


itm.Open "itm01";

itm.ImportExperiment path="reports\STAGE05\";execute=true;silent=false;suffix="_redone";

itm.Summary;

itm.Save;

You can call itm.Summary, to generate secondary reports, after the experiments are finished.

 

Attachments


  • Experimentation Console Tool for Web Business Intelligence - Windows Installer Package
    File size: 101 MB Downloads: 23
  • MCRepo - used in the research
    Mining Context Repository with Web Content used during research on Customer Web Classification System
    File size: 58 MB Downloads: 27
  • imbWBI Console Reference
    imbWBIWeb Business Intelligence libraries of imbVeles Framework. Console Tool autogenerated help document
    File size: 147 KB Downloads: 46
  • Web Classification Research project clone
    Archive contains imbWBIWeb Business Intelligence libraries of imbVeles Framework..IndustryTermModel project, with configuration used for the research.
    File size: 23 KB Downloads: 22
Spread the love