021 Plugin: bec
Class imbWBIWeb Business Intelligence libraries of imbVeles Framework..IndustryTermModel.consolePlugin.becPlugin
imbWBIWeb Business Intelligence libraries of imbVeles Framework..ConsoleTool Console.becPlugin
This is imbACE advanced console plugin for becPlugin
1 bec.CompareDataSets
What is purpose of this?
What it will do?
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | datasetA | String | — | |
| 02 | datasetB | String | — | |
| 03 | runName | String | DataSets | — |
| 04 | debug | Boolean | True | –Values: True,False |
Example :
bec.CompareDataSets datasetA="";datasetB="";runName="DataSets";debug=True;
2 bec.CrawlScript
Creates script to perform (re)build MCRepository crawl
Creates script that prepares crawler, crawl job and performs the crawl
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | name | String | ODPBusinessDistantTopics | What component of the model to crawl |
| 02 | clearRepo | Boolean | False | If true it will clear existing MC RepoValues: True,False |
| 03 | debug | Boolean | True | If true it will show some extra information during the processValues: True,False |
| 04 | autorun | Boolean | True | If true it will autorun created script without asking userValues: True,False |
Example :
bec.CrawlScript name="ODPBusinessDistantTopics";clearRepo=False;debug=True;autorun=True;
3 bec.DataSetGraphs
Constructs web site graphs for pointed dataset
It will load dataset from the path and construct web site graphs
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | runName | String | word | report directory name |
| 02 | datasetPath | String | path containing dataset to load | |
| 03 | debug | Boolean | True | –Values: True,False |
Example :
bec.DataSetGraphs runName="word";datasetPath="";debug=True;
4 bec.DataSetReport
Provides detailed statistics on dataset, when current BECBusiness Entity Classification system, implementation of Industry Term Model (business category / industry description model) for Business Entities classification by processing web site content. Part of imbWBI.... configuration is applied
What it will do?
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | runName | String | word | Name of the report folder |
| 02 | datasetPath | String | Path to dataset – when other than currently loaded should be reported about | |
| 03 | reconstruct | Boolean | True | If true, it will perform recornstructive analysis of all urls in the datasetValues: True,False |
Example :
bec.DataSetReport runName="word";datasetPath="";reconstruct=True;
5 bec.ExperimentGroup
Sets active experiment group
Creates subfolder in report directory
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | name | String | BECBusiness Entity Classification system, implementation of Industry Term Model (business category / industry description model) for Business Entities classification by processing web site content. Part of imbWBI.... | Name for the group |
| 02 | description | String | Optional description for the group | |
| 03 | script | String | Script associated with this group |
Example :
bec.ExperimentGroup name="BEC";description="";script="";
6 bec.GroupDescription
Sets description for current experiment group
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | description | String | Description for the experiment group |
Example :
bec.GroupDescription description="";
7 bec.HarvestDomainList
Runs crawler to harvest domain list categories currently loaded
It will generate and run crawler script for each category
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | path | String | word | — |
| 02 | steps | Int32 | 5 | — |
| 03 | debug | Boolean | True | –Values: True,False |
Example :
bec.HarvestDomainList path="word";steps=5;debug=True;
8 bec.ImportDomains
Import currently selected sample lists into imbIndustryTermProject category
Takes categories from webDataset
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | word | String | word | — |
| 02 | steps | Int32 | 5 | — |
| 03 | debug | Boolean | True | –Values: True,False |
Example :
bec.ImportDomains word="word";steps=5;debug=True;
9 bec.Init
Initialize project
Loads the project or creates new
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | name | String | bec01 | project name |
Example :
bec.Init name="bec01";
10 bec.OverviewReport
Provides overview spreadsheet report with cross-fold average F1 metrics for all experiments ran since console boot
Generates an overview report for active experiment group
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | name | String | word | filename without extension for the overview report |
Example :
bec.OverviewReport name="word";
11 bec.RunGroupScript
Runs the script associated with experiment group
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | overview | Boolean | True | if overview report should be createdValues: True,False |
Example :
becBusiness Entity Classification system, implementation of Industry Term Model (business category / industry description model) for Business Entities classification by processing web site content. Part of imbWBI.....RunGroupScript overview=True;
12 bec.Save
Saves project
What it will do?
Example :
becBusiness Entity Classification system, implementation of Industry Term Model (business category / industry description model) for Business Entities classification by processing web site content. Part of imbWBI.....Save
13 bec.ToolkitTest
What is purpose of this?
What it will do?
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | runName | String | * | Name of the experiment log |
| 02 | runComment | String | BECBusiness Entity Classification system, implementation of Industry Term Model (business category / industry description model) for Business Entities classification by processing web site content. Part of imbWBI.... experiment run | Comment on the test run |
| 03 | silentDatasetLoad | Boolean | True | Prevents printout during dataset loadValues: True,False |
Example :
bec.ToolkitTest runName="*";runComment="BEC experiment run";silentDatasetLoad=True;
022 Plugin: mcm
Class imbMiningContext.imbMCManager
imbWBIWeb Business Intelligence libraries of imbVeles Framework..ConsoleTool Console.MC Manager Plugin
Manager plugin takes care about MC repositories, loads, creates and provides the instances.
1 mcm.Close
Saves and unselects the currently selected MC Repository
It will save all muttable variables of the repository and its content
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | log_msg | String | Log message to write into repository log just before unselecting it, and after saving it | |
| 02 | doReport | Boolean | True | if true, it will create report files for complete content of the currently selected repository: spreadsheets, folder content readmes etc.Values: True,False |
| 03 | debug | Boolean | False | If true, it will print out short report on content of the repository (if any)Values: True,False |
Example :
mcm.Close log_msg="";doReport=True;debug=False;
2 mcm.Open
Opens or creates new MCRepository, starts a MC session. Call this before any other MC operation.
It initiates specified MCRepository and sets it as current/selected.
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | repo | String | word | Name of repository to start working with |
| 02 | log_msg | String | A message to be written into repository log after it is initiated, e.g. adding new MCWebSites, or running Data Mining procedure XXXX | |
| 03 | debug | Boolean | False | If true, it will print out short report on content of the repository (if any)Values: True,False |
Example :
mcm.Open repo="word";log_msg="";debug=False;
023 Plugin: nlp
Class imbNLP.Project.Plugin.imbNLPProjectPlugin
imbWBIWeb Business Intelligence libraries of imbVeles Framework..ConsoleTool Console.imbNLPProjectPlugin
This is imbACE advanced console plugin for imbNLPProjectPlugin
1 nlp.HarvestODP
Harvests the Open Directory Projects
It will scan for subdirectories and extract outer links
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | start | String | https://dmoztools.net/Business/ | Starting URL |
| 02 | steps | Int32 | 3 | How deep the harvester is allowed to go |
Example :
nlp.HarvestODP start="https://dmoztools.net/Business/";steps=3;
2 nlp.LoadWebKB
Loads WebKB web site datasets
It will load WebKB 7Sectors dataset
Command arguments:
| ID | Name | Type | Default | Comment |
|---|---|---|---|---|
| 01 | path | String | G:_DOKTORAT_MAIN\SM03_Datasets\7sectors | Path to 7Secotrs dataset |
Example :
nlp.LoadWebKB path="G:\_DOKTORAT_MAIN\SM03_Datasets\7sectors";