{"id":3864,"date":"2018-07-19T17:26:43","date_gmt":"2018-07-19T17:26:43","guid":{"rendered":"https:\/\/max-drake.cc\/?p=3864"},"modified":"2018-07-22T14:50:25","modified_gmt":"2018-07-22T14:50:25","slug":"weka-2-weka-machine-learning-alternative-interfaces-experimenter-knowledgeflow-command-line","status":"publish","type":"post","link":"https:\/\/max-drake.cc\/?p=3864","title":{"rendered":"Weka 2. Weka Machine Learning “Explorer” alternative interfaces “Experimenter”, “Knowledge Flow” & “Command Line”."},"content":{"rendered":"

Following on from the first Weka post, which was based on information gleaned from the Data Mining with Weka<\/strong><\/a> course that I followed.<\/p>\n

This post is based on the following More Data Mining with Weka<\/strong><\/a> videos.<\/p>\n

Some of  the screenshots below from the video’s that have been developed and are presented by Ian Witten of Machine Learning Group  University of Waikato<\/a> in NZ. I have not got his permission to use them but cite him as the source of this information.<\/p>\n

Earlier lesson takeaways<\/h3>\n

Training Set & Test Set should be independent. Otherwise you cannot realistically test your classifier to see if it works if you are only using the training data set.<\/p>\n

\"\"<\/p>\n

Statistical Mean, variance & standard deviation formulae.<\/p>\n

\"\"<\/p>\n

The 10-fold cross-validation method breaking the data set into 10 equal pieces and using 9 pieces to train and the 10th to test, then redoing the process with the test added into the training set and a different piece as the test set. A longer iterative process but you can cross- validate the information. There are subtleties about how you break the data set up into equal sized sets based on a consistency of data in each set ( so one set not all no’s and another not all yes’s etc, try for a balance).<\/p>\n

\"\"<\/p>\n

Experimenter<\/h2>\n

Mostly based on More Data Mining with Weka (1.3: Comparing classifiers)<\/a>.<\/p>\n

The experimenter allows you to run multiple machine learning algorithms (or variations of that algorithm) over multiple data sets. It has 3 tabs, the setup tap, the run tab and the analyse tab. You can save setup configurations to a file and you can save results to a file (eg a .arff or .csv file).<\/p>\n

Select a NEW Experiment configuration (item 4 below).<\/p>\n

In the setup tab<\/strong> you can choose data files to include, and you can choose multiple data sets.(left hand bottom tab).<\/p>\n

You can choose , in right hand bottom tab the Algorithms that you want to test, and also in what order you want to run them.<\/p>\n

You can choose Experiment type and number of iterations too.<\/p>\n

 <\/p>\n

\"\"<\/p>\n

Once you have your setup as you wish, you then go to the run tab<\/strong> and hit start and it will run the configurations you have in setup. Then go to the Analyse tab.<\/p>\n

\"\"<\/p>\n

In the Analyse Tab<\/strong> hit the EXPERIMENT button (top right) then the PERFORM TEST button to get the results. oin the Test Output panel (bottom right).<\/p>\n

In this setup the results are compared with the trees.J48 algorithm, as it was the first. In the left hand panel we are putting a significance of 0.05 (5%). This is then comparing the other 2 methods we have selected against the trees.J48 algorithm to see which performs better and shows whether it is within the significance % we have chosen, if not it shows an “*” to say that it has performed worse. So, if you look at the table below, for the Iris dataset, the rules.ZeroR has only a 33.33% accuracy of prediction compared to the trees.J48 algorithm which has a 94.73% accuracy on the training set. So it is significantly worse , hwence the “*”. Whereas the rules.OneR is 92.53% accurate, so falls within the selected 5% significance (so may perform better on a different training set than the trees.J48 algorithm).<\/p>\n

\"\"<\/p>\n

In the example above, the results  are comparing the rules.ZeroR and rules.OneR against the trees.J48 algorithm. If we want to compare against the rules.OneR we can change the setup as below.<\/p>\n

\"\"<\/p>\n

\"\"<\/p>\n

Also if we wanted to change the row\/column output to have the rows as the different algorithms and the columns as the datasets then we can change the configuration by changing the rows from “Dataset” to “Scheme” and the Cols from    “Scheme” to “Dataset”.\"\"<\/h2>\n

Knowledge Flow Interface<\/h2>\n

This is similar to the Knime Node process. You set up a workflow then plug in a dataset and run it and visualise the results.<\/p>\n

\"\"<\/p>\n

Select a node from the list and click in the blank area to paste it there.<\/p>\n

\"\"<\/p>\n

Right click on the node and choose configure to set up the node.<\/p>\n

\"\"<\/p>\n

Add another node and configure it.<\/p>\n

\"\"<\/p>\n

Right click on first node and connect it to the 2nd by selecting dataset (in this example , but instance in the last slide).<\/p>\n

\"\"<\/p>\n

Connect nodes together<\/p>\n

\"\"<\/p>\n

Create a workflow by connecting nodes together for 1\/Dataset, 2\/ Actions\/Processes, 3\/ output (Text visualiser\/Graphics). Then hit the RUN icon and right click the Visualisers to show results in pop-up boxes.<\/p>\n

\"\"<\/p>\n

Once you have the graphical display, you can choose to show it by changing X and Y axis attributes.<\/p>\n

\"\"<\/p>\n

The workflow below is based on INSTANCE instead of dataset. This allows data to flow in so could end with an infinite dataset as the data is not stored in memory . (A comment on output. I couldn’t change the graph size , maybe I needed to save the results and in the saved file modify the size).<\/p>\n

\"\"<\/p>\n

Command Line Interface (CLI)<\/h2>\n

I would prefer using the other options so would not use it unless I had to, so I will not go into it. Refer to the video if you are interested. This video<\/strong><\/a> discusses CLI and also linking to a Database.<\/p>\n

 \"\"<\/h3>\n

Weka algorithms for Implementation. A comment on the tool<\/h2>\n

Whilst going through the Data Mining with Weka<\/em> and More Data Mining with Weka<\/em>  videos that demonstrate the use of Weka in using Algorithms on datasets to predict outcomes. After setting up and pressing the buttons, something happens and a % prediction is given.<\/p>\n

For some of the algorithms I cannot see what formula\/algorithm is constructed that you can then use to build a predictor in say python or some other programming tool such as Knime.<\/p>\n

For Simple Linear Regression<\/a> you can get the start point and slope of line to predict the y variable. So you can plug the formula in for numeric data to get the results.<\/p>\n

In the More Data Mining with Weka<\/strong><\/a> videos class 3 relating to Classification Rules, Association Rules and clustering the 2nd video<\/a> talks about the rules.Part &  rules.JRip method of making a Decision Rules. This is the first time I have seen something for nominal data, I believe I could implement,  after testing on a Training Set & a Test Set. The demonstration in the lesson had a 74% probability of predicting the class correctly working with 8 attributes to predict the class.<\/p>\n

So whilst Weka seems to be a good analysis\/testing tool I cannot see a practical way of turning its results into a workflow for implementing easily. I think I would try and reproduce using the algorithms in Knime to build something practical. There is the Knowledge Flow process but I prefer Knime as it is easier to build. So test in Weka, build in Knime would be my thoughts on implementing some Machine Learning Algorithms.<\/p>\n

End Comment<\/h3>\n

I am quite impressed with the variety of interfaces that Weka has. I like the fact that you can use simple Explorer for starting to explore your data and to add different filters and tests to your data, then move on to the Experimenter to do multiple tests and runs and then also to build workflow nodes (like Knime) to set up some processes and also for streaming data. The Command Line Interface is always a backstop if you have issues with an interface and just need the grunt rather than the visuals.\/ I personally like the visuals. I really like the flexibility of the interface.<\/p>\n","protected":false},"excerpt":{"rendered":"

Following on from the first Weka post, which was based on information gleaned from the Data Mining with Weka course that I followed. This post is based on the following More Data Mining with Weka videos. Some of  the screenshots below from the video’s that have been developed and are presented by Ian Witten of […]<\/p>\n","protected":false},"author":1,"featured_media":3884,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[40,33,12],"tags":[],"class_list":["post-3864","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-analysis","category-knime-orange-rapidminer","category-visualisation"],"featured_image_src":"https:\/\/max-drake.cc\/wp-content\/uploads\/2018\/07\/im37.jpg","featured_image_src_square":"https:\/\/max-drake.cc\/wp-content\/uploads\/2018\/07\/im37.jpg","author_info":{"display_name":"Max Drake","author_link":"https:\/\/max-drake.cc\/?author=1"},"_links":{"self":[{"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/posts\/3864","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/max-drake.cc\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3864"}],"version-history":[{"count":0,"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/posts\/3864\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/max-drake.cc\/index.php?rest_route=\/wp\/v2\/media\/3884"}],"wp:attachment":[{"href":"https:\/\/max-drake.cc\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3864"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/max-drake.cc\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3864"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/max-drake.cc\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3864"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}