Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Single target result of J48 different to Weka #50

Open
vutle opened this issue May 20, 2018 · 1 comment
Open

Single target result of J48 different to Weka #50

vutle opened this issue May 20, 2018 · 1 comment

Comments

@vutle
Copy link

vutle commented May 20, 2018

Hi I'm testing a single target using BCC with J48.
The result seems to be different compared to Weka.
E.g. Accuracy is 0.525 in Meka while 0.5 in Weka for cross validation.

Is the method implement different between the two? Shouldn't I get the same answer if it is a single target?

Thanks
Meka
N(test) 40
L 1
Hamming score 0.525
Exact match 0.525
Hamming loss 0.475
ZeroOne loss 0.475
Levenshtein distance 0.475
Label indices [ 0 ]
Accuracy (per label) [ 0.525 ]


Weka
Correctly Classified Instances 20 50 %
Incorrectly Classified Instances 20 50 %
Kappa statistic 0.2599
Mean absolute error 0.2036
Root mean squared error 0.4321
Relative absolute error 73.8882 %
Root relative squared error 117.4604 %
Coverage of cases (0.95 level) 55 %
Mean rel. region size (0.95 level) 31 %
Total Number of Instances 40

@vutle vutle changed the title Single target of J48 Single target result of J48 different to Weka May 20, 2018
@jmread
Copy link
Contributor

jmread commented May 21, 2018

Meka has different default parameters. For example, by default the dataset is randomized in Meka prior to cross validation, therefore the train/test sets may vary. Maybe that is the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants