C4.5 Tutorial

References:

• P. Winston, 1992.

• Avoiding overfitting the data
• Determining how deeply to grow a decision tree.
• Reduced error pruning.
• Rule post-pruning.
• Handling continuous attributes.
• e.g., temperature
• Choosing an appropriate attribute selection measure.
• Handling training data with missing attribute values.
• Handling attributes with differing costs.
• Improving computational efficiency.

C4.5 Release 8 Installation Instructions for UNIX

1. Download the C4.5 source code.
2. Decompress the archive:
1. Type "tar xvzf c4.5r8.tar" (not universally supported), or, alternatively,
2. Type "gunzip c4.5r8.tar.gz" to decompress the gzip archive, and then

Type "tar xvf c4.5r8.tar" to decompress the tar archive.
3. Change to ./R8/Src
4. Type "make all" to compile the executables.
5. Put the executables into a "bin" subdirectory and include it in the path for command-line usage.

• c4.5: using the c4.5 decision tree generator.
• verbose c4.5: interpreting output generated by c4.5.

• c4.5rules: using the c4.5 rule generator.
• verbose c4.5rules: interpreting output generated by c4.5rules.

• consult: uses a decision tree to classify items.
• consultr: uses a rule set to classify items.

Click on the links below for examples of C4.5 usage:

• Example 1 - Golf
• A simple, detailed example of how C4.5 and C4.5rules work.
• Example 2 - Sunburn
• The sunburn example revisited.
• Example 3 - Homonyms
• Advanced usage of, and a practical application of, C4.5 and C4.5rules.