Exercise 4 (Decision boundaries)

What are decision boundaries? Find out, what kind of decision boundaries you can represent with the following classification methods. Notice that some classifiers can represent only restricted forms of nonlinear boundaries. Explain carefully or draw pictures, which explain your conclusions!

• Multiple linear regression (when used for 2-class classification)
• Decision trees
• Naive Bayes
• Bayesian networks
• Nearest neighbour classifiers
• Perceptrons
• Feed-forward neural networks
• Support vector machines