Tree-Based and Distance-Based Models - Machine Learning Quiz

1. What is the primary purpose of a decision tree in machine learning?

To cluster data points

To make data-driven decisions using a series of conditions

To reduce the dimensionality of the dataset

To calculate distance between data points

2. In a decision tree, what does a leaf node represent?

A feature used for splitting

The final prediction or class label

The midpoint of the dataset

The sum of the features

3. What is Gini Impurity used for in decision trees?

To measure the quality of a split

To calculate the depth of the tree

To identify the root node

To normalize the dataset

4. What does the parameter 'k' represent in K-Nearest Neighbors?

The number of features in the dataset

The number of nearest neighbors to consider

The distance metric used

The size of the training dataset

5. Which of the following distance metrics can be used in KNN?

Euclidean Distance

Manhattan Distance

Cosine Distance

All of the above

6. How does KNN classify a query point?

By using a decision tree

By calculating the average of its neighbors' values

By assigning the class with the most frequent neighbors

By reducing the dimensionality of the data

7. What is a common use case for decision trees in the banking industry?

Clustering customer data

Predicting loan approval based on credit score and income

Calculating distance metrics

Classifying handwritten digits

8. What happens if 'k' is set too low in KNN?

The model becomes too generalized

The model becomes too sensitive to noise

The model's performance remains unchanged

The model ignores outliers

9. Which factor significantly impacts the performance of a decision tree?

The number of nearest neighbors

The quality of the splits at each node

The choice of distance metric

The size of the query point

10. What does KNN rely on to make predictions for regression tasks?

The majority class of neighbors

The average value of its nearest neighbors

The root node of a decision tree

The depth of the tree

Quiz 6: Tree-Based and Distance-Based Models