Distance Metric used in Machine Learning

Distance Metric used in Machine Learning- ¢ Distance measures play an important role in machine learning. ¢ A distance measure is an objective score that summarizes the relative difference between two objects in a problem domain. ¢ The most famous algorithm of this type is the k-nearest neighbors algorithm, or KNN ¢ In the KNN algorithm, a classification or regression prediction is made for new examples by calculating the distance between the new example (row) and all examples (rows) in the training dataset. ¢ The k examples in the training dataset with the smallest distance are then selected and a prediction is made by averaging the outcome (mode of the class label or mean of the real value for regression). Applications: ¢ K-Nearest Neighbors ¢ Learning Vector Quantization (LVQ) ¢ Self-Organizing Map (SOM) ¢ K-Means Clustering ¢ There are many kernel-based methods that may also be considered d...