Topic outline
-
Cybernetics and the first neural networks
The first digital computers
The emergence of expert systems
Probabilistic approach
Random Forest
Recent achievements -
Machine learning problem
Classification and regression
Features and their types
Model and training method. Loss functional
Probabilistic statement of the training problem. The maximum likelihood principle and its relation to empirical risk minimization. Decision function
Overfitting and the generalizing ability of an algorithm -
Generalized algorithm
Examples: Nearest Neighbor, Parsen Window method
Margin
The Curse of Dimensionality
Choosing a distance
Distance-based regression -
Bayesian approach
Probability density estimation
- nonparametric
- parametric -
Linear regression
Logistic regression
Margins for a linear classifier
One hot encoding
ROC and AUC
SVM -
Linear perceptron
Stochastic gradient descent method
Neural nets structure
Backpropagation
Objective functions for regression, binary/multiclass/multilabel classification
Activation functions
Neural nets design -
The concept of rule
The criterion for the rule quality
Finding rules
Classification algorithms based on rules
-
-
-