![Machine Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-1.png)
![Contents I. Introduction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-2.png)
![Objectives](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-3.png)
![Related Fields 1. Statistics](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-4.png)
![Literature Machine Learning:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-5.png)
![Software Programming:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-6.png)
![Software Statistics:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-7.png)
![Software Lab Class Setup](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-8.png)
![Software Lab Class Setup](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-organization/unit-en-ml-organization-9.png)
![Chapter ML:I I. Introduction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-1.png)
![Examples of Learning Tasks (1) Car Shopping Guide](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-2.png)
![Examples of Learning Tasks (2) Risk Analysis for Credit Approval](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-3.png)
![Examples of Learning Tasks (2) Risk Analysis for Credit Approval](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-4.png)
![Examples of Learning Tasks (3) Image Analysis](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-5.png)
![Examples of Learning Tasks (3) Image Analysis](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-6.png)
![Specification of Learning Tasks Definition 1 (Machine Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-7.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-8.png)
![Specification of Learning Tasks Learning Paradigms](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-9.png)
![Specification of Learning Tasks Learning Paradigms](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-10.png)
![Specification of Learning Tasks (4) Example Chess: Kinds of Experience](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-11.png)
![Specification of Learning Tasks (4) Example Chess: Kinds of Experience](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-12.png)
![Specification of Learning Tasks (4) Example Chess: Kinds of Experience](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-13.png)
![Specification of Learning Tasks (4) Example Chess: Ideal Target Function γ()](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-14.png)
![Specification of Learning Tasks (4) Example Chess: Ideal Target Function γ()](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-15.png)
![Specification of Learning Tasks (4) Example Chess: Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-16.png)
![Specification of Learning Tasks (4) Example Chess: Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-17.png)
![Specification of Learning Tasks (4) Example Chess: Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-18.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-19.png)
![Remarks (continued):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-20.png)
![Specification of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-21.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-22.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-23.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-24.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-25.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-26.png)
![Specification of Learning Tasks Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-27.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-28.png)
![Remarks (continued) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-29.png)
![Specification of Learning Tasks The LMS Algorithm for Fitting y(x)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-30.png)
![Specification of Learning Tasks The LMS Algorithm for Fitting y(x)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-31.png)
![Remarks: (?) We consider the feature vector x in its extended form when used as operand in a scalar](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-32.png)
![Remarks (continued):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-introduction/unit-en-ml-introduction-33.png)
![Chapter ML:I I. Introduction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-1.png)
![Elements of Machine Learning (1) Model Formation: Real World → Model World](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-2.png)
![Elements of Machine Learning (2) Design Choices in the Machine Learning Stack: LMS](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-3.png)
![Elements of Machine Learning (2) Design Choices in the Machine Learning Stack: LMS](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-4.png)
![Elements of Machine Learning (2) Design Choices in the Machine Learning Stack: LMS](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-5.png)
![Elements of Machine Learning (2) Design Choices in the Machine Learning Stack: LMS](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-6.png)
![Elements of Machine Learning (2) Design Choices in the Machine Learning Stack: LMS](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-7.png)
![Related questions:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-8.png)
![Elements of Machine Learning (3) Feature Space Structure](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-9.png)
![Elements of Machine Learning (3) Feature Space Structure](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-10.png)
![Elements of Machine Learning (3) Feature Space Structure](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-11.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-12.png)
![Elements of Machine Learning (4) Discriminative versus Generative Approach to Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-13.png)
![Elements of Machine Learning (4) Discriminative versus Generative Approach to Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-14.png)
![Elements of Machine Learning (4) Discriminative versus Generative Approach to Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-15.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-16.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-17.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-18.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-19.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-20.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-21.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-22.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-23.png)
![Elements of Machine Learning (5) Frequentist versus Subjectivist Paradigm to Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-24.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-elements/unit-en-ml-elements-25.png)
![Chapter ML:I I. Introduction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-1.png)
![Notation Overview Data, Sets, and Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-2.png)
![Notation Overview Indexing](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-3.png)
![Notation Overview Functions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-4.png)
![Notation Overview Algorithms](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-5.png)
![Classification Approaches Overview Search in hypothesis space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-ml-syntax-overview/unit-en-ml-syntax-overview-6.png)
![Chapter ML:II](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-1.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-2.png)
![Concept Learning: Search in Hypothesis Space Example Learning Task](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-3.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-4.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-5.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-6.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-7.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-8.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-9.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-10.png)
![Concept Learning: Search in Hypothesis Space Simple Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-11.png)
![Concept Learning: Search in Hypothesis Space Order of Hypotheses](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-12.png)
![Concept Learning: Search in Hypothesis Space Order of Hypotheses](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-13.png)
![Concept Learning: Search in Hypothesis Space Order of Hypotheses](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-14.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-15.png)
![Remarks on entailment:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-16.png)
![Remarks on entailment: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-17.png)
![Concept Learning: Search in Hypothesis Space Inductive Learning Hypothesis](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-18.png)
![Concept Learning: Search in Hypothesis Space Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-19.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-20.png)
![Concept Learning: Search in Hypothesis Space Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-21.png)
![Concept Learning: Search in Hypothesis Space Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-22.png)
![Concept Learning: Search in Hypothesis Space Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-23.png)
![Concept Learning: Search in Hypothesis Space Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-24.png)
![Concept Learning: Search in Hypothesis Space Discussion of the Find-S Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-25.png)
![Concept Learning: Version Space Definition 5 (Version Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-26.png)
![Concept Learning: Version Space Definition 5 (Version Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-27.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-28.png)
![Concept Learning: Version Space Definition 6 (Boundary Sets of a Version Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-29.png)
![Concept Learning: Version Space Theorem 7 (Version Space Representation)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-30.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-31.png)
![Concept Learning: Version Space Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-32.png)
![Concept Learning: Version Space Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-33.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-34.png)
![Concept Learning: Version Space Candidate Elimination Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-35.png)
![Concept Learning: Version Space Candidate Elimination Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-36.png)
![Concept Learning: Version Space Illustration of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-37.png)
![Concept Learning: Version Space Illustration of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-38.png)
![Concept Learning: Version Space Illustration of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-39.png)
![Concept Learning: Version Space Illustration of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-40.png)
![Concept Learning: Version Space Illustration of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-41.png)
![Concept Learning: Version Space Discussion of the Candidate Elimination Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-42.png)
![Concept Learning: Version Space Question 1: Selecting Examples from D](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-43.png)
![Concept Learning: Version Space Question 1: Selecting Examples from D](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-44.png)
![Concept Learning: Version Space Question 2: Partially Learned Concepts](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-45.png)
![Concept Learning: Version Space Question 2: Partially Learned Concepts](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-46.png)
![Concept Learning: Version Space Question 2: Partially Learned Concepts](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-47.png)
![Concept Learning: Version Space Question 2: Partially Learned Concepts](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-48.png)
![Concept Learning: Version Space Question 2: Partially Learned Concepts](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-49.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-50.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-51.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-52.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-53.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-54.png)
![Concept Learning: Version Space Question 3: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-concept-learning/unit-en-concept-learning-55.png)
![Chapter ML:II II. Machine Learning Basics](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-1.png)
![From Regression to Classification Regression versus Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-2.png)
![From Regression to Classification Regression versus Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-3.png)
![From Regression to Classification Regression versus Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-4.png)
![From Regression to Classification The Linear Regression Model](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-5.png)
![From Regression to Classification The Linear Regression Model](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-6.png)
![From Regression to Classification The Linear Regression Model](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-7.png)
![Remarks (residuals):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-8.png)
![Remarks (randomness and distributions):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-9.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-10.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-11.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-12.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-13.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-14.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-15.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-16.png)
![From Regression to Classification One-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-17.png)
![From Regression to Classification Higher-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-18.png)
![From Regression to Classification Higher-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-19.png)
![From Regression to Classification Higher-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-20.png)
![From Regression to Classification Higher-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-21.png)
![From Regression to Classification Higher-Dimensional Feature Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-22.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-23.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-24.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-25.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-26.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-27.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-28.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-29.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-30.png)
![Remarks: (?) We consider the feature vector x in its extended form when used as operand in a scalar](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-31.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-32.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-33.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-34.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-35.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-36.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-37.png)
![From Regression to Classification Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-38.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-39.png)
![From Regression to Classification Linear Model Function Variants](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-40.png)
![From Regression to Classification Linear Model Function Variants](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-41.png)
![From Regression to Classification Linear Model Function Variants](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-42.png)
![From Regression to Classification Linear Model Function Variants](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-43.png)
![From Regression to Classification Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-44.png)
![From Regression to Classification Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-45.png)
![From Regression to Classification Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-46.png)
![From Regression to Classification Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-47.png)
![From Regression to Classification Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-48.png)
![From Regression to Classification Methods of Least Squares: Iterative versus Direct Methods](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-49.png)
![From Regression to Classification Methods of Least Squares: Iterative versus Direct Methods](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-50.png)
![From Regression to Classification Methods of Least Squares: Iterative versus Direct Methods](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-51.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-52.png)
![From Regression to Classification Properties of the Solution](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-53.png)
![From Regression to Classification Properties of the Solution](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-54.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regression-for-classification/unit-en-regression-for-classification-55.png)
![Chapter ML:II](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-1.png)
![Evaluating Effectiveness Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-2.png)
![Evaluating Effectiveness Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-3.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-4.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-5.png)
![Evaluating Effectiveness Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-6.png)
![Evaluating Effectiveness Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-7.png)
![Evaluating Effectiveness Illustration 1: Label Noise](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-8.png)
![Evaluating Effectiveness Illustration 1: Label Noise](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-9.png)
![Evaluating Effectiveness Illustration 1: Label Noise](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-10.png)
![Evaluating Effectiveness Illustration 1: Label Noise](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-11.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-12.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-13.png)
![Evaluating Effectiveness Illustration 2: Bayes [Optimal] Classifier and Bayes Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-14.png)
![Evaluating Effectiveness Illustration 2: Bayes [Optimal] Classifier and Bayes Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-15.png)
![Evaluating Effectiveness Illustration 2: Bayes [Optimal] Classifier and Bayes Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-16.png)
![Evaluating Effectiveness Illustration 2: Bayes [Optimal] Classifier and Bayes Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-17.png)
![Evaluating Effectiveness Illustration 2: Bayes [Optimal] Classifier and Bayes Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-18.png)
![Remarks (Bayes classifier):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-19.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-20.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-21.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-22.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-23.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-24.png)
![Evaluating Effectiveness Illustration 3: Marginal and Conditional Distributions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-25.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-26.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-27.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-28.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-29.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-30.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-31.png)
![Evaluating Effectiveness Illustration 4: Probability Distribution in a Regression Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-32.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-33.png)
![Evaluating Effectiveness Estimating Error Bounds](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-34.png)
![Evaluating Effectiveness Estimating Error Bounds](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-35.png)
![Evaluating Effectiveness Estimating Error Bounds](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-36.png)
![Evaluating Effectiveness Estimating Error Bounds](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-37.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-38.png)
![Evaluating Effectiveness Training Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-39.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-40.png)
![Evaluating Effectiveness Holdout Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-41.png)
![Evaluating Effectiveness Holdout Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-42.png)
![Evaluating Effectiveness Holdout Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-43.png)
![Evaluating Effectiveness Holdout Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-44.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-45.png)
![Evaluating Effectiveness k-Fold Cross-Validation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-46.png)
![Evaluating Effectiveness k-Fold Cross-Validation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-47.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-48.png)
![Evaluating Effectiveness Comparing Model Variants](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-49.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-50.png)
![Evaluating Effectiveness Model Selection: Single Validation Set](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-51.png)
![Evaluating Effectiveness Model Selection: Single Validation Set](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-52.png)
![Evaluating Effectiveness Model Selection: Single Validation Set](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-53.png)
![Evaluating Effectiveness Model Selection: k validation sets](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-54.png)
![Evaluating Effectiveness Model Selection: k validation sets](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-55.png)
![Evaluating Effectiveness Model Selection: k validation sets](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-56.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-57.png)
![Evaluating Effectiveness Misclassification Costs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-58.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-evaluating-effectiveness/unit-en-evaluating-effectiveness-59.png)
![Chapter ML:III III. Linear Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-1.png)
![Logistic Regression Binary Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-2.png)
![Logistic Regression Binary Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-3.png)
![Logistic Regression Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-4.png)
![Logistic Regression Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-5.png)
![Logistic Regression Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-6.png)
![Logistic Regression Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-7.png)
![Logistic Regression Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-8.png)
![Remarks: (?) Recap.](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-9.png)
![Logistic Regression Sigmoid (Logistic) Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-10.png)
![Logistic Regression Sigmoid (Logistic) Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-11.png)
![Logistic Regression Sigmoid (Logistic) Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-12.png)
![Logistic Regression Sigmoid (Logistic) Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-13.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-14.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-15.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-16.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-17.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-18.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-19.png)
![Logistic Regression Interpretation of the Logistic Model Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-20.png)
![Remarks (probabilistic view to classification) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-21.png)
![Remarks (probabilistic view to classification) : (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-22.png)
![Remarks (derivation of Lσ (w)) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-23.png)
![Remarks (derivation of Lσ (w)) : (continued) = argmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-24.png)
![Logistic Regression Recap. Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-25.png)
![Logistic Regression Recap. Linear Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-26.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-27.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-28.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-29.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-30.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-31.png)
![Logistic Regression Logistic Regression for Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-32.png)
![Logistic Regression The BGDσ Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-33.png)
![Logistic Regression The BGDσ Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-34.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-35.png)
![Logistic Regression Machine Learning Stack for Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-36.png)
![Logistic Regression Machine Learning Stack for Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-37.png)
![Logistic Regression Machine Learning Stack for Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-38.png)
![Logistic Regression Machine Learning Stack for Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-39.png)
![Logistic Regression Machine Learning Stack for Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-40.png)
![Logistic Regression Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-41.png)
![Logistic Regression Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-42.png)
![Logistic Regression Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-43.png)
![Logistic Regression Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-44.png)
![Logistic Regression Non-Linear Decision Boundaries](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-45.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-46.png)
![Chapter ML:III III. Linear Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-47.png)
![Loss Computation in Detail Loss Computation in the Machine Learning Stack](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-48.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-49.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-50.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-51.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-52.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-53.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-54.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-55.png)
![Loss Computation in Detail Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-56.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-57.png)
![Loss Computation in Detail Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-58.png)
![Loss Computation in Detail Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-59.png)
![Loss Computation in Detail Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-60.png)
![Loss Computation in Detail Logistic Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-61.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-62.png)
![Remarks (different roles of loss functions) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-logistic-regression/unit-en-logistic-regression-63.png)
![Chapter ML:III](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-1.png)
![Overfitting Definition 9 (Overfitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-2.png)
![Overfitting Definition 9 (Overfitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-3.png)
![Overfitting Definition 9 (Overfitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-4.png)
![Overfitting Definition 9 (Overfitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-5.png)
![Overfitting Definition 9 (Overfitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-6.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-7.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-8.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-9.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-10.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-11.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-12.png)
![Overfitting Example: Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-13.png)
![Overfitting Definition 9 (Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-14.png)
![Overfitting Mitigation Strategies](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-15.png)
![Overfitting Mitigation Strategies](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-16.png)
![Overfitting Mitigation Strategies](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-17.png)
![Chapter ML:III](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-18.png)
![Regularization Regularization in the Machine Learning Stack](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-19.png)
![Regularization Bound the Absolute Values of the Weights w](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-20.png)
![Regularization Bound the Absolute Values of the Weights w](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-21.png)
![Regularization Bound the Absolute Values of the Weights w](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-22.png)
![Regularization Bound the Absolute Values of the Weights w](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-23.png)
![Regularization Bound the Absolute Values of the Weights w](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-24.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-25.png)
![Remarks (continued) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-26.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-27.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-28.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-29.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-30.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-31.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-32.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-33.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-34.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-35.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-36.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-37.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-38.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-39.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-40.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-41.png)
![Regularization The Vector Norm as Regularization Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-42.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-43.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-44.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-45.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-46.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-47.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-48.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-49.png)
![Regularization Regularized Linear Regression](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-regularization/unit-en-regularization-50.png)
![Chapter ML:III](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-1.png)
![Gradient Descent in Detail Principle](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-2.png)
![Gradient Descent in Detail Principle](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-3.png)
![Gradient Descent in Detail Principle](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-4.png)
![Gradient Descent in Detail Principle](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-5.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-6.png)
![Gradient Descent in Detail](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-7.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-8.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-9.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-10.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-11.png)
![Gradient Descent in Detail (1) Linear Regression + Squared Loss](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-12.png)
![Gradient Descent in Detail (1) Linear Regression + Squared Loss](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-13.png)
![Remarks (derivation of ∇L2 (w)) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-14.png)
![Gradient Descent in Detail The BGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-15.png)
![Gradient Descent in Detail The BGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-16.png)
![Remarks: (?) Recap.](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-17.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-18.png)
![Gradient Descent in Detail Global Loss versus Pointwise Loss](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-19.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-20.png)
![Gradient Descent in Detail The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-21.png)
![Gradient Descent in Detail The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-22.png)
![Remarks (IGD) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-23.png)
![Remarks (:::::::: recap. different roles of loss functions) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-24.png)
![Gradient Descent in Detail (2) Linear Regression + 0\u002f1 Loss](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-25.png)
![Gradient Descent in Detail (2) Linear Regression + 0\u002f1 Loss](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-26.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-27.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-28.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-29.png)
![Gradient Descent in Detail](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-30.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-31.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-32.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-33.png)
![Gradient Descent in Detail (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-34.png)
![Gradient Descent in Detail (3) Logistic Regression + Logistic Loss + Regularization](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-35.png)
![Gradient Descent in Detail (3) Logistic Regression + Logistic Loss + Regularization](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-36.png)
![Remarks: ~ = (w1 , . . . , wp )T , and the](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-37.png)
![Remarks (derivation of ∇Lσ (w)) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-38.png)
![Remarks (derivation of ∇Lσ (w)) : (continued) (3)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-gradient-descent/unit-en-gradient-descent-39.png)
![Chapter ML:IV IV. Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-1.png)
![Perceptron Learning Biological Inspiration](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-2.png)
![Perceptron Learning Biological Inspiration](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-3.png)
![Remarks (facts about the human brain):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-4.png)
![Perceptron Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-5.png)
![Perceptron Learning The Perceptron of Rosenblatt](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-6.png)
![Perceptron Learning The Perceptron of Rosenblatt](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-7.png)
![Perceptron Learning The Perceptron of Rosenblatt](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-8.png)
![Perceptron Learning The Perceptron of Rosenblatt](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-9.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-10.png)
![Perceptron Learning Binary Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-11.png)
![Perceptron Learning The PT Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-12.png)
![Perceptron Learning The PT Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-13.png)
![Remarks: (?) Recap.](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-14.png)
![Perceptron Learning Weight Adaptation: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-15.png)
![Perceptron Learning Weight Adaptation: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-16.png)
![Remarks: ~ = (w1 , . . . , wp )T , and the](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-17.png)
![Perceptron Learning Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-18.png)
![Perceptron Learning Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-19.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-20.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-21.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-22.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-23.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-24.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-25.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-26.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-27.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-28.png)
![Perceptron Learning Example: Illustration in Input Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-29.png)
![Perceptron Learning Perceptron Convergence Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-30.png)
![Perceptron Learning Perceptron Convergence Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-31.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-32.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-33.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-34.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-35.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-36.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-37.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-38.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-39.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-40.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-41.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-42.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-43.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-44.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-45.png)
![Perceptron Learning Perceptron Convergence Theorem: Proof](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-46.png)
![Perceptron Learning Perceptron Convergence Theorem: Discussion](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-47.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-48.png)
![Perceptron Learning PT Algorithm versus Gradient Descent](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-49.png)
![Perceptron Learning PT Algorithm versus Gradient Descent](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-50.png)
![Perceptron Learning PT Algorithm versus Gradient Descent](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-51.png)
![Remarks (PT versus GD) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-perceptron-learning/unit-en-perceptron-learning-52.png)
![Chapter ML:IV](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-1.png)
![Multilayer Perceptron Basics Definition 1 (Linear Separability)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-2.png)
![Multilayer Perceptron Basics Definition 1 (Linear Separability)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-3.png)
![Multilayer Perceptron Basics Linear Separability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-4.png)
![Multilayer Perceptron Basics Linear Separability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-5.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-6.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-7.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-8.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-9.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-10.png)
![Multilayer Perceptron Basics Overcoming the Linear Separability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-11.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-12.png)
![Remarks (history) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-13.png)
![Multilayer Perceptron Basics Overcoming the Non-Differentiability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-14.png)
![Multilayer Perceptron Basics Overcoming the Non-Differentiability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-15.png)
![Multilayer Perceptron Basics Overcoming the Non-Differentiability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-16.png)
![Multilayer Perceptron Basics Overcoming the Non-Differentiability Restriction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-17.png)
![Multilayer Perceptron Basics Unrestricted Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-18.png)
![Multilayer Perceptron Basics Unrestricted Classification Problems: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-19.png)
![Multilayer Perceptron Basics Unrestricted Classification Problems: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-20.png)
![Multilayer Perceptron Basics Sigmoid Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-21.png)
![Multilayer Perceptron Basics Sigmoid Function](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-22.png)
![Remarks (derivation of (σ(z))0 ) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-23.png)
![Remarks (limitation of linear thresholds) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-24.png)
![Chapter ML:IV](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-25.png)
![Multilayer Perceptron with Two Layers Network Architecture](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-26.png)
![Multilayer Perceptron with Two Layers Network Architecture](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-27.png)
![Multilayer Perceptron with Two Layers Network Architecture](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-28.png)
![Multilayer Perceptron with Two Layers Network Architecture](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-29.png)
![Multilayer Perceptron with Two Layers (1) Forward Propagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-30.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-31.png)
![Multilayer Perceptron with Two Layers (1) Forward Propagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-32.png)
![Multilayer Perceptron with Two Layers (1) Forward Propagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-33.png)
![Multilayer Perceptron with Two Layers (1) Forward Propagation: Batch Mode](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-34.png)
![Multilayer Perceptron with Two Layers (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-35.png)
![Multilayer Perceptron with Two Layers (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-36.png)
![Multilayer Perceptron with Two Layers (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-37.png)
![Multilayer Perceptron with Two Layers (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-38.png)
![Multilayer Perceptron with Two Layers (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-39.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-40.png)
![Multilayer Perceptron with Two Layers (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-41.png)
![Multilayer Perceptron with Two Layers (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-42.png)
![Multilayer Perceptron with Two Layers (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-43.png)
![Multilayer Perceptron with Two Layers The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-44.png)
![Multilayer Perceptron with Two Layers The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-45.png)
![Multilayer Perceptron with Two Layers The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-46.png)
![Multilayer Perceptron with Two Layers The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-47.png)
![Multilayer Perceptron with Two Layers The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-48.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-49.png)
![Chapter ML:IV](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-50.png)
![Multilayer Perceptron at Arbitrary Depth Network Architecture](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-51.png)
![Multilayer Perceptron at Arbitrary Depth (1) Forward Propagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-52.png)
![Multilayer Perceptron at Arbitrary Depth (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-53.png)
![Multilayer Perceptron at Arbitrary Depth (2) Backpropagation (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-54.png)
![Multilayer Perceptron at Arbitrary Depth (2) Backpropagation (continued) [two layers]](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-55.png)
![Multilayer Perceptron at Arbitrary Depth (2) Backpropagation (continued) [two layers]](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-56.png)
![Multilayer Perceptron at Arbitrary Depth (2) Backpropagation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-57.png)
![Multilayer Perceptron at Arbitrary Depth The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-58.png)
![Multilayer Perceptron at Arbitrary Depth The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-59.png)
![Multilayer Perceptron at Arbitrary Depth The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-60.png)
![Multilayer Perceptron at Arbitrary Depth The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-61.png)
![Multilayer Perceptron at Arbitrary Depth The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-62.png)
![Remarks (derivation of ∇hs L2 (w)) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-63.png)
![Remarks (derivation of ∇hs L2 (w)) : (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-64.png)
![Remarks (derivation of ∇hs L2 (w)) : (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-65.png)
![Remarks (derivation of ∇hs L2 (w)) : (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-66.png)
![Remarks (derivation of ∇hs L2 (w)) : (continued) h](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-67.png)
![Remarks (derivation of ∇hs L2 (w)) : (continued) h](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-68.png)
![Remarks (derivation of ∇o L2 (w) and ∇h L2 (w) for MLP at depth one) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-multilayer-perceptron/unit-en-multilayer-perceptron-69.png)
![Chapter ML:IV](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-1.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-2.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-3.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-4.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-5.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-6.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-7.png)
![Advanced MLPs Output Normalization: Softmax](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-8.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-9.png)
![Advanced MLPs Loss Function: Cross-Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-10.png)
![Advanced MLPs Loss Function: Cross-Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-11.png)
![Advanced MLPs Loss Function: Cross-Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-12.png)
![Advanced MLPs Cross-Entropy in Classification Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-13.png)
![Advanced MLPs Cross-Entropy in Classification Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-14.png)
![Advanced MLPs Cross-Entropy in Classification Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-15.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-16.png)
![Advanced MLPs Activation Function: Rectified Linear Unit (ReLU)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-17.png)
![Advanced MLPs Regularization: Dropout](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-18.png)
![Advanced MLPs Learning Rate Adaptation: Momentum](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-19.png)
![Advanced MLPs Learning Rate Adaptation: Momentum](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-20.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-21.png)
![Chapter ML:IV](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-22.png)
![Automatic Gradient Computation The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-23.png)
![Automatic Gradient Computation The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-24.png)
![Automatic Gradient Computation The IGD Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-25.png)
![Automatic Gradient Computation Reverse-Mode Automatic Differentiation in Computational Graphs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-26.png)
![Automatic Gradient Computation Reverse-Mode Automatic Differentiation in Computational Graphs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-27.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-28.png)
![Automatic Gradient Computation Autodiff Example: Setting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-29.png)
![Automatic Gradient Computation Autodiff Example: Computational Graph](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-30.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-31.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-32.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-33.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-34.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-35.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-36.png)
![Automatic Gradient Computation Example: Forward and Reverse Trace](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-37.png)
![Remarks: ∂](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-38.png)
![Automatic Gradient Computation Reverse-mode Autodiff Algorithm for Scalar-valued Functions](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-39.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-mlp-extensions/unit-en-mlp-extensions-40.png)
![Chapter ML:VI VI. Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-1.png)
![Decision Trees Basics Classification Problems with Nominal Features](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-2.png)
![Decision Trees Basics Decision Tree for the Concept “EnjoySurfing”](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-3.png)
![Decision Trees Basics Decision Tree for the Concept “EnjoySurfing”](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-4.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-5.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-6.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-7.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-8.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-9.png)
![Decision Trees Basics Definition 1 (Splitting, Induced Splitting)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-10.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-11.png)
![Decision Trees Basics Definition 2 (Decision Tree)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-12.png)
![Decision Trees Basics Definition 2 (Decision Tree)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-13.png)
![Decision Trees Basics Definition 2 (Decision Tree)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-14.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-15.png)
![Decision Trees Basics Notation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-16.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-17.png)
![Decision Trees Basics Algorithm Template: Construction](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-18.png)
![Decision Trees Basics Algorithm Template: Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-19.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-20.png)
![Decision Trees Basics When to Use Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-21.png)
![Decision Trees Basics On the Construction of Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-22.png)
![Decision Trees Basics Assessment of Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-23.png)
![Decision Trees Basics Assessment of Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-24.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-25.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-26.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-27.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-28.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-29.png)
![Decision Trees Basics Assessment of Decision Trees: Size](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-30.png)
![Decision Trees Basics Assessment of Decision Trees: Classification Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-31.png)
![Decision Trees Basics Assessment of Decision Trees: Classification Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-32.png)
![Decision Trees Basics Assessment of Decision Trees: Classification Error](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-33.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-34.png)
![Remarks (misclassification costs):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-basics/unit-en-decision-trees-basics-35.png)
![Chapter ML:VI VI. Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-1.png)
![Impurity Functions Splitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-2.png)
![Impurity Functions Splitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-3.png)
![Impurity Functions Splitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-4.png)
![Impurity Functions Splitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-5.png)
![Impurity Functions Definition 4 (Impurity Function ι)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-6.png)
![Impurity Functions Definition 5 (Impurity of an Example Set ι(D))](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-7.png)
![Impurity Functions Definition 5 (Impurity of an Example Set ι(D))](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-8.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-9.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-10.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-11.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-12.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-13.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-14.png)
![Impurity Functions Impurity Functions Based on the Misclassification Rate](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-15.png)
![Impurity Functions Definition 7 (Strict Impurity Function)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-16.png)
![Impurity Functions Definition 7 (Strict Impurity Function)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-17.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-18.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-19.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-20.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-21.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-22.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-23.png)
![Remarks [::::::: Bayes :::](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-24.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-25.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-26.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-27.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-28.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-29.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-30.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-31.png)
![Impurity Functions Impurity Functions Based on Entropy](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-32.png)
![Impurity Functions Impurity Functions Based on the Gini Index](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-33.png)
![Impurity Functions Impurity Functions Based on the Gini Index](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-34.png)
![Impurity Functions Impurity Functions Based on the Gini Index](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-35.png)
![Impurity Functions Impurity Functions Based on the Gini Index](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-impurity/unit-en-decision-trees-impurity-36.png)
![Chapter ML:VI VI. Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-1.png)
![Decision Tree Algorithms ID3 Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-2.png)
![Decision Tree Algorithms ID3 Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-3.png)
![Decision Tree Algorithms ID3 Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-4.png)
![Decision Tree Algorithms ID3 Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-5.png)
![Decision Tree Algorithms ID3 Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-6.png)
![Decision Tree Algorithms ID3 Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-7.png)
![Decision Tree Algorithms ID3 Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-8.png)
![Decision Tree Algorithms ID3 Algorithm (pseudo code)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-9.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-10.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-11.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-12.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-13.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-14.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-15.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-16.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-17.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-18.png)
![Decision Tree Algorithms ID3 Algorithm: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-19.png)
![Decision Tree Algorithms ID3 Algorithm: Search Space](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-20.png)
![Remarks (search space versus hypothesis space):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-21.png)
![Decision Tree Algorithms ID3 Algorithm: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-22.png)
![Decision Tree Algorithms ID3 Algorithm: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-23.png)
![Decision Tree Algorithms ID3 Algorithm: Inductive Bias](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-24.png)
![Remarks (inductive bias):](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-25.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-26.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-27.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-28.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-29.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-30.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-31.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-32.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-33.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-34.png)
![Decision Tree Algorithms CART Algorithm](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-algorithms/unit-en-decision-trees-algorithms-35.png)
![Chapter ML:VI VI. Decision Trees](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-1.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-2.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-3.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-4.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-5.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-6.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-7.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-8.png)
![Decision Tree Pruning Overfitting](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-9.png)
![Decision Tree Pruning (a) Stopping](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-10.png)
![Decision Tree Pruning (b) Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-11.png)
![Decision Tree Pruning (b) Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-12.png)
![Decision Tree Pruning (b) Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-13.png)
![Decision Tree Pruning (b) Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-14.png)
![Decision Tree Pruning (b) Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-15.png)
![Decision Tree Pruning (b) Pruning: Reduced Error Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-16.png)
![Decision Tree Pruning (b) Pruning: Reduced Error Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-17.png)
![Decision Tree Pruning (b) Pruning: Reduced Error Pruning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-18.png)
![Remarks (pruning extensions) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-decision-trees-pruning/unit-en-decision-trees-pruning-19.png)
![Chapter ML:VII VII. Bayesian Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-1.png)
![Approaches to Probability Area Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-2.png)
![Approaches to Probability Area Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-3.png)
![Approaches to Probability Definition 1 (Random Experiment, Random Observation)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-4.png)
![Approaches to Probability Definition 1 (Random Experiment, Random Observation)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-5.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-6.png)
![Approaches to Probability Definition 2 (Sample Space, Event Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-7.png)
![Approaches to Probability Definition 2 (Sample Space, Event Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-8.png)
![Approaches to Probability Definition 2 (Sample Space, Event Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-9.png)
![Approaches to Probability Definition 2 (Sample Space, Event Space)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-10.png)
![Approaches to Probability Definition 3 (Important Event Types)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-11.png)
![Approaches to Probability Definition 3 (Important Event Types)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-12.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-13.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-14.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-15.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-16.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-17.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-18.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-19.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-20.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-21.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-22.png)
![Approaches to Probability How to Capture the Nature of Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-23.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-24.png)
![Remarks (frequentist versus subjectivist) : ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-25.png)
![Approaches to Probability Axiomatic Approach to Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-26.png)
![Approaches to Probability Axiomatic Approach to Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-27.png)
![Approaches to Probability Axiomatic Approach to Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-28.png)
![Approaches to Probability Axiomatic Approach to Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-29.png)
![Approaches to Probability Axiomatic Approach to Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-30.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-31.png)
![Chapter ML:VII](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-32.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-33.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-34.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-35.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-36.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-37.png)
![Conditional Probability Basic Definition](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-38.png)
![Remarks (conditional probability) : ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-39.png)
![Remarks (conditional event algebra) : ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-40.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-41.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-42.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-43.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-44.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-45.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-46.png)
![Conditional Probability Total Probability](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-47.png)
![Remarks: ❑](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-48.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-49.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-50.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-51.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-52.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-53.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-54.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-55.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-56.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-57.png)
![Conditional Probability Independence of Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-probability-basics/unit-en-probability-basics-58.png)
![Chapter ML:VII](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-1.png)
![Bayes Classifier Generative Approach to Classification Problems](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-2.png)
![Bayes Classifier Bayes Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-3.png)
![Bayes Classifier Bayes Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-4.png)
![Bayes Classifier Bayes Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-5.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-6.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-7.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-8.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-9.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-10.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-11.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-12.png)
![Bayes Classifier Example: Reasoning About a Disease](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-13.png)
![Bayes Classifier Combined Conditional Events: P (Ai | B1, . . . , Bp)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-14.png)
![Bayes Classifier Combined Conditional Events: P (Ai | B1, . . . , Bp)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-15.png)
![Bayes Classifier Combined Conditional Events: P (Ai | B1, . . . , Bp)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-16.png)
![Remarks [:::::::::::: information:::::](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-17.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-18.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-19.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-20.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-21.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-22.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-23.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-24.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-25.png)
![Bayes Classifier Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-26.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-27.png)
![Bayes Classifier Naive Bayes: Classifier Construction Summary](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-28.png)
![Bayes Classifier Naive Bayes: Classifier Construction Summary](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-29.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-30.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-31.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-32.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-33.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-34.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-35.png)
![Bayes Classifier Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-36.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-bayes-classifier/unit-en-bayes-classifier-37.png)
![Chapter ML:VII](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-1.png)
![Exploitation of Data Data Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-2.png)
![Exploitation of Data Data Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-3.png)
![Exploitation of Data Data Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-4.png)
![Exploitation of Data Data Events](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-5.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-6.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-7.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-8.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-9.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-10.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-11.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-12.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-13.png)
![Exploitation of Data Typical Learning Settings](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-14.png)
![Remarks (predictor-response vs. outcome-only setting) : (1),. . . , (4)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-15.png)
![Remarks (discriminative vs. generative approach) : (1), (2), (3)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-16.png)
![Remarks (discriminative vs. generative approach) : (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-17.png)
![Remarks (ML principle vs. Bayes method) : (1), (2), (3)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-18.png)
![Exploitation of Data Learning Approaches Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-19.png)
![Exploitation of Data Learning Approaches Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-20.png)
![Exploitation of Data Learning Approaches Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-21.png)
![Exploitation of Data Learning Approaches Overview](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-22.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-23.png)
![Chapter ML:VII](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-24.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-25.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-26.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-27.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-28.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-29.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-30.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-31.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-32.png)
![Remarks: (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-33.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-34.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-35.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Example](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-36.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-37.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-38.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-39.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-40.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-41.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-42.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-43.png)
![Frequentist versus Subjectivist Logistic Regression versus Naive Bayes: Conditional Class Probabilities](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-44.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-45.png)
![Frequentist versus Subjectivist Naive Bayes: Smoothing and Continuous Likelihoods](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-46.png)
![Frequentist versus Subjectivist Naive Bayes: Prior Probability Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-47.png)
![Frequentist versus Subjectivist Classification: Bayes Optimum versus MAP versus Ensemble](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-48.png)
![Frequentist versus Subjectivist Advanced Bayesian Decision Making](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-49.png)
![Frequentist versus Subjectivist Advanced Bayesian Decision Making](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-50.png)
![Frequentist versus Subjectivist Advanced Bayesian Decision Making](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-51.png)
![Frequentist versus Subjectivist Advanced Bayesian Decision Making](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-52.png)
![Frequentist versus Subjectivist Advanced Bayesian Decision Making](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-53.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-frequentist-subjectivist/unit-en-frequentist-subjectivist-54.png)
![Chapter ML:IX IX. Deep Learning](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-1.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-2.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-3.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-4.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-5.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-6.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-7.png)
![Introduction to Deep Learning History](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-8.png)
![Introduction to Deep Learning Types of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-9.png)
![Introduction to Deep Learning Types of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-10.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-11.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-12.png)
![Autoencoder Networks Representation Learning Task: Word Embedding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-13.png)
![Autoencoder Networks Word Embedding with Autoencoders](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-14.png)
![Autoencoder Networks Representation Learning Task: Co-Occurrence Embedding (Word2Vec)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-15.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-16.png)
![Convolutional Neural Networks Image Classification Task](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-17.png)
![Convolutional Neural Networks Image Classification Task](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-18.png)
![Convolutional Neural Networks Image Classification Task](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-19.png)
![Convolutional Neural Networks Image Classification with CNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-20.png)
![Convolutional Neural Networks Image Classification with CNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-21.png)
![Convolutional Neural Networks Image Classification with CNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-22.png)
![Convolutional Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-23.png)
![Convolutional Neural Networks Image Classification with CNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-24.png)
![Convolutional Neural Networks Image Classification with CNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-25.png)
![Remarks (computation of yc ) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-26.png)
![Remarks (technical variants and improvements) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-27.png)
![Remarks (learning strategies) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-deep-learning-introduction/unit-en-deep-learning-introduction-28.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-1.png)
![Recurrent Neural Networks Notation I](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-2.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-3.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-4.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-5.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-6.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-7.png)
![Recurrent Neural Networks Types of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-8.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-9.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-10.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-11.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-12.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-13.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-14.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-15.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-16.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-17.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-18.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-19.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-20.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-21.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-22.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-23.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-24.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-25.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-26.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-27.png)
![Recurrent Neural Networks RNN Sequence Encoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-28.png)
![Recurrent Neural Networks (S1) Sequence-to-Class: Sentiment Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-29.png)
![Recurrent Neural Networks (S1) Sequence-to-Class: Sentiment Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-30.png)
![Recurrent Neural Networks (S1) Sequence-to-Class: Sentiment Classification](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-31.png)
![Recurrent Neural Networks (S1) Sequence-to-Class Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-32.png)
![Recurrent Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-33.png)
![Recurrent Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-34.png)
![Recurrent Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-35.png)
![Recurrent Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-36.png)
![Recurrent Neural Networks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-37.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-38.png)
![Recurrent Neural Networks The IGD Algorithm for Sequence-to-Class Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-39.png)
![Recurrent Neural Networks The IGD Algorithm for Sequence-to-Class Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-40.png)
![Recurrent Neural Networks Types of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-41.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-42.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-43.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-44.png)
![Recurrent Neural Networks (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-45.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-46.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-47.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-48.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-49.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-50.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-51.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-52.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-53.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-54.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-55.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-56.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-57.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-58.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-59.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-60.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-61.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-62.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-63.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-64.png)
![Recurrent Neural Networks RNN Sequence Decoding](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-65.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-66.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-67.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-68.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-69.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-70.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-71.png)
![Recurrent Neural Networks (S2) Class-to-Sequence: Text Generation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-72.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-73.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-74.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-75.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-76.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-77.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-78.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-79.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-80.png)
![Recurrent Neural Networks (S2) Class-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-81.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-82.png)
![Recurrent Neural Networks The IGD Algorithm for Class-to-Sequence Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-83.png)
![Recurrent Neural Networks The IGD Algorithm for Class-to-Sequence Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-basics/unit-en-rnn-basics-84.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-longterm/unit-en-rnn-longterm-1.png)
![Long-Term Dependencies Vanishing Gradient Problem](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-longterm/unit-en-rnn-longterm-2.png)
![Long-Term Dependencies RNN with Long Short-Term Memory (LSTM)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-longterm/unit-en-rnn-longterm-3.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-longterm/unit-en-rnn-longterm-4.png)
![Long-Term Dependencies RNN with Gated Recurrent Units (GRU)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-longterm/unit-en-rnn-longterm-5.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-1.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-2.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-3.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-4.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-5.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-6.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-7.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-8.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-9.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-10.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-11.png)
![RNNs for Machine Translation Statistical Machine Translation (SMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-12.png)
![Remarks (statistical machine translation) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-13.png)
![RNNs for Machine Translation Neural Machine Translation (NMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-14.png)
![RNNs for Machine Translation Neural Machine Translation (NMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-15.png)
![RNNs for Machine Translation Neural Machine Translation (NMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-16.png)
![RNNs for Machine Translation Neural Machine Translation (NMT)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-17.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-18.png)
![RNNs for Machine Translation Types of Learning Tasks](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-19.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-20.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-21.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-22.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-23.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-24.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-25.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence: Machine Translation](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-26.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-27.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-28.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-29.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-30.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-31.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-32.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-33.png)
![RNNs for Machine Translation (S3) Sequence-to-Sequence Mapping with RNNs](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-34.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-35.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-36.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-37.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-38.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-39.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-40.png)
![RNNs for Machine Translation Sequence-to-Sequence RNNs are Conditional Language Models](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-41.png)
![Remarks: Each output vector y(t) corresponds to a probability distribution over Vocabularyd (recall the](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-rnn-mt/unit-en-rnn-mt-42.png)
![Chapter ML:IX](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-1.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-2.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-3.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-4.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-5.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-6.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-7.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-8.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-9.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-10.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-11.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-12.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-13.png)
![Attention Mechanism Notation III (language model view)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-14.png)
![Attention Mechanism Rationale of the Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-15.png)
![Attention Mechanism Rationale of the Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-16.png)
![Attention Mechanism Rationale of the Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-17.png)
![Attention Mechanism Rationale of the Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-18.png)
![Attention Mechanism Rationale of the Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-19.png)
![Attention Mechanism Query the Encoder to Tweak the Decoder Output](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-20.png)
![Remarks (observations) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-21.png)
![Attention Mechanism RNN with Simple Attention](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-22.png)
![Attention Mechanism (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-23.png)
![Attention Mechanism (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-24.png)
![Attention Mechanism (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-25.png)
![Attention Mechanism (continued)](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-26.png)
![Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-27.png)
![Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-28.png)
![Attention Mechanism](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-29.png)
![Attention Mechanism RNN with Parameterized Attention](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-30.png)
![Remarks (attention calculus) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-31.png)
![Remarks (parameterized attention) :](https://webis.de/downloads/lecturenotes/machine-learning/unit-en-attention/unit-en-attention-32.png)
![Kapitel ML:IX IX. Ensemble and Meta](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-1.png)
![Ensemble Methods Motivation (1): Generalisierungsfähigkeit](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-2.png)
![Ensemble Methods Motivation (2): No Free Lunch Theorem](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-3.png)
![Ensemble Methods Motivation (3): Instabilität von Lernverfahren](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-4.png)
![Ensemble Methods Motivation (4): Consequences](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-5.png)
![Ensemble Methods Bootstrap Aggregating (Bagging)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-6.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-7.png)
![Ensemble Methods Bootstrap Aggregating](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-8.png)
![Ensemble Methods Bootstrap Aggregating](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-9.png)
![Ensemble Methods Bootstrap Aggregating](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-10.png)
![Ensemble Methods Boosting Weak Classifiers](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-11.png)
![Ensemble Methods Adaptive Boosting (AdaBoost)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-12.png)
![Ensemble Methods Adaptive Boosting](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-13.png)
![Ensemble Methods Adaptive Boosting](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-14.png)
![Remarks:](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-15.png)
![Ensemble Methods Discrete AdaBoost](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-16.png)
![Ensemble Methods Cascades of Classifiers (Cascading)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-17.png)
![Ensemble Methods Cascading](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-18.png)
![Ensemble Methods Maßzahlen für Cascading](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-19.png)
![Ensemble Methods Maßzahlen für Cascading](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-20.png)
![Ensemble Methods Cascading](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-21.png)
![Ensemble Methods Cascading for Face Detection (Main Loop)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-22.png)
![Ensemble Methods Cascading for Face Detection (Gesamtklassifikator)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-23.png)
![Ensemble Methods Cascading for Face Detection(Einzelklassifikator in Kaskade)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-24.png)
![Ensemble Methods Cascading for Face Detection (Einzelklassifikator in Ensemble)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-25.png)
![Ensemble Methods Cascading for Face Detection (alle Features)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-26.png)
![Ensemble Methods Cascading for Face Detection (ausgewählte Features)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-27.png)
![Ensemble Methods Cascading for Face Detection (Effizienz)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-28.png)
![Ensemble Methods Cascading for Face Detection (Effizienz beim Training)](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-29.png)
![Ensemble Methods Trainingsmengen](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-30.png)
![Ensemble Methods Grundlage der Entscheidung](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-31.png)
![Ensemble Methods Literature](https://webis.de/downloads/lecturenotes/machine-learning/unit-de-ensemble-methods-basics/unit-de-ensemble-methods-basics-32.png)
Shortcut | Documents |
---|---|
↑/↓
|
Navigate documents |
Shift + ↑/↓
|
Navigate 3 documents |
Shortcut | Pages |
---|---|
←/→
|
Navigate pages |
Shift + MouseWheel
|
Navigate pages |
Shift + ←/→
|
Navigate 3 pages |