Step 1.3 – Core Ideas in Machine Learning

1. Features

Features are the input variables used to make predictions. For example, house size, number of bedrooms, and location when predicting house price.

2. Labels (Targets)

Labels are the expected outputs the model is trained to predict. In the house price example, the label is the actual price.

3. Training

Training is the process of feeding the model data so it can learn patterns. You provide both features and labels.

4. Testing

Testing evaluates the model on unseen data to check its performance and generalization.

5. Model

The model is the algorithm plus learned parameters. It’s the trained system that makes predictions.

6. Prediction

Prediction is using the trained model to estimate outputs for new inputs.

Summary Table

Concept Role in ML Workflow Code Representation
Features Input variables X
Labels Expected output y
Training Learning from known data model.fit(X, y)
Testing Evaluating on new data model.predict(X)
Model The trained algorithm model
Prediction Output from the model y_pred