Regression
ELI5 — The Vibe Check
Regression is like classification but instead of sorting things into categories, you're predicting a number. What will this house sell for? How many users will we have next month? What's the temperature tomorrow? The AI learns to output a continuous value instead of a category label. Linear regression is the 'hello world' of ML.
Real Talk
Regression is a supervised learning task where the model predicts a continuous numerical output. Common algorithms include linear regression, polynomial regression, decision trees, and neural networks. Loss functions for regression include MSE (mean squared error) and MAE (mean absolute error). Evaluation metrics include RMSE and R-squared.
Show Me The Code
from sklearn.linear_model import LinearRegression
model = LinearRegression()
model.fit(X_train, y_train)
predictions = model.predict(X_test) # outputs continuous values
When You'll Hear This
"Predicting house prices is a regression task." / "Our churn prediction model is actually a regression — we output a probability."
Related Terms
Classification
Classification is teaching an AI to sort things into categories. Is this email spam or not? Is this image a cat, dog, or bird?
Clustering
Clustering is teaching an AI to find groups in data WITHOUT being told what the groups are.
Loss Function
The loss function is the AI's score of how badly it's doing.
Machine Learning (ML)
Machine Learning is teaching a computer by showing it thousands of examples instead of writing out every rule.