What is Regression?

Regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable) and one or more independent variables (often called 'predictors', 'covariates', or 'features'). It is commonly used for prediction, forecasting, and understanding the causal effect of one variable upon another. Common types include linear regression (for continuous outcomes) and logistic regression (for categorical outcomes).