Regression is a set of problems where we estimate the relationship between one or more variables in order to predict new data points. Opposed to classification problems, regression is used to predict a number such as the Remaining Useful Life or the sales price of a house.