{"id":516,"date":"2014-11-26T04:24:12","date_gmt":"2014-11-26T04:24:12","guid":{"rendered":"http:\/\/rovdownloads.com\/blog\/?p=516"},"modified":"2014-11-26T04:24:12","modified_gmt":"2014-11-26T04:24:12","slug":"multivariate-regression-part-1","status":"publish","type":"post","link":"https:\/\/rovdownloads.com\/blog\/multivariate-regression-part-1\/","title":{"rendered":"Multivariate Regression, Part 1"},"content":{"rendered":"

Theory<\/strong>
\nIt is assumed that the user is knowledgeable about the fundamentals of regression analysis.
\nThe general bivariate linear regression equation takes the form of<\/p>\n

\"form1\"<\/p>\n

where \u03b20 is the intercept,\u03b21 is the slope, and \u03b5 is the error term. It is bivariate as there are only two variables, a Y, or dependent variable, and an X, or independent variable, where X is also known as the regressor (sometimes a bivariate regression is also known as a univariate regression as there is only a single independent variable X). The dependent variable is so named because it depends on the independent variable; for example, sales revenue depends on the amount of marketing costs expended on a product\u2019s advertising and promotion, making the dependent variable \u201csales\u201d and the independent variable \u201cmarketing costs.\u201d An example of a bivariate regression is seen as simply inserting the best-fitting line through a set of data points in a two-dimensional plane, as seen on the left in Figure 1. In other cases, a multivariate regression can be performed, where there are multiple, or k number of, independent X variables or regressors, where the general regression equation will now take the form of<\/p>\n

\"form2\"<\/p>\n

In this case, the best-fitting line will be within a k + 1 dimensional plane.<\/p>\n

\"Untitled\"<\/p>\n

However, fitting a line through a set of data points in a scatter plot as in Figure 1 may result in numerous possible lines. The best-fitting line is defined as the single unique line that minimizes the total vertical errors, that is, the sum of the absolute distances between the actual data points (Yi) and the estimated line (Error! Objects cannot be created from editing field codes.), as shown on the right of Figure 1. To find the best-fitting unique line that minimizes the errors, a more sophisticated approach is applied, using regression analysis. Regression analysis, therefore, finds the unique best-fitting line by requiring that the total errors be minimized, or by calculating<\/p>\n

\"form3\"<\/p>\n

where only one unique line minimizes this sum of squared errors. The errors (vertical distances between the actual data and the predicted line) are squared to avoid the negative errors from canceling out the positive errors. Solving this minimization problem with respect to the slope and intercept requires calculating first derivatives and setting them equal to zero:<\/p>\n

\"form4\"<\/p>\n

which yields the bivariate regression\u2019s least squares equations:<\/p>\n

\"form5\"<\/p>\n

For multivariate regression, the analogy is expanded to account for multiple independent variables, where<\/p>\n

\"form6\"<\/p>\n

and the estimated slopes can be calculated by:<\/p>\n

\"form7\"<\/p>\n

In running multivariate regressions, great care must be taken to set up and interpret the results. For instance, a good understanding of econometric modeling is required (e.g., identifying regression pitfalls such as structural breaks, multicollinearity, heteroskedasticity, autocorrelation, specification tests, nonlinearities, and so forth) before a proper model can be constructed.<\/p>\n

Procedure<\/strong><\/p>\n

  • Start Excel and type in or open your existing dataset (the illustration in Figure 2 uses the file Multiple Regression in the examples folder).<\/li>\n
  • Check to make sure that the data are arranged in columns and select the data including the variable headings, and click on Risk Simulator | Forecasting | Multiple Regression.<\/li>\n
  • Select the dependent variable and check the relevant options (lags, stepwise regression, nonlinear regression, and so forth) and click OK (Figure 2).<\/li>\n

    \"IMG_08072014_192129\"<\/p>\n

    Results Interpretation<\/strong>
    \nFigure 3 (on the next page) illustrates a sample multivariate regression result report generated. The report comes complete with all the regression results, analysis of variance results, fitted chart, and hypothesis test results.<\/p>\n

    In \u201cMultivariate Regression, Part 2,\u201d you will learn about a powerful automated approach to regression analysis known as \u201cstepwise regression\u201d and about how goodness-of-fit statistics provide a glimpse into the accuracy and reliability of the estimated regression model.<\/p>\n

    \"IMG_08072014_192207\"<\/p>\n

    TO BE CONCLUDED IN \u201cMulitvariate Regression, Part 2\u201d<\/p>\n

    \"Share<\/a>