(Solved) : Part 1 Introduction Something Useful Big Data Models Devised Large Numbers Observations Or Q30790558 . . .
Need MATLAB Coding for the following Project


PART 1 Introduction To do something useful with big data, models are devised from the large numbers of observations in order to predict what will occur for some other observation(s). A simple linear model is of the form: where yi is the dependent variable, i is the observation number (there are a total of M observa- tions), rij is the set of independent variables, N is the number of independent variables (for big data, M N), and ai are the set of model coefficients. Equation (1) lends itself to a matrix formulation: Y XA The model coefficients aj are determined by measuring yi and rij. One of the dangers of developing such a model is “over-fitting” the data. This is where aj are tuned for the M observations so that aj is an excellent model for y, i-M, but is a poor model for y, i > M Good practice is therefore to split the M observations into a “training dataset” (with M1 observations, Mi 2 N and typically Mi > N) and a “test dataset” (with M2 observations, My + M2 M, and typically M2 < M). The values of aj are determined from Eq. (1) using the training dataset (with Mi observations). The values can then be validated using the test dataset by calculating yi using Eq. 1) and calculating the error from the actual values yi. In this question, you are going to apply this methodology to determinef it is possible to estimate the mean pressure for the year based on temperature readings from each month. The ideal gas law is: where p is the pressure, ρ is the density, R the ideal gas constant and T the temperature. Your computational task is to use Eq. (1) 12 Pi= リ ㄅ in the form of Eq. (2) P TA for the 9:00 readings. Here pi is the average pressure across all months for day i, Ti is the temperature on day i and month j and aj is the average coefficient for month j. You will use the entire 12 months’ worth of data (N 12) to calculate the average pressure for each calendar Examples of non-linear models are: 1. having raised to some power other than 1 2. having z z,(j k) where k is 3. having T inside some function, e.g. In a, sin Ti Show transcribed image text
Expert Answer
Answer to Part 1 Introduction Something Useful Big Data Models Devised Large Numbers Observations Or Q30790558 . . .
OR