DOC PREVIEW
CSUN PSY 524 - Factor Analysis Continued

This preview shows page 1-2-3-26-27-28 out of 28 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 28 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Factor Analysis ContinuedPsy 524AinsworthEquations – ExtractionPrincipal Components AnalysisSkiers Cost Lift Depth PowderS1 32 64 65 67S2 61 37 62 65S3 59 40 45 43S4 36 62 34 35S5 62 46 43 40VariablesEquations – ExtractionCost Lift Depth PowderCost 1 -0.952990 -0.055276 -0.129999Lift -0.952990 1 -0.091107 -0.036248Depth -0.055276 -0.091107 1 0.990174Powder -0.129999 -0.036248 0.990174 1• Correlation matrix w/ 1s in the diag• Large correlation between Cost and Lift and another between Depth and Powder• Looks like two possible factorsEquations – Extraction• Reconfigure the variance of the correlation matrix into eigenvalues and eigenvectors2.016356722 0.000000000 0.000000000 0.0000000000.000000000 1.941495414 0.000000000 0.0000000000.000000000 0.000000000 0.037784214 0.0000000000.000000000 0.000000000 0.000000000 0.0043636500.3525740484 0.6142350748 0.6627227864 0.2433214370-0.2513116190 -0.6636944396 0.6760812698 0.1981572044-0.6273115310 0.3224031907 0.2748380988 -0.6534527107-0.6473131033 0.2797876809 -0.1678590017 0.6888598954V =L =Equations – Extraction• L=V’RV• Where L is the eigenvalue matrix and V is the eigenvector matrix.• This diagonalized the R matrix and reorganized the variance into eigenvalues• A 4 x 4 matrix can be summarized by 4 numbers instead of 16.Equations – Extraction• R=VLV’• This exactly reproduces the R matrix if all eigenvalues are used• SPSS matrix output ‘factor_extraction.sps’• Gets pretty close even when you use only the eigenvalues larger than 1.• More SPSS matrix outputEquations – Extraction• Since R=VLV’'RVLLV=()(')RVL LV=,''VL A LV A==', where A is the loading matrixand A' is the transpose of the loading matrix.See SPSS output from matrix syntax.RAA=Equations – ExtractionFactor 1 Factor 2Cost -0.401 0.907Lift 0.251 -0.954Depth 0.933 0.351Powder 0.957 0.288• Here we see that factor 1 is mostly Depth and Powder (Snow Condition Factor)• Factor 2 is mostly Cost and Lift, which is a resort factor• Both factors have complex loadingsEquations – Orthogonal Rotation• Factor extraction is usually followed by rotation in order to maximize large correlation and minimize small correlations• Rotation usually increases simple structure and interpretability.• The most commonly used is the Varimax variance maximizing procedure which maximizes factor loading varianceEquations – Orthogonal Rotation• The unrotated loading matrix is multiplied by a transformation matrix which is based on angle of rotationcos sin, where is the angle of rotationsin cos.946 .326if = 19 then .326 .946See SPSS matrix syntax.unrotated rotatedAAΛ=Ψ− ΨΛ= ΨΨΨ−ΨΛ=Equations – Other Stuff• Communalities are found from the factor solution by the sum of the squared loadings• 97% of cost is accounted for by Factors 1 and 2Equations – Other Stuff• Proportion of variance in a variable set accounted for by a factor is the SSLs for a factor divided by the number of variables• For factor 1 1.994/4 is .50Equations – Other Stuff• The proportion of covariance in a variable set accounted for by a factor is the SSLsdivided by the total communality (or total SSLs across factors)• 1.994/3.915 = .51Equations – Other Stuff• The residual correlation matrix is found by subtracting the reproduced correlation matrix from the original correlation matrix.• See matrix syntax output• For a “good” factor solution these should be pretty small.• The average should be below .05 or so.Equations – Other Stuff• Factor weight matrix is found by dividing the loading matrix by the correlation matrix• See matrix output1BRA−Equations – Other Stuff• Factors scores are found by multiplying the standardized scores for each individual by the factor weight matrix and adding them up.FZB=Equations – Other Stuff• You can also estimate what each subject would score on the (standardized) variables'ZFA=Equations – Oblique Rotation• In oblique rotation the steps for extraction are taken• The variables are assessed for the unique relationship between each factor and the variables (removing relationships that are shared by multiple factors)• The matrix of unique relationships is called the pattern matrix.• The pattern matrix is treated like the loading matrix in orthogonal rotation.Equations – Oblique Rotation• The Factor weight matrix and factor scores are found in the same way• The factor scores are used to find correlations between the variables..079 .981.078 .978.994 .033.977 .033pattern A−−−==−Equations – Oblique Rotation1.104 .584.081 .421.159 .020.856 .0341.12 -1.181.01 .88.46 .681.07 .98.59 .59RA BFZB−−==−==−−−−Equations – Oblique Rotation• Once you have the factor scores you can calculate the correlations between the factors (phi matrix; Φ)1'1FFNΦ=−Equations – Oblique Rotation1.12 -1.181.01 .881.12 1.01 -0.46 -1.07 -0.59 1.00 .011*.46 .68-1.18 0.88 0.68 -0.98 0.59 .01 1.0041.07 .98.59 .59−Φ= =−−−−−Equations – Oblique Rotation• The structure matrix is the (zero-order) correlations between the variables and the factors..079 .981 .069 .982.078 .978 1.00 .01 .088 .977*.994 .033 .01 1.00 .994 .023.977 .033 .997 .043CAC=Φ−−  −− − −− == − −− Equations – Oblique Rotation• With oblique rotation the reproduced factor matrix is found be multiplying the structure matrix by the pattern matrix.'repRCA=What else?• How many factors do you extract?• One convention is to extract all factors with eigenvalues greater than 1 (e.g. PCA)• Another is to extract all factors with non-negative eigenvalues• Yet another is to look at the scree plot• Number based on theory• Try multiple numbers and see what gives best interpretation.Total Variance Explained3.513 29.276 29.276 3.296 27.467 27.467 3.251 27.094 27.0943.141 26.171 55.447 2.681 22.338 49.805 1.509 12.573 39.6661.321 11.008 66.455 .843 7.023 56.828 1.495 12.455 52.121.801 6.676 73.132 .329 2.745 59.573 .894 7.452 59.573.675 5.623 78.755.645 5.375 84.131.527 4.391 88.522.471 3.921 92.443.342 2.851 95.294.232 1.936 97.231.221 1.841 99.072.111 .928 100.000Factor123456789101112Total % of Variance Cumulative % Total % of Variance


View Full Document

CSUN PSY 524 - Factor Analysis Continued

Download Factor Analysis Continued
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Factor Analysis Continued and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Factor Analysis Continued 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?