Factor analysis is an exploratory/descriptive method for modeling observed variables and their variance/covariance structures in terms of a smaller number of underlying, unobservable (i.e. latent) factors.
Factors are commonly viewed as broad concepts/ideas that can describe an observed phenomenon. As a result, use of factor analysis can be controversial because the method is somewhat subjective and open to flexible interpretations.
For example, a strong desire to obtain social status may explain why many people exercise, but how much this factor influences motivation and discipline to exercise depends on the individual and can't be accurately measured quantitatively. There are also other factors that might influence how much somebody exercises, as well as other observable ways that people might try to obtain social status other than exercising.
Data variables for the example above could be:
- How much money do you spend on gym memberships and fitness equipment?
- How much time do you spend exercising each day?
- Do you prefer to exercise alone or with another person / group?
The answers to these questions are specific and quantifiable, whereas the underlying factors that might influence them are not. In factor analysis, observed variables are modeled as linear functions of the "factors".
Factor Analysis in Machine Learning
Factor analysis is a technique sometimes used in machine learning to gain insights about the connections and interdependencies between observed variables in a data set. A common application is the case in which data sets have a large amount of observed variables and it is thought that they can be condensed to reflect a smaller number of underlying variables.
NCSS Statistical Software
PCA Probabilistic PCA Factor Analysis Bonus Material CPSC 540: Machine Learning Probabilistic PCA and Factor Analysis
Towards reducing the multidimensionality of OLAP cubes using the Evolutionary Algorithms and Factor Analysis Methods
Sami Naouali, Semeh Ben Salem
Documentaries, videos and podcasts
- Cluster: Artificial intelligenceA cluster of topics related to artificial intelligence.
- BiologyStudy of life
- MarketingActivities to gain and keep customers, providing value to them through offerings and communication about offerings
- Social scienceAcademic discipline concerned with society and the relationships
- Machine learningA field of computer science enabling computers to learn.
- Reinforcement LearningAn area of machine learning focusing on how machines and software agents react in a specific context to maximize performance and achieve reward known as reinforcement signal.
- Artificial neural networkA computational model biologically inspired network of artificial neurons applied in computers to execute specific tasks
- Hierarchical clusteringHierarchical clustering