Difference between revisions of "Out-of-Distribution (OOD) Generalization"

From
Jump to: navigation, search
m
m
Line 15: Line 15:
 
* [[Math for Intelligence#Mathematical Reasoning|Mathematical Reasoning]]
 
* [[Math for Intelligence#Mathematical Reasoning|Mathematical Reasoning]]
 
* [[Transfer Learning]]
 
* [[Transfer Learning]]
 +
* [[Causation vs. Correlation]]
 
* [https://arxiv.org/abs/2108.13624 Towards Out-Of-Distribution Generalization: A Survey]
 
* [https://arxiv.org/abs/2108.13624 Towards Out-Of-Distribution Generalization: A Survey]
 
* [https://arxiv.org/abs/2106.04496 Towards a Theoretical Framework of Out-of-Distribution Generalization]
 
* [https://arxiv.org/abs/2106.04496 Towards a Theoretical Framework of Out-of-Distribution Generalization]

Revision as of 17:11, 27 May 2023

YouTube ... Quora ...Google search ...Google News ...Bing News

Out-of-Distribution (OOD) generalization refers to the ability of a machine learning model to generalize to new data that comes from a different distribution than the training data. This is a challenging problem because the testing distribution is unknown and different from the training distribution. There are several methods for improving out-of-distribution generalization. According to a survey on the topic, existing methods can be categorized into three parts based on their positions in the whole learning pipeline: unsupervised representation learning, supervised model learning and optimization. Another approach to out-of-distribution generalization is via learning domain-invariant features or hypothesis-invariant features.