Difference between revisions of "Multi-Task Learning (MTL)"

From
Jump to: navigation, search
m
 
(3 intermediate revisions by the same user not shown)
Line 9: Line 9:
  
 
* [[Learning Techniques]]
 
* [[Learning Techniques]]
 +
* [[Agents]]
 +
* [[Multi-Task Learning (MTL)]] ... [[SMART - Multi-Task Deep Neural Networks (MT-DNN)]]
 
* [http://en.wikipedia.org/wiki/Multi-task_learning Multi-task Learning | Wikipedia]
 
* [http://en.wikipedia.org/wiki/Multi-task_learning Multi-task Learning | Wikipedia]
 +
* [[Large Language Model (LLM)]] ... [[Natural Language Processing (NLP)]]  ...[[Natural Language Generation (NLG)|Generation]] ... [[Natural Language Classification (NLC)|Classification]] ...  [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding]] ... [[Language Translation|Translation]] ... [[Natural Language Tools & Services|Tools & Services]]
  
Training a single neural network to apply multiple kinds of labels when inferring, for example, objects seen in an image. Multi-task learning is a type of supervised learning that involves fitting a model on one dataset that addresses multiple related problems. It involves devising a model that can be trained on multiple related tasks in such a way that the performance of the model is improved by training across the tasks as compared to being trained on any single task. Multi-task learning can be a useful approach to problem-solving when there is an abundance of input data labeled for one task that can be shared with another task with much less labeled data. For example, it is common for a multi-task learning problem to involve the same input patterns that may be used for multiple different outputs or supervised learning problems. In this setup, each output may be predicted by a different part of the model, allowing the core of the model to generalize across each task for the same inputs. A popular example of multi-task learning is where the same word embedding is used to learn a distributed representation of words in text that is then shared across multiple different natural language processing supervised learning tasks. [http://machinelearningmastery.com/types-of-learning-in-machine-learning/ 14 Different Types of Learning in Machine Learning | Jason Brownlee - Machine Learning Mastery]   
+
Training a single neural network to apply multiple kinds of labels when inferring, for example, objects seen in an image. Multi-task learning is a type of supervised learning that involves fitting a model on one dataset that addresses multiple related problems. It involves devising a model that can be trained on multiple related tasks in such a way that the performance of the model is improved by training across the tasks as compared to being trained on any single task. Multi-task learning can be a useful approach to problem-solving when there is an abundance of input data labeled for one task that can be shared with another task with much less labeled data. For example, it is common for a multi-task learning problem to involve the same input patterns that may be used for multiple different outputs or supervised learning problems. In this setup, each output may be predicted by a different part of the model, allowing the core of the model to generalize across each task for the same inputs. A popular example of multi-task learning is where the same word [[embedding]] is used to learn a distributed representation of words in text that is then shared across multiple different natural language processing supervised learning tasks. [http://machinelearningmastery.com/types-of-learning-in-machine-learning/ 14 Different Types of Learning in Machine Learning | Jason Brownlee - Machine Learning Mastery]   
  
  
Line 17: Line 20:
 
<youtube>MENYCdm1eis</youtube>
 
<youtube>MENYCdm1eis</youtube>
 
<youtube>ciNBQupWsAc</youtube>
 
<youtube>ciNBQupWsAc</youtube>
<youtube>qb-Lq1mT2-4</youtube>
 

Latest revision as of 19:08, 26 June 2023

YouTube search... ...Google search

Training a single neural network to apply multiple kinds of labels when inferring, for example, objects seen in an image. Multi-task learning is a type of supervised learning that involves fitting a model on one dataset that addresses multiple related problems. It involves devising a model that can be trained on multiple related tasks in such a way that the performance of the model is improved by training across the tasks as compared to being trained on any single task. Multi-task learning can be a useful approach to problem-solving when there is an abundance of input data labeled for one task that can be shared with another task with much less labeled data. For example, it is common for a multi-task learning problem to involve the same input patterns that may be used for multiple different outputs or supervised learning problems. In this setup, each output may be predicted by a different part of the model, allowing the core of the model to generalize across each task for the same inputs. A popular example of multi-task learning is where the same word embedding is used to learn a distributed representation of words in text that is then shared across multiple different natural language processing supervised learning tasks. 14 Different Types of Learning in Machine Learning | Jason Brownlee - Machine Learning Mastery