SMART - Multi-Task Deep Neural Networks (MT-DNN)

Youtube search... | ...Google search

• Natural Language Processing (NLP)
• SMART
• Multi-Task Deep Neural Networks for Natural Language Understanding - GitHub

With our recently developed SMART(https://arxiv.org/pdf/1911.03437.pdf) technology, we jointly trained the tasks with MT-DNN and HNN models. Those models are initialized with RoBERTa large model. Parameter Description: All the tasks share the same model structure, while parameters are not shared across tasks.