Difference between revisions of "Benchmarks"

From
Jump to: navigation, search
Line 33: Line 33:
  
 
<youtube>uz_eYqutEG4</youtube>
 
<youtube>uz_eYqutEG4</youtube>
 +
 +
 +
== <span id="SQuAD"></span>The Stanford Question Answering Dataset (SQuAD) ==
 +
* [http://rajpurkar.github.io/SQuAD-explorer/ The Stanford Question Answering Dataset (SQuAD)] 
 +
 +
== <span id="RACE"></span>ReAding Comprehension (RACE) ==
 +
* [http://www.qizhexie.com/data/RACE_leaderboard.html ReAding Comprehension {RACE)]
  
  
Line 42: Line 49:
 
<youtube>0Fuxjq1eiZ4</youtube>
 
<youtube>0Fuxjq1eiZ4</youtube>
 
<youtube>sH03-InVba4</youtube>
 
<youtube>sH03-InVba4</youtube>
 
== <span id="SQuAD"></span>The Stanford Question Answering Dataset (SQuAD) ==
 
* [http://rajpurkar.github.io/SQuAD-explorer/ The Stanford Question Answering Dataset (SQuAD)] 
 
 
== <span id="RACE"></span>ReAding Comprehension (RACE) ==
 
* [http://www.qizhexie.com/data/RACE_leaderboard.html ReAding Comprehension {RACE)]
 

Revision as of 14:05, 24 December 2019

YouTube search... ...Google search


GLUE

The General Language Understanding Evaluation (GLUE) benchmark is a collection of resources for training, evaluating, and analyzing natural language understanding systems. GLUE consists of: A benchmark of nine sentence- or sentence-pair language understanding tasks built on established existing datasets and selected to cover a diverse range of dataset sizes, text genres, and degrees of difficulty, A diagnostic dataset designed to evaluate and analyze model performance with respect to a wide range of linguistic phenomena found in natural language, and A public leaderboard for tracking performance on the benchmark and a dashboard for visualizing the performance of models on the diagnostic set.


The Stanford Question Answering Dataset (SQuAD)

ReAding Comprehension (RACE)


MLPerf

  • MLPerf benchmarks for measuring training and inference performance of ML hardware, software, and services.