Difference between revisions of "Generative Pre-trained Transformer (GPT)"
m (→GPT Impact to Development) |
m |
||
(One intermediate revision by the same user not shown) | |||
Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
− | |keywords=artificial, intelligence, machine, learning, models, algorithms, data, singularity, moonshot, | + | |keywords=artificial, intelligence, machine, learning, models, algorithms, data, singularity, moonshot, TensorFlow, Facebook, Google, Nvidia, Microsoft, Azure, Amazon, AWS |
|description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | ||
}} | }} | ||
Line 188: | Line 188: | ||
<youtube>utuz7wBGjKM</youtube> | <youtube>utuz7wBGjKM</youtube> | ||
<b>[[OpenAI]] Model Generates Python Code | <b>[[OpenAI]] Model Generates Python Code | ||
− | </b><br>This code completion engine can write an entire function from just the name! OpenAI demonstrates what happens when you learn a language model on thousands of GitHub Python repositories. Source Clip: http://youtu.be/fZSFNUT6iY8 | + | </b><br>This code completion engine can write an entire function from just the name! [[OpenAI]] demonstrates what happens when you learn a language model on thousands of GitHub [[Python]] repositories. Source Clip: http://youtu.be/fZSFNUT6iY8 |
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
Line 197: | Line 197: | ||
<youtube>y5-wzgIySb4</youtube> | <youtube>y5-wzgIySb4</youtube> | ||
<b>[[OpenAI]] and [[Microsoft]] Can Generate [[Python]] Code | <b>[[OpenAI]] and [[Microsoft]] Can Generate [[Python]] Code | ||
− | </b><br> | + | </b><br>[[OpenAI]] language model was trained on thousands of GitHub repositories using the same unsupervised learning as the GPT models. Build 2020 |
|} | |} | ||
|<!-- M --> | |<!-- M --> | ||
Line 204: | Line 204: | ||
|| | || | ||
<youtube>6SGj2OrTpbI</youtube> | <youtube>6SGj2OrTpbI</youtube> | ||
− | <b>GPT 3 Explanation And Demo Reaction | Should You Be Scared ? Techies Reaction To GPT3 AI OpenAI | + | <b>GPT 3 Explanation And Demo Reaction | Should You Be Scared ? Techies Reaction To GPT3 AI [[OpenAI]] |
</b><br>In this video we will look at some of the demos and reactions across social media on GPT-3. The links to the tweets and demo you see in this video have been linked below so please do react out to them if you have any questions. | </b><br>In this video we will look at some of the demos and reactions across social media on GPT-3. The links to the tweets and demo you see in this video have been linked below so please do react out to them if you have any questions. | ||
|} | |} | ||
Line 296: | Line 296: | ||
== GetBadNews == | == GetBadNews == | ||
− | * [http://getbadnews.com Get Bad News] game - Can you beat my score? Play the fake news game! Drop all pretense of ethics and choose the path that builds your persona as an unscrupulous media magnate. Your task is to get as many followers as you can while | + | * [http://getbadnews.com Get Bad News] game - Can you beat my score? Play the fake news game! Drop all pretense of [[ethics]] and choose the path that builds your persona as an unscrupulous media magnate. Your task is to get as many followers as you can while |
<img src="http://www.getbadnews.com/wp-content/uploads/2018/02/share-score.png" width="500" height="250"> | <img src="http://www.getbadnews.com/wp-content/uploads/2018/02/share-score.png" width="500" height="250"> |
Revision as of 17:17, 8 October 2020
YouTube search... ...Google search
- Case Studies
- Text Transfer Learning
- Natural Language Generation (NLG)
- Generated Image
- OpenAI Blog | OpenAI
- Language Models are Unsupervised Multitask Learners | Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever
- Neural Monkey | Jindřich Libovický, Jindřich Helcl, Tomáš Musil Byte Pair Encoding (BPE) enables NMT model translation on open-vocabulary by encoding rare and unknown words as sequences of subword units.
- Attention Mechanism/Transformer Model
- Bidirectional Encoder Representations from Transformers (BERT)
- ELMo
- Language Models are Unsupervised Multitask Learners - GitHub
- Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ - trained on over 147M dialogs
- minGPT | Andrej Karpathy - GitHub
Contents
Generative Pre-trained Transformer (GPT-3)
- Language Models are Few-Shot Learners | T. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei - arXiv.org
- GPT-3: Demos, Use-cases, Implications | Simon O'Regan - Towards Data Science
- OpenAI API ...today the API runs models with weights from the GPT-3 family with many speed and throughput improvements.
- GPT-3 by OpenAI – Outlook and Examples | Praveen Govindaraj | Medium
- GPT-3 Creative Fiction | R. Gwern
Try...
- Sushant Kumar's micro-site - Replace your 'word' in the following URL to see what GPT-3 generates: http://thoughts.sushant-kumar.com/word
- Serendipity ...an AI powered recommendation engine for anything you want.
- Taglines.ai ... just about every business has a tagline — a short, catchy phrase designed to quickly communicate what it is that they do.
- Simplify.so ...simple, easy-to-understand explanations for everything
|
|
|
|
|
|
|
|
|
|
|
|
GPT Impact to Development
- Development
- http://analyticsindiamag.com/will-the-much-hyped-gpt-3-impact-the-coders/ Will The Much-Hyped GPT-3 Impact The Coders? | Analytics India Magazine]
- With GPT-3, I built a layout generator where you just describe any layout you want, and it generates the JSX code for you. | Sharif Shameem - debuild
|
|
|
|
|
|
Generative Pre-trained Transformer (GPT-2)
- GitHub
- How to Get Started with OpenAIs GPT-2 for Text Generation | Amal Nair - Analytics India Magazine
- GPT-2: It learned on the Internet | Janelle Shane
- Too powerful NLP model (GPT-2): What is Generative Pre-Training | Edward Ma
- GPT-2 A nascent transfer learning method that could eliminate supervised learning some NLP tasks | Ajit Rajasekharan - Medium
- OpenAI Creates Platform for Generating Fake News. Wonderful | Nick Kolakowski - Dice
- InferKit | Adam D King- completes your text.
Coding Train Late Night 2
|
|
r/SubSimulator
Subreddit populated entirely by AI personifications of other subreddits -- all posts and comments are generated automatically using:
results in coherent and realistic simulated content.
GetBadNews
- Get Bad News game - Can you beat my score? Play the fake news game! Drop all pretense of ethics and choose the path that builds your persona as an unscrupulous media magnate. Your task is to get as many followers as you can while