Difference between revisions of "Generative Pre-trained Transformer (GPT)"
m (→Let's build GPT: from scratch, in code, spelled out | Andrej Karpathy) |
m |
||
| (184 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
| − | |keywords=artificial, intelligence, machine, learning, models | + | |keywords=ChatGPT, artificial, intelligence, machine, learning, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools |
| − | |description=Helpful resources for your journey with artificial intelligence; | + | |
| + | <!-- Google tag (gtag.js) --> | ||
| + | <script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script> | ||
| + | <script> | ||
| + | window.dataLayer = window.dataLayer || []; | ||
| + | function gtag(){dataLayer.push(arguments);} | ||
| + | gtag('js', new Date()); | ||
| + | |||
| + | gtag('config', 'G-4GCWLBVJ7T'); | ||
| + | </script> | ||
}} | }} | ||
| − | [https://www.youtube.com/results?search_query=Generative+Pre+trained+Transformer | + | [https://www.youtube.com/results?search_query=Generative+Pre+trained+Transformer+GPT YouTube] |
| − | [https://www.google.com/search?q=Generative+Pre+trained+Transformer | + | [https://www.quora.com/search?q=Generative%20Pre%20trained%20Transformer%20%GPT ... Quora] |
| + | [https://www.google.com/search?q=Generative+Pre+trained+Transformer+GPT ...Google search] | ||
| + | [https://news.google.com/search?q=Generative+Pre+trained+Transformer+GPT ...Google News] | ||
| + | [https://www.bing.com/news/search?q=Generative+Pre+trained+Transformer+GPT&qft=interval%3d%228%22 ...Bing News] | ||
| − | * [[ | + | * [[Large Language Model (LLM)]] ... [[Large Language Model (LLM)#Multimodal|Multimodal]] ... [[Foundation Models (FM)]] ... [[Generative Pre-trained Transformer (GPT)|Generative Pre-trained]] ... [[Transformer]] ... [[Attention]] ... [[Generative Adversarial Network (GAN)|GAN]] ... [[Bidirectional Encoder Representations from Transformers (BERT)|BERT]] |
| − | ** [[ | + | * [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing/Copilot]] | [[Microsoft]] ... [[Gemini]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[phind]] ... [[Ernie]] | [[Baidu]] |
| − | ** [[ | + | * [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation (NLG)]] ... [[Natural Language Classification (NLC)|Classification (NLC)]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding (NLU)]] ... [[Language Translation|Translation]] ... [[Summarization]] ... [[Sentiment Analysis|Sentiment]] ... [[Natural Language Tools & Services|Tools]] |
| + | * [[Agents]] ... [[Robotic Process Automation (RPA)|Robotic Process Automation]] ... [[Assistants]] ... [[Personal Companions]] ... [[Personal Productivity|Productivity]] ... [[Email]] ... [[Negotiation]] ... [[LangChain]] | ||
| + | * [[What is Artificial Intelligence (AI)? | Artificial Intelligence (AI)]] ... [[Generative AI]] ... [[Machine Learning (ML)]] ... [[Deep Learning]] ... [[Neural Network]] ... [[Reinforcement Learning (RL)|Reinforcement]] ... [[Learning Techniques]] | ||
| + | * [[Sequence to Sequence (Seq2Seq)]] | ||
| + | * [[Recurrent Neural Network (RNN)]] | ||
| + | * [[Long Short-Term Memory (LSTM)]] | ||
| + | * [[ELMo]] | ||
| + | * [[Bidirectional Encoder Representations from Transformers (BERT)]] ... a better model, but less investment than the larger [[OpenAI]] organization | ||
| + | * [https://openai.com/blog/gpt-2-6-month-follow-up/ OpenAI Blog] | [[OpenAI]] | ||
* [[Text Transfer Learning]] | * [[Text Transfer Learning]] | ||
| − | * [[ | + | * [[Video/Image]] ... [[Vision]] ... [[Enhancement]] ... [[Fake]] ... [[Reconstruction]] ... [[Colorize]] ... [[Occlusions]] ... [[Predict image]] ... [[Image/Video Transfer Learning]] |
| − | + | [[Writing/Publishing#SynthPub|Writing/Publishing - SynthPub]] | |
| − | |||
| − | |||
| − | |||
* [https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf Language Models are Unsupervised Multitask Learners | Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever] | * [https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf Language Models are Unsupervised Multitask Learners | Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever] | ||
* [https://neural-monkey.readthedocs.io/en/latest/machine_translation.html Neural Monkey | Jindřich Libovický, Jindřich Helcl, Tomáš Musil] Byte Pair Encoding (BPE) enables NMT model translation on open-vocabulary by encoding rare and unknown words as sequences of subword units. | * [https://neural-monkey.readthedocs.io/en/latest/machine_translation.html Neural Monkey | Jindřich Libovický, Jindřich Helcl, Tomáš Musil] Byte Pair Encoding (BPE) enables NMT model translation on open-vocabulary by encoding rare and unknown words as sequences of subword units. | ||
| − | |||
| − | |||
| − | |||
| − | |||
* [https://github.com/openai/gpt-2 Language Models are Unsupervised Multitask Learners - GitHub] | * [https://github.com/openai/gpt-2 Language Models are Unsupervised Multitask Learners - GitHub] | ||
* [https://www.infoq.com/news/2019/11/microsoft-ai-conversation/ Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ] - trained on over 147M dialogs | * [https://www.infoq.com/news/2019/11/microsoft-ai-conversation/ Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ] - trained on over 147M dialogs | ||
* [https://github.com/karpathy/minGPT minGPT | Andrej Karpathy - GitHub] | * [https://github.com/karpathy/minGPT minGPT | Andrej Karpathy - GitHub] | ||
* [https://sambanova.ai/solutions/gpt/ SambaNova Systems] ... Dataflow-as-a-Service GPT | * [https://sambanova.ai/solutions/gpt/ SambaNova Systems] ... Dataflow-as-a-Service GPT | ||
| − | * [https://www.reuters.com/technology/facebook-owner-meta-opens-access-ai-large-language-model-2022-05-03/ Facebook-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters] ... [[Facebook]] 175-billion-parameter language model - Open Pretrained Transformer (OPT-175B) | + | * [https://www.reuters.com/technology/facebook-owner-meta-opens-access-ai-large-language-model-2022-05-03/ [[Meta|Facebook]]-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters] ... [[Meta|Facebook]] 175-billion-parameter language model - Open Pretrained Transformer (OPT-175B) |
| + | * [https://lilianweng.github.io/posts/2018-06-24-attention/ Resource on Transformers | Lilian Weng - Lil'Log] | ||
| + | |||
| + | <img src=https://production-media.paperswithcode.com/methods/Screen_Shot_2020-05-27_at_12.41.44_PM.png width="1000"> | ||
| + | * [https://paperswithcode.com/method/gpt GPT | Papers With Code] | ||
| + | |||
| + | |||
| + | |||
| + | <hr> | ||
| + | |||
| + | |||
| + | <b><span id="Try"></span>Try...</b> | ||
| + | |||
| + | * [https://twitter.com/sushant_kumar Sushant Kumar]'s micro-site - Replace your 'word' in the following URL to see what GPT-3 generates: https://thoughts.sushant-kumar.com/word | ||
| + | * [https://serendipityrecs.com/ Serendipity] ...an AI powered recommendation engine for anything you want. | ||
| + | * [https://www.taglines.ai/ Taglines.ai] ... just about every business has a tagline — a short, catchy phrase designed to quickly communicate what it is that they do. | ||
| + | * [https://www.simplify.so/ Simplify.so] ...simple, easy-to-understand explanations for everything | ||
| + | |||
| − | + | <hr> | |
| − | |||
| − | |||
| − | |||
| − | + | {|<!-- T --> | |
| − | + | | valign="top" | | |
| − | + | {| class="wikitable" style="width: 550px;" | |
| − | + | || | |
| − | + | <youtube>5fqxPOaaqi0</youtube> | |
| + | <b>What is GPT-3? Showcase, possibilities, and implications | ||
| + | </b><br>What is going on in AI research lately? GPT-3 crashed the party, let’s see what it is and what it can do. Hoping we do not forget how problematic it might also become. GPT-3 Paper : Brown, Tom B., Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan et al. "Language models are few-shot learners." arXiv preprint arXiv:2005.14165 (2020). https://arxiv.org/pdf/2005.14165.pdf | ||
| + | |} | ||
| + | |<!-- M --> | ||
| + | | valign="top" | | ||
| + | {| class="wikitable" style="width: 550px;" | ||
| + | || | ||
| + | <youtube>G6Z_S6hs29s</youtube> | ||
| + | <b>14 Cool Apps Built on [[OpenAI]]'s GPT-3 API | ||
| + | </b><br>14 Cool applications just built on top of [[OpenAI]]'s GPT-3 (generative predictive transformer) API (currently in private beta). | ||
| + | |} | ||
| + | |}<!-- B --> | ||
| − | + | == <span id="GPT Impact to Development"></span>GPT Impact to Development == | |
| + | * * [[Development]] ...[[Development#AI Pair Programming Tools|AI Pair Programming Tools]] ... [[Analytics]] ... [[Visualization]] ... [[Diagrams for Business Analysis]] | ||
| + | * https://analyticsindiamag.com/will-the-much-hyped-gpt-3-impact-the-coders/ Will The Much-Hyped GPT-3 Impact The Coders? | Analytics India Magazine] | ||
| + | * [https://twitter.com/sharifshameem/status/1283322990625607681 With GPT-3, I built a layout generator where you just describe any layout you want, and it generates the JSX code for you. | Sharif Shameem] - [https://debuild.co/ debuild] | ||
{|<!-- T --> | {|<!-- T --> | ||
| Line 48: | Line 90: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>fZSFNUT6iY8</youtube> |
| − | <b> | + | <b>[[OpenAI]] Model Generates [[Python]] Code |
| − | </b><br> | + | </b><br>Credits: [[Microsoft]], [[OpenAI]] |
|} | |} | ||
|<!-- M --> | |<!-- M --> | ||
| Line 56: | Line 98: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>utuz7wBGjKM</youtube> |
| − | <b> | + | <b>[[OpenAI]] Model Generates Python Code |
| − | </b><br> | + | </b><br>This code completion engine can write an entire function from just the name! [[OpenAI]] demonstrates what happens when you learn a language model on thousands of GitHub [[Python]] repositories. Source Clip: https://youtu.be/fZSFNUT6iY8 |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| Line 76: | Line 107: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>3P3TcKaegbA</youtube> |
| − | <b> | + | <b>Generative Python Code with GPT |
| − | </b><br> | + | </b><br>In a quest to teach neural networks via transformers to write Python code. Project name: Generative Python Transformers! |
|} | |} | ||
|<!-- M --> | |<!-- M --> | ||
| Line 84: | Line 115: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>6SGj2OrTpbI</youtube> |
| − | <b> | + | <b>GPT 3 Explanation And Demo Reaction | Should You Be Scared ? Techies Reaction To GPT3 AI [[OpenAI]] |
| − | </b><br> | + | </b><br>In this video we will look at some of the demos and reactions across social media on GPT-3. The links to the tweets and demo you see in this video have been linked below so please do react out to them if you have any questions. |
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| Line 93: | Line 124: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>w4JYe-oY4HI</youtube> |
| − | <b> | + | <b>Code 10x Faster With This CRAZY New AI Tool (GPT-3) |
| − | </b><br>In this | + | </b><br>In this FREE LIVE training, Aaron and Naz will show you the new cutting edge machine learning AI, [[OpenAI]]'s GPT-3. |
| − | |||
| − | |||
| − | |||
|} | |} | ||
|<!-- M --> | |<!-- M --> | ||
| Line 104: | Line 132: | ||
{| class="wikitable" style="width: 550px;" | {| class="wikitable" style="width: 550px;" | ||
|| | || | ||
| − | <youtube> | + | <youtube>-qizU_v-oqA</youtube> |
| − | <b> | + | <b>Build 2 projects using GPT-3 in just a couple of minutes. Bare bones: branding generator, chat bot |
| − | </b><br> | + | </b><br>Co-founded by Elon Musk [[OpenAI]] wants to make AI safe and accessible. A year ago the startup released GPT-2. That language model was at that time deemed too powerful to release. Eventually [[OpenAI]] made the model available. This year they've trained a much more powerful model at least 1 magnitude larger than GPT-2. I was one of the lucky 750+ people granted access as Beta testers by [[OpenAI]] to see what can be built using the GPT-3 API. The model costs millions of dollars to train which makes it out of reach for most organizations. This video skims the surface of what you can get done with this amazing new model. |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| + | = <span id="Custom GPTs"></span>Custom GPTs = | ||
| + | * [[Agents]] ... [[Robotic Process Automation (RPA)|Robotic Process Automation]] ... [[Assistants]] ... [[Personal Companions]] ... [[Personal Productivity|Productivity]] ... [[Email]] ... [[Negotiation]] ... [[LangChain]] | ||
| + | Custom GPTs are personalized versions of AI models like [[ChatGPT]] that can be tailored for specific tasks or projects. They represent a significant advancement in AI implementation, allowing businesses and individuals to customize AI tools to meet unique challenges and operational needs. | ||
| + | == <span id="OpenAI Platform"></span>OpenAI Platform == | ||
| + | * [https://chat.openai.com/create OpenAI Platform] | ||
| + | [[OpenAI]] allows Plus and Enterprise users to create custom GPTs that can browse the web, create images, and run code. Users can upload knowledge files, modify the GPT's appearance, and define its actions | ||
| − | = | + | === <span id="OpenAI GPT Store"></span>OpenAI GPT Store === |
| + | * [https://chatgpt.com/gpts GPT Store] | ||
| + | The [[OpenAI]] GPT Store provides a platform for users to create, share, and monetize their custom GPTs, expanding the capabilities and possibilities of AI assistants like [[ChatGPT]]. It allows users of [[ChatGPT]] Plus to create and share their own custom chatbots, known as GPTs (Generative Pre-trained Transformers). The GPT Store offers a platform for developers to monetize their custom GPTs and provides a wide range of AI tools and capabilities for users to explore and enhance their AI assistant capabilities | ||
| + | |||
| + | <youtube>2wYcJEcKVPk</youtube> | ||
| + | <youtube>amjnJrfByS0</youtube> | ||
| + | <youtube>VudB3E9tSbc</youtube> | ||
| + | <youtube>SVA-OBl44m4</youtube> | ||
| + | |||
| + | === <span id="OpenAI GPT Builder"></span>OpenAI GPT Builder === | ||
| + | |||
| + | With the GPT Builder, users can tailor GPTs for specific tasks or topics by combining instructions, knowledge, and capabilities. It enables users to build AI agents without the need for coding skills, making it accessible to a wide range of individuals, including educators, coaches, and anyone interested in building helpful tools. | ||
| + | |||
| + | To create a GPT using the GPT Builder, users can access the builder interface through the [[OpenAI]] platform at chat.openai.com/gpts/editor or by selecting "My GPTs" after logging in. The builder interface provides a split screen with a Create panel where users can enter prompts and instructions to build their chatbot, and a Preview panel that allows users to interact with the chatbot as they build it, making it easier to refine and customize the GPT. | ||
| + | |||
| + | The GPT Builder also offers features such as the ability to add images to the GPT, either by asking the builder to create an image or by uploading custom images. Additionally, GPTs can be granted access to web browsing, [[Video/Image#DALL-E | DALL-E]] (an image generation model), and [[OpenAI]]'s Code Interpreter tool for writing and executing software. The builder interface also includes a Knowledge section where users can upload custom data to enhance the capabilities of their GPTs . | ||
| + | |||
| + | <youtube>f2uPl2MlV24</youtube> | ||
| + | <youtube>SjJsXyBTPUc</youtube> | ||
| + | |||
| + | = <span id="Let's build GPT: from scratch, in code, spelled out - Andrej Karpathy"></span>Let's build GPT: from scratch, in code, spelled out - Andrej Karpathy = | ||
| + | * [[What is Artificial Intelligence (AI)? | Artificial Intelligence (AI)]] ... [[Generative AI]] ... [[Machine Learning (ML)]] ... [[Deep Learning]] ... [[Neural Network]] ... [[Reinforcement Learning (RL)|Reinforcement]] ... [[Learning Techniques]] | ||
| + | * [[Development]] ... [[Notebooks]] ... [[Development#AI Pair Programming Tools|AI Pair Programming]] ... [[Codeless Options, Code Generators, Drag n' Drop|Codeless, Generators, Drag n' Drop]] ... [[Algorithm Administration#AIOps/MLOps|AIOps/MLOps]] ... [[Platforms: AI/Machine Learning as a Service (AIaaS/MLaaS)|AIaaS/MLaaS]] | ||
{|<!-- T --> | {|<!-- T --> | ||
| Line 165: | Line 210: | ||
* 00:34:53 training the bigram model | * 00:34:53 training the bigram model | ||
* 00:38:00 port our code to a script Building the "self-attention" | * 00:38:00 port our code to a script Building the "self-attention" | ||
| − | * 00:42:13 version 1: averaging past context with for loops, the weakest form of aggregation | + | * 00:42:13 version 1: averaging past [[context]] with for loops, the weakest form of aggregation |
* 00:47:11 the trick in self-attention: matrix multiply as weighted aggregation | * 00:47:11 the trick in self-attention: matrix multiply as weighted aggregation | ||
* 00:51:54 version 2: using matrix multiply | * 00:51:54 version 2: using matrix multiply | ||
| Line 172: | Line 217: | ||
* 01:00:18 positional encoding | * 01:00:18 positional encoding | ||
* 01:02:00 THE CRUX OF THE VIDEO: version 4: self-attention | * 01:02:00 THE CRUX OF THE VIDEO: version 4: self-attention | ||
| − | * 01:11:38 note 1: attention as communication | + | * 01:11:38 note 1: attention as [[Agents#Communication | communication]] |
* 01:12:46 note 2: attention has no notion of space, operates over sets | * 01:12:46 note 2: attention has no notion of space, operates over sets | ||
| − | * 01:13:40 note 3: there is no communication across batch dimension | + | * 01:13:40 note 3: there is no [[Agents#Communication | communication]] across batch dimension |
* 01:14:14 note 4: encoder blocks vs. decoder blocks | * 01:14:14 note 4: encoder blocks vs. decoder blocks | ||
* 01:15:39 note 5: attention vs. self-attention vs. cross-attention | * 01:15:39 note 5: attention vs. self-attention vs. cross-attention | ||
| Line 220: | Line 265: | ||
* [https://twitter.com/lexfridman Twitter] | * [https://twitter.com/lexfridman Twitter] | ||
* [https://www.linkedin.com/in/lexfridman LinkedIn] | * [https://www.linkedin.com/in/lexfridman LinkedIn] | ||
| − | * [https://www.facebook.com/lexfridman Facebook] | + | * [https://www.facebook.com/lexfridman [[Meta|Facebook]]] |
* [https://www.instagram.com/lexfridman Instagram] | * [https://www.instagram.com/lexfridman Instagram] | ||
* [https://medium.com/@lexfridman Medium] | * [https://medium.com/@lexfridman Medium] | ||
| Line 228: | Line 273: | ||
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
Latest revision as of 09:06, 28 May 2025
YouTube ... Quora ...Google search ...Google News ...Bing News
- Large Language Model (LLM) ... Multimodal ... Foundation Models (FM) ... Generative Pre-trained ... Transformer ... Attention ... GAN ... BERT
- Conversational AI ... ChatGPT | OpenAI ... Bing/Copilot | Microsoft ... Gemini | Google ... Claude | Anthropic ... Perplexity ... You ... phind ... Ernie | Baidu
- Natural Language Processing (NLP) ... Generation (NLG) ... Classification (NLC) ... Understanding (NLU) ... Translation ... Summarization ... Sentiment ... Tools
- Agents ... Robotic Process Automation ... Assistants ... Personal Companions ... Productivity ... Email ... Negotiation ... LangChain
- Artificial Intelligence (AI) ... Generative AI ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
- Sequence to Sequence (Seq2Seq)
- Recurrent Neural Network (RNN)
- Long Short-Term Memory (LSTM)
- ELMo
- Bidirectional Encoder Representations from Transformers (BERT) ... a better model, but less investment than the larger OpenAI organization
- OpenAI Blog | OpenAI
- Text Transfer Learning
- Video/Image ... Vision ... Enhancement ... Fake ... Reconstruction ... Colorize ... Occlusions ... Predict image ... Image/Video Transfer Learning
- Language Models are Unsupervised Multitask Learners | Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever
- Neural Monkey | Jindřich Libovický, Jindřich Helcl, Tomáš Musil Byte Pair Encoding (BPE) enables NMT model translation on open-vocabulary by encoding rare and unknown words as sequences of subword units.
- Language Models are Unsupervised Multitask Learners - GitHub
- Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ - trained on over 147M dialogs
- minGPT | Andrej Karpathy - GitHub
- SambaNova Systems ... Dataflow-as-a-Service GPT
- Facebook-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters ... Facebook 175-billion-parameter language model - Open Pretrained Transformer (OPT-175B)
- Resource on Transformers | Lilian Weng - Lil'Log
Try...
- Sushant Kumar's micro-site - Replace your 'word' in the following URL to see what GPT-3 generates: https://thoughts.sushant-kumar.com/word
- Serendipity ...an AI powered recommendation engine for anything you want.
- Taglines.ai ... just about every business has a tagline — a short, catchy phrase designed to quickly communicate what it is that they do.
- Simplify.so ...simple, easy-to-understand explanations for everything
|
|
Contents
GPT Impact to Development
- * Development ...AI Pair Programming Tools ... Analytics ... Visualization ... Diagrams for Business Analysis
- https://analyticsindiamag.com/will-the-much-hyped-gpt-3-impact-the-coders/ Will The Much-Hyped GPT-3 Impact The Coders? | Analytics India Magazine]
- With GPT-3, I built a layout generator where you just describe any layout you want, and it generates the JSX code for you. | Sharif Shameem - debuild
|
|
|
|
|
|
Custom GPTs
- Agents ... Robotic Process Automation ... Assistants ... Personal Companions ... Productivity ... Email ... Negotiation ... LangChain
Custom GPTs are personalized versions of AI models like ChatGPT that can be tailored for specific tasks or projects. They represent a significant advancement in AI implementation, allowing businesses and individuals to customize AI tools to meet unique challenges and operational needs.
OpenAI Platform
OpenAI allows Plus and Enterprise users to create custom GPTs that can browse the web, create images, and run code. Users can upload knowledge files, modify the GPT's appearance, and define its actions
OpenAI GPT Store
The OpenAI GPT Store provides a platform for users to create, share, and monetize their custom GPTs, expanding the capabilities and possibilities of AI assistants like ChatGPT. It allows users of ChatGPT Plus to create and share their own custom chatbots, known as GPTs (Generative Pre-trained Transformers). The GPT Store offers a platform for developers to monetize their custom GPTs and provides a wide range of AI tools and capabilities for users to explore and enhance their AI assistant capabilities
OpenAI GPT Builder
With the GPT Builder, users can tailor GPTs for specific tasks or topics by combining instructions, knowledge, and capabilities. It enables users to build AI agents without the need for coding skills, making it accessible to a wide range of individuals, including educators, coaches, and anyone interested in building helpful tools.
To create a GPT using the GPT Builder, users can access the builder interface through the OpenAI platform at chat.openai.com/gpts/editor or by selecting "My GPTs" after logging in. The builder interface provides a split screen with a Create panel where users can enter prompts and instructions to build their chatbot, and a Preview panel that allows users to interact with the chatbot as they build it, making it easier to refine and customize the GPT.
The GPT Builder also offers features such as the ability to add images to the GPT, either by asking the builder to create an image or by uploading custom images. Additionally, GPTs can be granted access to web browsing, DALL-E (an image generation model), and OpenAI's Code Interpreter tool for writing and executing software. The builder interface also includes a Knowledge section where users can upload custom data to enhance the capabilities of their GPTs .
Let's build GPT: from scratch, in code, spelled out - Andrej Karpathy
- Artificial Intelligence (AI) ... Generative AI ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
- Development ... Notebooks ... AI Pair Programming ... Codeless, Generators, Drag n' Drop ... AIOps/MLOps ... AIaaS/MLaaS
|
|
