Difference between revisions of "Loop"
m |
m |
||
(21 intermediate revisions by the same user not shown) | |||
Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
− | |keywords=artificial, intelligence, machine, learning, models | + | |keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools |
− | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | + | |
+ | <!-- Google tag (gtag.js) --> | ||
+ | <script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script> | ||
+ | <script> | ||
+ | window.dataLayer = window.dataLayer || []; | ||
+ | function gtag(){dataLayer.push(arguments);} | ||
+ | gtag('js', new Date()); | ||
+ | |||
+ | gtag('config', 'G-4GCWLBVJ7T'); | ||
+ | </script> | ||
}} | }} | ||
− | [https://www.youtube.com/results?search_query=loop+ | + | [https://www.youtube.com/results?search_query=loop+OODA+feedback+ai+reinforcement YouTube] |
− | [https://www.google.com/search?q=loop+ | + | [https://www.quora.com/search?q=loop%20OODA%20feedback%20ai%20reinforcement ... Quora] |
− | + | [https://www.google.com/search?q=loop+OODA+feedback+ai+reinforcement ...Google search] | |
+ | [https://news.google.com/search?q=loop+OODA+feedback+ai+reinforcement ...Google News] | ||
+ | [https://www.bing.com/news/search?q=loop+OODA+feedback+ai+reinforcement&qft=interval%3d%228%22 ...Bing News] | ||
+ | * [[Analytics]] ... [[Visualization]] ... [[Graphical Tools for Modeling AI Components|Graphical Tools]] ... [[Diagrams for Business Analysis|Diagrams]] & [[Generative AI for Business Analysis|Business Analysis]] ... [[Requirements Management|Requirements]] ... [[Loop]] ... [[Bayes]] ... [[Network Pattern]] | ||
* [[Human-in-the-Loop (HITL) Learning]] | * [[Human-in-the-Loop (HITL) Learning]] | ||
− | * [[ | + | * [[What is Artificial Intelligence (AI)? | Artificial Intelligence (AI)]] ... [[Machine Learning (ML)]] ... [[Deep Learning]] ... [[Neural Network]] ... [[Reinforcement Learning (RL)|Reinforcement]] ... [[Learning Techniques]] |
− | * [[ | + | * [[Perspective]] ... [[Context]] ... [[In-Context Learning (ICL)]] ... [[Transfer Learning]] ... [[Out-of-Distribution (OOD) Generalization]] |
− | * [[Causation vs. Correlation]] | + | * [[Causation vs. Correlation]] ... [[Autocorrelation]] ...[[Convolution vs. Cross-Correlation (Autocorrelation)]] |
+ | * [[Embedding]] ... [[Fine-tuning]] ... [[Retrieval-Augmented Generation (RAG)|RAG]] ... [[Agents#AI-Powered Search|Search]] ... [[Clustering]] ... [[Recommendation]] ... [[Anomaly Detection]] ... [[Classification]] ... [[Dimensional Reduction]]. [[...find outliers]] | ||
* [[Algorithm Administration]] | * [[Algorithm Administration]] | ||
− | |||
* [[Policy]] ... [[Policy vs Plan]] ... [[Constitutional AI]] ... [[Trust Region Policy Optimization (TRPO)]] ... [[Policy Gradient (PG)]] ... [[Proximal Policy Optimization (PPO)]] | * [[Policy]] ... [[Policy vs Plan]] ... [[Constitutional AI]] ... [[Trust Region Policy Optimization (TRPO)]] ... [[Policy Gradient (PG)]] ... [[Proximal Policy Optimization (PPO)]] | ||
− | * [[Assistants]] ... [[ | + | * [[Agents]] ... [[Robotic Process Automation (RPA)|Robotic Process Automation]] ... [[Assistants]] ... [[Personal Companions]] ... [[Personal Productivity|Productivity]] ... [[Email]] ... [[Negotiation]] ... [[LangChain]] |
− | * [[Generative AI]] | + | * [[What is Artificial Intelligence (AI)? | Artificial Intelligence (AI)]] ... [[Generative AI]] ... [[Machine Learning (ML)]] ... [[Deep Learning]] ... [[Neural Network]] ... [[Reinforcement Learning (RL)|Reinforcement]] ... [[Learning Techniques]] |
+ | * [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing/Copilot]] | [[Microsoft]] ... [[Gemini]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[phind]] ... [[Ernie]] | [[Baidu]] | ||
* [https://medium.com/intuitionmachine/process-patterns-loops-and-emergence-dff1292cfa78 Process Patterns, Loops and Emergence | Carlos E. Perez - Medium] | * [https://medium.com/intuitionmachine/process-patterns-loops-and-emergence-dff1292cfa78 Process Patterns, Loops and Emergence | Carlos E. Perez - Medium] | ||
Line 41: | Line 54: | ||
<youtube>ndQPdhf30rY</youtube> | <youtube>ndQPdhf30rY</youtube> | ||
<b>Mindset: OODA Loop by [[Creatives#John Richard Boyd|John Boyd]] | <b>Mindset: OODA Loop by [[Creatives#John Richard Boyd|John Boyd]] | ||
− | </b><br>OODA Loop is an acronym which stands for Observe, Orient, Decide and Act. In this video I provide a historical, academic, and practical perspective to help shed some light on the topic. [[Creatives#John Richard Boyd|John Boyd]] is one of the greatest military strategist to have lived, and to understand OODA Loop it's import to put it into [[context]]. If you have any questions or have something to add, please comment down below. Like this content? Consider supporting me on Patreon where you will get exclusive access to unpublished videos, behind the scenes, coupons, and the satisfaction of supporting pro-freedom content. https://www.patreon.com/WeRunGuns Please LIKE, SHARE, and SUBSCRIBE if you enjoyed! | + | </b><br>OODA Loop is an acronym which stands for Observe, Orient, Decide and Act. In this video I provide a historical, academic, and practical [[perspective]] to help shed some light on the topic. [[Creatives#John Richard Boyd|John Boyd]] is one of the greatest military strategist to have lived, and to understand OODA Loop it's import to put it into [[context]]. If you have any questions or have something to add, please comment down below. Like this content? Consider supporting me on Patreon where you will get exclusive access to unpublished videos, behind the scenes, coupons, and the satisfaction of supporting pro-freedom content. https://www.patreon.com/WeRunGuns Please LIKE, SHARE, and SUBSCRIBE if you enjoyed! |
|} | |} | ||
|<!-- M --> | |<!-- M --> | ||
Line 57: | Line 70: | ||
[https://www.google.com/search?q=loop+feedback+machine+learning+reinforcement ...Google search] | [https://www.google.com/search?q=loop+feedback+machine+learning+reinforcement ...Google search] | ||
+ | * [[Gaming]] ... [[Game-Based Learning (GBL)]] ... [[Games - Security|Security]] ... [[Game Development with Generative AI|Generative AI]] ... [[Metaverse#Games - Metaverse|Games - Metaverse]] ... [[Games - Quantum Theme|Quantum]] ... [[Game Theory]] ... [[Game Design | Design]] | ||
* [https://en.wikipedia.org/wiki/Feedback Feedback | Wikipedia] | * [https://en.wikipedia.org/wiki/Feedback Feedback | Wikipedia] | ||
* [https://www.clarifai.com/blog/closing-the-loop-how-feedback-loops-help-to-maintain-quality-long-term-ai-results Closing the Loop: How Feedback Loops Help to Maintain Quality Long-Term AI Results | Natalie Fletcher - Clarifai] | * [https://www.clarifai.com/blog/closing-the-loop-how-feedback-loops-help-to-maintain-quality-long-term-ai-results Closing the Loop: How Feedback Loops Help to Maintain Quality Long-Term AI Results | Natalie Fletcher - Clarifai] | ||
Line 164: | Line 178: | ||
* [https://simonsinek.com/product/start-with-why/ Start With Why | ][[Creatives#Simon Sinek|Simon Sinek]] ...[https://en.wikipedia.org/wiki/Start_with_Why Wikipedia] | * [https://simonsinek.com/product/start-with-why/ Start With Why | ][[Creatives#Simon Sinek|Simon Sinek]] ...[https://en.wikipedia.org/wiki/Start_with_Why Wikipedia] | ||
* [[Loop#Observe–Orient–Decide–Act (OODA) Loop|Observe–Orient–Decide–Act (OODA) Loop]] ...[https://en.wikipedia.org/wiki/OODA_loop Wikipedia] | * [[Loop#Observe–Orient–Decide–Act (OODA) Loop|Observe–Orient–Decide–Act (OODA) Loop]] ...[https://en.wikipedia.org/wiki/OODA_loop Wikipedia] | ||
+ | * [[Perspective]] ... [[Context]] ... [[In-Context Learning (ICL)]] ... [[Transfer Learning]] ... [[Out-of-Distribution (OOD) Generalization]] | ||
The Triple Golden OODA loop diagram depicts a hybrid of concepts from the Triple Loop concept inspired by Chris Argyris & Donald Schön's work on the Double Loop, [[Creatives#Simon Sinek|Simon Sinek]]'s Golden Circle in 'Start with Why', and [[Creatives#John Richard Boyd|Colonel John Boyd]]'s Observe, Orient, Decide and Act (OODA) Loop from his ‘A Discourse On Winning and Losing'. | The Triple Golden OODA loop diagram depicts a hybrid of concepts from the Triple Loop concept inspired by Chris Argyris & Donald Schön's work on the Double Loop, [[Creatives#Simon Sinek|Simon Sinek]]'s Golden Circle in 'Start with Why', and [[Creatives#John Richard Boyd|Colonel John Boyd]]'s Observe, Orient, Decide and Act (OODA) Loop from his ‘A Discourse On Winning and Losing'. | ||
Line 243: | Line 258: | ||
[https://www.google.com/search?q=~Consciousness+feedback+Strange+loop+ai+machine+learning ...Google search] | [https://www.google.com/search?q=~Consciousness+feedback+Strange+loop+ai+machine+learning ...Google search] | ||
+ | * [[Artificial General Intelligence (AGI) to Singularity]] ... [[Inside Out - Curious Optimistic Reasoning| Curious Reasoning]] ... [[Emergence]] ... [[Moonshots]] ... [[Explainable / Interpretable AI|Explainable AI]] ... [[Algorithm Administration#Automated Learning|Automated Learning]] | ||
* [https://www.popularmechanics.com/science/health/a10320/michio-kaku-and-the-mysteries-of-the-mind-16582552/ Michio Kaku and the Mysteries of the Mind | Alyson Sheppard - Popular Mechanics] ...The Future of the Mind: The Scientific Quest to Understand, Enhance, and Empower the Mind | * [https://www.popularmechanics.com/science/health/a10320/michio-kaku-and-the-mysteries-of-the-mind-16582552/ Michio Kaku and the Mysteries of the Mind | Alyson Sheppard - Popular Mechanics] ...The Future of the Mind: The Scientific Quest to Understand, Enhance, and Empower the Mind | ||
* [https://medium.com/@tylerneylon/a-theory-of-consciousness-d5866b2f8fce A Theory of Consciousness | Tyler Neylon - Medium] | * [https://medium.com/@tylerneylon/a-theory-of-consciousness-d5866b2f8fce A Theory of Consciousness | Tyler Neylon - Medium] | ||
Line 249: | Line 265: | ||
* [https://www.pulitzer.org/winners/douglas-r-hofstadter Godel, Escher, Bach: an Eternal Golden Braid | Douglas R. Hofstadter] | * [https://www.pulitzer.org/winners/douglas-r-hofstadter Godel, Escher, Bach: an Eternal Golden Braid | Douglas R. Hofstadter] | ||
** [https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach Gödel, Escher, Bach | Wikipedia] | ** [https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach Gödel, Escher, Bach | Wikipedia] | ||
− | * [[ | + | * [[Simulation]] ... [[Simulated Environment Learning]] ... [[World Models]] ... [[Minecraft]]: [[Minecraft#Voyager|Voyager]] |
{|<!-- T --> | {|<!-- T --> | ||
Line 575: | Line 591: | ||
* [https://www.packetlabs.net/purple-team/ Purple Team: When Red and Blue Teams Work Together | Packetlabs] | * [https://www.packetlabs.net/purple-team/ Purple Team: When Red and Blue Teams Work Together | Packetlabs] | ||
− | Modern security organizations create new capabilities within an overall cyber defense team by organizing themselves around a fundamental concept of an “OODA loop” — enabling teams to quickly make necessary decisions as they are responding to live or simulated incidents. ... Handling incidents effectively requires this sort of cyclical and quick decision making. In this quick-decision cycle, the IR team becomes the Blue Team, the “attackers” comprise the Red Team and run attack scenarios, and an even more novel third team called the Purple Team proactively hunts the attackers. This structure allows organizations to “train like they fight,” enabling them to prepare for increasingly more advanced adversarial techniques....Purple Teams help optimize security detection processes within an organization by reproducing attacks, determining if successful detection of these attacks occurred, and exposing existing deficiencies within the organization’s IR plan. [https://medium.com/@bogov/improving-cyber-defense-by-purple-team-using-ooda-loop-ae0459bbe734 Improving Cyber Defense by Purple Team using OODA loop | Ozren (Oz) Bogovac - Medium] | + | Modern security organizations create new capabilities within an overall cyber defense team by organizing themselves around a fundamental concept of an “OODA loop” — enabling teams to quickly make necessary decisions as they are responding to live or [[Simulation | simulated incidents]]. ... Handling incidents effectively requires this sort of cyclical and quick decision making. In this quick-decision cycle, the IR team becomes the Blue Team, the “attackers” comprise the Red Team and run attack scenarios, and an even more novel third team called the Purple Team proactively hunts the attackers. This structure allows organizations to “train like they fight,” enabling them to prepare for increasingly more advanced adversarial techniques....Purple Teams help optimize security detection processes within an organization by reproducing attacks, determining if successful detection of these attacks occurred, and exposing existing deficiencies within the organization’s IR plan. [https://medium.com/@bogov/improving-cyber-defense-by-purple-team-using-ooda-loop-ae0459bbe734 Improving Cyber Defense by Purple Team using OODA loop | Ozren (Oz) Bogovac - Medium] |
<img src="https://cdn.packetlabs.net/wp-content/uploads/2019/09/10115222/purple-team-fig2.png" width="700"> | <img src="https://cdn.packetlabs.net/wp-content/uploads/2019/09/10115222/purple-team-fig2.png" width="700"> |
Latest revision as of 12:06, 6 November 2024
YouTube ... Quora ...Google search ...Google News ...Bing News
- Analytics ... Visualization ... Graphical Tools ... Diagrams & Business Analysis ... Requirements ... Loop ... Bayes ... Network Pattern
- Human-in-the-Loop (HITL) Learning
- Artificial Intelligence (AI) ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
- Perspective ... Context ... In-Context Learning (ICL) ... Transfer Learning ... Out-of-Distribution (OOD) Generalization
- Causation vs. Correlation ... Autocorrelation ...Convolution vs. Cross-Correlation (Autocorrelation)
- Embedding ... Fine-tuning ... RAG ... Search ... Clustering ... Recommendation ... Anomaly Detection ... Classification ... Dimensional Reduction. ...find outliers
- Algorithm Administration
- Policy ... Policy vs Plan ... Constitutional AI ... Trust Region Policy Optimization (TRPO) ... Policy Gradient (PG) ... Proximal Policy Optimization (PPO)
- Agents ... Robotic Process Automation ... Assistants ... Personal Companions ... Productivity ... Email ... Negotiation ... LangChain
- Artificial Intelligence (AI) ... Generative AI ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
- Conversational AI ... ChatGPT | OpenAI ... Bing/Copilot | Microsoft ... Gemini | Google ... Claude | Anthropic ... Perplexity ... You ... phind ... Ernie | Baidu
- Process Patterns, Loops and Emergence | Carlos E. Perez - Medium
Contents
- 1 Observe–Orient–Decide–Act (OODA) Loop
- 2 Feedback Loop
- 3 Multi-Loop Learning
- 4 Triple Golden OODA
- 5 Feedback Loop - Peer Learning
- 6 Feedback Loop - Creating Consciousness
- 7 Feedback Loop - Scientific Discovery
- 8 Feedback Loop - Stock Market Predictions
- 9 Feedback Loop - The AI Economist
- 10 Feedback Loop - Synthetic
- 11 Recursion
- 12 Unintended Feedback Loop
- 13 Using the OODA Loop - Purple Team with Cybersecurity
- 14 OODA Loop - Security Approaches
Observe–Orient–Decide–Act (OODA) Loop
YouTube search... ...Google search
The OODA loop is the cycle: Observe–Orient–Decide–Act ...emphasized that "the loop" is actually a set of interacting loops that are to be kept in continuous operation... developed by military strategist and United States Air Force Colonel John Boyd. Boyd applied the concept to the combat operations process, often at the operational level during military campaigns. It is now also often applied to understand commercial operations and learning processes. The approach explains how agility can overcome raw power in dealing with human opponents. It is especially applicable to cyber security and cyberwarfare. Wikipedia ... A Discourse On Winning and Losing | John R. Boyd - Air University Press
We’ve historically focused automation efforts on the “Act” portion but the real potential for new technologies is to address the prior 3 steps: Improving Observation: Improve the data itself with better sensing accuracy, timeliness, relevance, etc or improve our ability to use the data with higher throughput learning processes Improving Orientation: Improve the classification of the current state and the prediction of future states
Improving Decision: Improve the ability to choose between paths via better objective functions. How Artificial Intelligence is Closing the Loop with Better Predictions | Erik Trautman - HackerNoon]
|
|
Feedback Loop
YouTube search... ...Google search
- Gaming ... Game-Based Learning (GBL) ... Security ... Generative AI ... Games - Metaverse ... Quantum ... Game Theory ... Design
- Feedback | Wikipedia
- Closing the Loop: How Feedback Loops Help to Maintain Quality Long-Term AI Results | Natalie Fletcher - Clarifai
- So, What Actually Is a Feedback Loop? | Tina Nord - Ultimate Knowledge ...With feedback loops, a system is constantly in dialogue with itself.
- AI in the Feedback Loop: A Survey of Alternative Approaches | Karl-ErikÅrzén - ScienceDirect ...paper gives special attention to fuzzy control and expert control.
- Feedback Loops in Machine Learning | Ankur Goyal - Impair ...in spite of the immense benefits that Machine Learning offers, this technology has been very slow to take off, particularly in the enterprise world. At Impira, we believe a key reason for this is the lack of well-designed feedback loops that serve to continuously improve machine learning models.
- HP200A | Wikipedia ...oscillator to use a simple light bulb as the temperature-dependent resistor in its feedback network. Walt Disney bought eight HP200A for use in the production of Fantasia
- The Air Force Research Lab wants tools, techniques and innovative ideas for shortening the OODA Loop. | Aaron Boyd - Nextgov
any process where the outputs of a system are plugged back in and used as iterative inputs. Feedback loops exist just about everywhere. In nature, the evolutionary "arms race" between predators and prey is a classic example. In business, the practice of taking customer feedback (the output of a product or service) and using it to improve future processes is another commonly used feedback loop. Today, rapid advances in artificial intelligence (AI) and machine learning are helping businesses do more with data. These systems — and their ability to analyze an inhuman amount of data — allow businesses to adjust algorithms, workflows and processes on the fly. Get More Out Of Feedback Loops With AI | Arka Dhar - Forbes
|
|
Multi-Loop Learning
YouTube search... ...Google search
- How Artificial Intelligence Will Redefine Management | V. Kolbjørnsrud, R. Amico and R.J. Thomas
- Chris Argyris: theories of action, double-loop learning and organizational learning | Infed.org
- Donald Schon (Schön): learning, reflection and change | Infed.org
- Organisational learning: a critical review | Catherine L. Wang, Pervaiz K. Ahmed
- Single and double loop learning | Organizational Learning
- Double-loop learning | Wikipedia
- Re-Framing Perspectives | Patrick A. Trottier - The Institute Of Emergent Organizational Development and Emergent Change®
- Working visually: Record, Reflect, Reframe, Part 1 Part 2 | Kim S van den Berg
- Different Kinds of Learning (Loops of Learning) Adapted from “Field Guide to Consulting and Organizational Development”
|
|
|
|
|
|
Triple Golden OODA
YouTube search... ...Google search
- Context ... the next AI frontier
- Multi-Loop Learning
- Start With Why | Simon Sinek ...Wikipedia
- Observe–Orient–Decide–Act (OODA) Loop ...Wikipedia
- Perspective ... Context ... In-Context Learning (ICL) ... Transfer Learning ... Out-of-Distribution (OOD) Generalization
The Triple Golden OODA loop diagram depicts a hybrid of concepts from the Triple Loop concept inspired by Chris Argyris & Donald Schön's work on the Double Loop, Simon Sinek's Golden Circle in 'Start with Why', and Colonel John Boyd's Observe, Orient, Decide and Act (OODA) Loop from his ‘A Discourse On Winning and Losing'.
|
|
Feedback Loop - Peer Learning
YouTube search... ...Google search
- Education
- Decentralized: Federated & Distributed Learning
- FeedbackFruits
- The NIPS experiment | Eric Price - A blog on machine learning very broadly construed by Moritz Hardt
|
|
|
|
Feedback Loop - Creating Consciousness
YouTube search... ...Google search
- Artificial General Intelligence (AGI) to Singularity ... Curious Reasoning ... Emergence ... Moonshots ... Explainable AI ... Automated Learning
- Michio Kaku and the Mysteries of the Mind | Alyson Sheppard - Popular Mechanics ...The Future of the Mind: The Scientific Quest to Understand, Enhance, and Empower the Mind
- A Theory of Consciousness | Tyler Neylon - Medium
- Do Loops Explain Consciousness? | Martin Gardner - AMS.org ...Review of I Am a Strange Loop
- Strange Loop | Wikipedia ...The "strangeness" of a strange loop comes from our way of perception
- Godel, Escher, Bach: an Eternal Golden Braid | Douglas R. Hofstadter
- Simulation ... Simulated Environment Learning ... World Models ... Minecraft: Voyager
|
|
|
|
Feedback Loop - Scientific Discovery
YouTube search... ...Google search
- Scientific discovery must be redefined. Quantum and AI can help | Dario Gil - World Economic Forum
- Can Artificial Intelligence Make Scientific Discoveries? | Kartik Hosanagar - The Scientist
- Can artificial intelligence lead scientific discoveries? | University of Konstanz - EurekAlert!
The paradigm shift will be from AI used for analysing the data which has already been obtained, to AI deciding what to measure next. Why Artificial Intelligence Will Enable New Scientific Discoveries - Andrew Briggs - Graphcore
Quantum Computing and AI to Enable Our Sustainable Future | Katia Moskvitch - IBM
|
|
Feedback Loop - Stock Market Predictions
YouTube search... ...Google search
Why you can beat the market, even when it does not seem so. The importance of loops, patterns, and predictable events. Random events are don’t measure risks, and should not affect your decision making. Some traders follow the trend, and some go against it. At I Know First we work on algorithmic strategies which are neither, we simply try an assess where the next opportunity is and provide stock market predictions. If this means to do what everyone else does, than why not. If it means going against when everyone else does, this is also fine. The tricky part is determining where this opportunities are, this article will discuss how to find opportunities in what can seem as total randomness. Markets are Complex, but not Unpredictable! There are two major misconceptions about the stock market. The first one is connected to the classical economic theory which claims markets to be efficient, and as such unpredictable. In this case trying to select one stock over another becomes useless, as no opportunity is ever better than the other. Both stocks are perfectly priced according to their opportunity and risk, with everyone having all information. However, the truth of the matter is that some people profit trading stocks while others lose – this by itself proves the market to be inefficient, and thus exploitable. While US markets are very efficient, and most information is available, not everyone interprets this information the same. Stock Market Predictions: Where In The Feedback Loop Is Your Portfolio? | I Know First
|
Feedback Loop - The AI Economist
YouTube search... ...Google search
Optimal Tax Design as Learned Reward Design Using Reinforcement Learning. Reinforcement learning is a powerful framework in which agents learn from experience collected through trial-and-error. We use model-free RL, in which agents do not use any prior world knowledge or modeling assumptions. Another benefit of RL is that agents can optimize for any objective. In our setting, this means that a tax policy can be learned that optimizes any social objective, and without knowledge of workers’ utility functions or skills. The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policies | S. Zheng, A. Trott, S. Srinivasa, N. Naik, M. Gruesbeck, D. Parkes, and R. Socher - Einstein.ai]
|
Feedback Loop - Synthetic
YouTube search... ...Google search
|
Recursion
YouTube search... ...Google search
|
|
|
|
Unintended Feedback Loop
YouTube search... ...Google search
- Bias and Variances
- Unintended consequences from existing AI | Wikipedia
- Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy | Cathy O'Neil
- The Toxic Potential of YouTube’s Feedback Loop | Guillaume Chaslot - Wired
- The Unintended Consequences of Machine Learning | Frank Kane - Sundog Education - KDnuggets
- Dangerous Feedback Loops in ML | David Blaszka - Towards Data Science
- The Negative Feedback Loop: Technology Needs To Know When It Gets Things Wrong | Fiona McEvoy - You The Data ...This is not a secret problem. AI developers are painfully aware that there is currently no straightforward way to combat biased data or solicit full feedback. However, increasingly they are making efforts to harvest this critical information wherever and however they can. Not just in the name of ethics, but also to ensure that their creations perform as accurately as possible.
Models that are an integrated part of a product experience, or what we referred to as data products, often involve feedback loops. When done right, feedback loops can help us to create better experiences. However, feedback loops can also create unintended negative consequences, such as bias or inaccurate model performance measurements... Getting Better at Machine Learning | Robert Chang - Medium
Leaders hoping to shift their posture from hindsight to foresight need to better understand the types of risks they are taking on, their interdependencies, and their underlying causes... Confronting the risks of artificial intelligence | B. Cheatham, K. Javanmardian, and H. Samandari - Mckinsey & Company
One of the key features of live ML systems is that they often end up influencing their own behavior if they update over time. This leads to a form of analysis debt, in which it is difficult to predict the behavior of a given model before it is released. These feedback loops can take different forms, but they are all more difficult to detect and address if they occur gradually over time, as may be the case when models are updated infrequently.
- Direct Feedback Loops. A model may directly influence the selection of its own future training data. It is common practice to use standard supervised algorithms, although the theoretically correct solution would be to use bandit algorithms. The problem here is that bandit algorithms (such as contextual bandits) do not necessarily scale well to the size of action spaces typically required for real-world problems. It is possible to mitigate these effects by using some amount of randomization, or by isolating certain parts of data from being influenced by a given model.
- Hidden Feedback Loops. Direct feedback loops are costly to analyze, but at least they pose a statistical challenge that ML researchers may find natural to investigate. A more difficult case is hidden feedback loops, in which two systems influence each other indirectly through the world. One example of this may be if two systems independently determine facets of a web page, such as
one selecting products to show and another selecting related reviews. Improving one system may lead to changes in behavior in the other, as users begin clicking more or less on the other components in reaction to the changes. Note that these hidden loops may exist between completely disjoint systems. Consider the case of two stock-market prediction models from two different investment companies. Improvements (or, more scarily, bugs) in one may influence the bidding and buying behavior of the other. Hidden Technical Debt in Machine Learning Systems | D. Sculley, G. Holt, D. Golovin, E. Davydov, T. Phillips, D. Ebner, V. Chaudhary, M. Young, J. Crespo, and D. Dennison - Google
When the system is retrained on future data, it may become not less but more detrimental to historically disadvantaged groups. In order to build AI systems that are aligned with desirable long-term societal outcomes, we need to understand when and why such negative feedback loops occur, and we need to learn how to prevent them. When bias begets bias: A source of negative feedback loops in AI systems | Lydia T. Liu - University of California, Berkeley - Microsoft Research Blog
|
|
Unintended Feedback Loop - Filter Bubbles
YouTube search... ...Google search
In December 2009, Google began customizing its search results for all users, and we entered a new era of personalization. With little notice or fanfare, our online experience is changing, as the websites we visit are increasingly tailoring themselves to us. In this engaging and visionary book, MoveOn.org board president Eli Pariser lays bare the personalization that is already taking place on every major website, from Facebook to AOL to ABC News. As Pariser reveals, this new trend is nothing short of an invisible revolution in how we consume information, one that will shape how we learn, what we know, and even how our democracy works. The Filter Bubble | Eli Pariser
In news media, echo chamber is a metaphorical description of a situation in which beliefs are amplified or reinforced by communication and repetition inside a closed system. Filter Bubble | Wikipedia
|
|
|
|
Using the OODA Loop - Purple Team with Cybersecurity
YouTube search... ...Google search
- MITRE ATT&CK™
- The Cyber OODA Loop, How Your Attacker Should Help You Design Your Defense | Tony Sager - The Center for Internet Security - NIST
- The 4 Phases of Effective Incident Response Decision Making | Andrew Cook - Praetorian
- OODA and Cybersecurity | INFOSEC
- Red Team VS Blue Team: What’s The Difference? | Jason Firch - PurpleSec
- Purple Team: When Red and Blue Teams Work Together | Packetlabs
Modern security organizations create new capabilities within an overall cyber defense team by organizing themselves around a fundamental concept of an “OODA loop” — enabling teams to quickly make necessary decisions as they are responding to live or simulated incidents. ... Handling incidents effectively requires this sort of cyclical and quick decision making. In this quick-decision cycle, the IR team becomes the Blue Team, the “attackers” comprise the Red Team and run attack scenarios, and an even more novel third team called the Purple Team proactively hunts the attackers. This structure allows organizations to “train like they fight,” enabling them to prepare for increasingly more advanced adversarial techniques....Purple Teams help optimize security detection processes within an organization by reproducing attacks, determining if successful detection of these attacks occurred, and exposing existing deficiencies within the organization’s IR plan. Improving Cyber Defense by Purple Team using OODA loop | Ozren (Oz) Bogovac - Medium
|
|
OODA Loop - Security Approaches
YouTube search... ...Google search
|
|