Difference between revisions of "...find outliers"

From
Jump to: navigation, search
m
 
(31 intermediate revisions by the same user not shown)
Line 1: Line 1:
* [[AI Solver]]
+
{{#seo:
 +
|title=PRIMO.ai
 +
|titlemode=append
 +
|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools 
  
Anomaly detection. Sometimes the goal is to identify data points that are simply unusual. In fraud detection, for example, any highly unusual credit card spending patterns are suspect. The possible variations are so numerous and the training examples so few, that it's not feasible to learn what fraudulent activity looks like. The approach that anomaly detection takes is to simply learn what normal activity looks like (using a history non-fraudulent transactions) and identify anything that is significantly different.
+
<!-- Google tag (gtag.js) -->
_______________________________________________.
+
<script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script>
 +
<script>
 +
  window.dataLayer = window.dataLayer || [];
 +
  function gtag(){dataLayer.push(arguments);}
 +
  gtag('js', new Date());
  
Do you have > 100 features?
+
  gtag('config', 'G-4GCWLBVJ7T');
 +
</script>
 +
}}
 +
[https://www.youtube.com/results?search_query=~outlier+~diversity+AI YouTube]
 +
[https://www.quora.com/search?q=~outlier%20diversity%20AI ... Quora]
 +
[https://www.google.com/search?q=~outlier+~diversity+AI ...Google search]
 +
[https://news.google.com/search?q=~outlier+~diversity+AI ...Google News]
 +
[https://www.bing.com/news/search?q=~outlier+~diversity+AI&qft=interval%3d%228%22 ...Bing News]
  
* Yes, then try [[One-class Support Vector Machine (SVM)]]
+
* [[Embedding]] ... [[Fine-tuning]] ... [[Retrieval-Augmented Generation (RAG)|RAG]] ... [[Agents#AI-Powered Search|Search]] ... [[Clustering]] ... [[Recommendation]] ... [[Anomaly Detection]] ... [[Classification]] ... [[Dimensional Reduction]].  [[...find outliers]]
* No, need fast training, then try [[Principal Components Analysis (PCA)-based Anomaly Detection]]
+
* [[AI Solver]]
 +
** Looking for event based?
 +
*** [[Bidirectional Long Short-Term Memory (BI-LSTM) with Attention Mechanism]]
 +
** Do you have > 100 features?
 +
*** Yes, then try [[One-class Support Vector Machine (SVM)]]
 +
*** No, need fast training, then try [[Principal Component Analysis (PCA)]]-based Anomaly Detection
 +
** Also consider...
 +
*** [[K-Means]] Clustering
 +
*** [[Hierarchical Clustering; Agglomerative (HAC) & Divisive (HDC)]]
 +
*** [[One-class Support Vector Machine (SVM)]]
 +
**** [[Variational Autoencoder (VAE)]]
 +
*** [[Autoencoder (AE) / Encoder-Decoder]]
 +
*** [[Radial Basis Function Network (RBFN)]]
 +
* [https://en.wikipedia.org/wiki/Outlier Outlier | Wikipedia]
 +
* [https://medium.com/@srnghn/machine-learning-trying-to-detect-outliers-or-unusual-behavior-2d9f364334f9 Machine Learning: Trying to detect outliers or unusual behavior | Stacey Ronaghan - Medium]
 +
* [https://pdfs.semanticscholar.org/4c68/4a9ba057fb7e61733ff554fe2975a2c91096.pdf Outlier Detection and Removal Algorithm in K-Means and Hierarchical Clustering | A. Barai and L. Dey]
 +
* [[Cybersecurity]] ... [[Open-Source Intelligence - OSINT |OSINT]] ... [[Cybersecurity Frameworks, Architectures & Roadmaps | Frameworks]] ... [[Cybersecurity References|References]] ... [[Offense - Adversarial Threats/Attacks| Offense]] ... [[National Institute of Standards and Technology (NIST)|NIST]] ... [[U.S. Department of Homeland Security (DHS)| DHS]] ... [[Screening; Passenger, Luggage, & Cargo|Screening]] ... [[Law Enforcement]] ... [[Government Services|Government]] ... [[Defense]] ... [[Joint Capabilities Integration and Development System (JCIDS)#Cybersecurity & Acquisition Lifecycle Integration| Lifecycle Integration]] ... [[Cybersecurity Companies/Products|Products]] ... [[Cybersecurity: Evaluating & Selling|Evaluating]]
 +
* [[Signal Processing]]
 +
* [[Pathology]]
 +
 
 +
 
 +
<hr><center>
 +
<b>Outliers don't necessarily represent abnormal behavior
 +
</b></center>
 +
<hr>
 +
 +
 
 +
An Outlier is a rare chance of occurrence within a given data set. In Data Science, an Outlier is an observation point that is distant from other observations. An Outlier may be due to variability in the measurement or it may indicate experimental error. Outliers, being the most extreme observations, may include the sample maximum or sample minimum, or both, depending on whether they are extremely high or low. However, the sample maximum and minimum are not always outliers because they may not be unusually far from other observations. - [https://medium.com/@mehulved1503/outlier-detection-and-anomaly-detection-with-machine-learning-caa96b34b7f6 Outlier Detection and Anomaly Detection with Machine Learning | Mehul Ved - Medium]
 +
 
 +
 
 +
<youtube>MUcrGtLKK7I</youtube>
 +
<youtube>QaVL4Ht3u8w</youtube>

Latest revision as of 04:36, 13 September 2023

YouTube ... Quora ...Google search ...Google News ...Bing News



Outliers don't necessarily represent abnormal behavior



An Outlier is a rare chance of occurrence within a given data set. In Data Science, an Outlier is an observation point that is distant from other observations. An Outlier may be due to variability in the measurement or it may indicate experimental error. Outliers, being the most extreme observations, may include the sample maximum or sample minimum, or both, depending on whether they are extremely high or low. However, the sample maximum and minimum are not always outliers because they may not be unusually far from other observations. - Outlier Detection and Anomaly Detection with Machine Learning | Mehul Ved - Medium