Difference between revisions of "...find outliers"

From
Jump to: navigation, search
m
 
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
{{#seo:
 +
|title=PRIMO.ai
 +
|titlemode=append
 +
|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools 
 +
 +
<!-- Google tag (gtag.js) -->
 +
<script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script>
 +
<script>
 +
  window.dataLayer = window.dataLayer || [];
 +
  function gtag(){dataLayer.push(arguments);}
 +
  gtag('js', new Date());
 +
 +
  gtag('config', 'G-4GCWLBVJ7T');
 +
</script>
 +
}}
 +
[https://www.youtube.com/results?search_query=~outlier+~diversity+AI YouTube]
 +
[https://www.quora.com/search?q=~outlier%20diversity%20AI ... Quora]
 +
[https://www.google.com/search?q=~outlier+~diversity+AI ...Google search]
 +
[https://news.google.com/search?q=~outlier+~diversity+AI ...Google News]
 +
[https://www.bing.com/news/search?q=~outlier+~diversity+AI&qft=interval%3d%228%22 ...Bing News]
 +
 +
* [[Embedding]] ... [[Fine-tuning]] ... [[Retrieval-Augmented Generation (RAG)|RAG]] ... [[Agents#AI-Powered Search|Search]] ... [[Clustering]] ... [[Recommendation]] ... [[Anomaly Detection]] ... [[Classification]] ... [[Dimensional Reduction]].  [[...find outliers]]
 
* [[AI Solver]]  
 
* [[AI Solver]]  
* [[Capabilities]]
+
** Looking for event based?
** [[Intruder]]
+
*** [[Bidirectional Long Short-Term Memory (BI-LSTM) with Attention Mechanism]]
** [[Cybersecurity]]
+
** Do you have > 100 features?
** [[Signals]]
+
*** Yes, then try [[One-class Support Vector Machine (SVM)]]
** [[Pathology]]
+
*** No, need fast training, then try [[Principal Component Analysis (PCA)]]-based Anomaly Detection
 +
** Also consider...
 +
*** [[K-Means]] Clustering
 +
*** [[Hierarchical Clustering; Agglomerative (HAC) & Divisive (HDC)]]
 +
*** [[One-class Support Vector Machine (SVM)]]
 +
**** [[Variational Autoencoder (VAE)]]
 +
*** [[Autoencoder (AE) / Encoder-Decoder]]
 +
*** [[Radial Basis Function Network (RBFN)]]
 +
* [https://en.wikipedia.org/wiki/Outlier Outlier | Wikipedia]
 +
* [https://medium.com/@srnghn/machine-learning-trying-to-detect-outliers-or-unusual-behavior-2d9f364334f9 Machine Learning: Trying to detect outliers or unusual behavior | Stacey Ronaghan - Medium]
 +
* [https://pdfs.semanticscholar.org/4c68/4a9ba057fb7e61733ff554fe2975a2c91096.pdf Outlier Detection and Removal Algorithm in K-Means and Hierarchical Clustering | A. Barai and L. Dey]
 +
* [[Cybersecurity]] ... [[Open-Source Intelligence - OSINT |OSINT]] ... [[Cybersecurity Frameworks, Architectures & Roadmaps | Frameworks]] ... [[Cybersecurity References|References]] ... [[Offense - Adversarial Threats/Attacks| Offense]] ... [[National Institute of Standards and Technology (NIST)|NIST]] ... [[U.S. Department of Homeland Security (DHS)| DHS]] ... [[Screening; Passenger, Luggage, & Cargo|Screening]] ... [[Law Enforcement]] ... [[Government Services|Government]] ... [[Defense]] ... [[Joint Capabilities Integration and Development System (JCIDS)#Cybersecurity & Acquisition Lifecycle Integration| Lifecycle Integration]] ... [[Cybersecurity Companies/Products|Products]] ... [[Cybersecurity: Evaluating & Selling|Evaluating]]
 +
* [[Signal Processing]]
 +
* [[Pathology]]
 +
 
  
 +
<hr><center>
 +
<b>Outliers don't necessarily represent abnormal behavior
 +
</b></center>
 +
<hr>
 +
  
Anomaly detection. Sometimes the goal is to identify data points that are simply unusual. In fraud detection, for example, any highly unusual credit card spending patterns are suspect. The possible variations are so numerous and the training examples so few, that it's not feasible to learn what fraudulent activity looks like. The approach that anomaly detection takes is to simply learn what normal activity looks like (using a history non-fraudulent transactions) and identify anything that is significantly different.
+
An Outlier is a rare chance of occurrence within a given data set. In Data Science, an Outlier is an observation point that is distant from other observations. An Outlier may be due to variability in the measurement or it may indicate experimental error. Outliers, being the most extreme observations, may include the sample maximum or sample minimum, or both, depending on whether they are extremely high or low. However, the sample maximum and minimum are not always outliers because they may not be unusually far from other observations. - [https://medium.com/@mehulved1503/outlier-detection-and-anomaly-detection-with-machine-learning-caa96b34b7f6 Outlier Detection and Anomaly Detection with Machine Learning | Mehul Ved - Medium]
_______________________________________________.
 
  
Do you have > 100 features?
 
  
* Yes, then try [[One-class Support Vector Machine (SVM)]]
+
<youtube>MUcrGtLKK7I</youtube>
* No, need fast training, then try [[Principle Component Analysis (PCA)]]-based Anomaly Detection
+
<youtube>QaVL4Ht3u8w</youtube>

Latest revision as of 04:36, 13 September 2023

YouTube ... Quora ...Google search ...Google News ...Bing News



Outliers don't necessarily represent abnormal behavior



An Outlier is a rare chance of occurrence within a given data set. In Data Science, an Outlier is an observation point that is distant from other observations. An Outlier may be due to variability in the measurement or it may indicate experimental error. Outliers, being the most extreme observations, may include the sample maximum or sample minimum, or both, depending on whether they are extremely high or low. However, the sample maximum and minimum are not always outliers because they may not be unusually far from other observations. - Outlier Detection and Anomaly Detection with Machine Learning | Mehul Ved - Medium