Difference between revisions of "Bias and Variances"
m |
m |
||
| Line 17: | Line 17: | ||
** [[Train, Validate, and Test]] | ** [[Train, Validate, and Test]] | ||
** [[Algorithm Administration#Model Monitoring|Model Monitoring]] | ** [[Algorithm Administration#Model Monitoring|Model Monitoring]] | ||
| − | |||
| − | |||
* [http://becominghuman.ai/a-basic-recipe-for-machine-learning-2fbebd3549f5 A Basic Recipe for Machine Learning | Hafidz Zulkifli] | * [http://becominghuman.ai/a-basic-recipe-for-machine-learning-2fbebd3549f5 A Basic Recipe for Machine Learning | Hafidz Zulkifli] | ||
* [http://en.wikipedia.org/wiki/Inductive_bias Inductive Bias | Wikipedia] | * [http://en.wikipedia.org/wiki/Inductive_bias Inductive Bias | Wikipedia] | ||
| Line 26: | Line 24: | ||
* [http://www.analyticsindiamag.com/top-6-common-statistical-errors-made-data-scientists/ Top 6 most common statistical errors made by data scientists | Richa Bhatia - Analytics India] | * [http://www.analyticsindiamag.com/top-6-common-statistical-errors-made-data-scientists/ Top 6 most common statistical errors made by data scientists | Richa Bhatia - Analytics India] | ||
* [http://towardsdatascience.com/data-science-concepts-explained-to-a-five-year-old-ad440c7b3cbd Data Science Concepts Explained to a Five-year-old | Megan Dibble - Toward Data Science] | * [http://towardsdatascience.com/data-science-concepts-explained-to-a-five-year-old-ad440c7b3cbd Data Science Concepts Explained to a Five-year-old | Megan Dibble - Toward Data Science] | ||
| − | + | ||
| − | + | Two terms of <b>bias</b> in Artificial Intelligence: | |
| − | + | ||
| + | # <b>Node Bias</b> - The activation of a node in a neural network is determined by the following: output = activation function (dot_product(weights, inputs) + bias) This means when calculating the output of a node, the inputs are multiplied by weights, and a bias value is added to the result. The bias value allows the activation function to be shifted to the left or right, to better fit the data. Hence changes to the weights alter the steepness of the sigmoid curve, whilst the bias offsets it, shifting the entire curve so it fits better. Note also how the bias only influences the output values, it doesn’t interact with the actual input data. [http://medium.com/deeper-learning/glossary-of-deep-learning-bias-cf49d9c895e2 Glossary of Deep Learning: Bias | Jaron Collis - Deeper Learning] | ||
| + | # <b>Model Bias</b> - Bias can creep into algorithms in several ways. AI systems learn to make decisions based on training data, which can include biased human decisions or reflect historical or social inequities, even if sensitive variables such as gender, race, or sexual orientation are removed. [http://hbr.org/2019/10/what-do-we-do-about-the-biases-in-ai#:~:text=Bias%20can%20creep%20into%20algorithms,or%20sexual%20orientation%20are%20removed.&text=Bias%20is%20all%20of%20our%20responsibility. What Do We Do About the Biases in AI? | J. Manyika, J. Silberg, and B. Presten - Harvard Business Review] | ||
| + | = Node Bias = | ||
http://cdn-images-1.medium.com/max/800/1*RvLVTYBiRXogAr6Ap5jgLA.png | http://cdn-images-1.medium.com/max/800/1*RvLVTYBiRXogAr6Ap5jgLA.png | ||
| Line 87: | Line 88: | ||
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| + | |||
| + | |||
| + | * [http://ai.googleblog.com/2017/08/exploring-and-visualizing-open-global.html Exploring and Visualizing an Open Global Dataset | Reena Jana and Josh Lovejoy] | ||
| + | |||
| + | http://4.bp.blogspot.com/-KbGvGbxn8X4/WZ9MwE2GdOI/AAAAAAAAB-Y/zqkSZzRgBmcTnrxWE2_Zt4mBn7bng3poACLcBGAs/s640/chair-world-light-1000.gif | ||
| + | |||
| + | = Model Bias = | ||
| + | * [[Ethics]] | ||
| + | * [[Privacy]] | ||
| + | * [http://developer.ibm.com/articles/machine-learning-and-bias/ Machine learning and bias | IBM] [http://aif360.mybluemix.net/?_ga=2.258555210.1353694320.1576870371-739966746.1575208440 AI Fairness 360 Open Source Toolkit] extensible open source toolkit can help you examine, report, and mitigate discrimination and bias in machine learning models throughout the AI application lifecycle. Containing over 70 fairness metrics and 10 state-of-the-art bias mitigation algorithms | ||
| + | * [http://www.usatoday.com/story/tech/2020/07/22/uber-lyft-algorithms-discriminate-charge-more-non-white-areas/5481950002/ Was your Uber, Lyft fare high because of algorithm bias? | Coral Murphy - USA TODAY] | ||
| + | * [http://research.google.com/bigpicture/attacking-discrimination-in-ml/ Attacking discrimination with smarter machine learning |] [[Creatives#Martin Wattenberg |Martin Wattenberg]], [[Creatives#Fernanda Viegas |Fernanda Viegas]], and Moritz Hardt | ||
| + | |||
{|<!-- T --> | {|<!-- T --> | ||
| valign="top" | | | valign="top" | | ||
| Line 104: | Line 118: | ||
|} | |} | ||
|}<!-- B --> | |}<!-- B --> | ||
| − | |||
| − | |||
| − | |||
| − | |||
Revision as of 09:46, 29 November 2020
Youtube search... ...Google search
- Evaluation
- A Basic Recipe for Machine Learning | Hafidz Zulkifli
- Inductive Bias | Wikipedia
- Overfitting Challenge
- Data Science
- This is how AI bias really happens—and why it’s so hard to fix | Karen Hao
- Top 6 most common statistical errors made by data scientists | Richa Bhatia - Analytics India
- Data Science Concepts Explained to a Five-year-old | Megan Dibble - Toward Data Science
Two terms of bias in Artificial Intelligence:
- Node Bias - The activation of a node in a neural network is determined by the following: output = activation function (dot_product(weights, inputs) + bias) This means when calculating the output of a node, the inputs are multiplied by weights, and a bias value is added to the result. The bias value allows the activation function to be shifted to the left or right, to better fit the data. Hence changes to the weights alter the steepness of the sigmoid curve, whilst the bias offsets it, shifting the entire curve so it fits better. Note also how the bias only influences the output values, it doesn’t interact with the actual input data. Glossary of Deep Learning: Bias | Jaron Collis - Deeper Learning
- Model Bias - Bias can creep into algorithms in several ways. AI systems learn to make decisions based on training data, which can include biased human decisions or reflect historical or social inequities, even if sensitive variables such as gender, race, or sexual orientation are removed. What Do We Do About the Biases in AI? | J. Manyika, J. Silberg, and B. Presten - Harvard Business Review
Node Bias
|
|
|
|
|
|
Model Bias
- Ethics
- Privacy
- Machine learning and bias | IBM AI Fairness 360 Open Source Toolkit extensible open source toolkit can help you examine, report, and mitigate discrimination and bias in machine learning models throughout the AI application lifecycle. Containing over 70 fairness metrics and 10 state-of-the-art bias mitigation algorithms
- Was your Uber, Lyft fare high because of algorithm bias? | Coral Murphy - USA TODAY
- Attacking discrimination with smarter machine learning | Martin Wattenberg, Fernanda Viegas, and Moritz Hardt
|
|