Difference between revisions of "Finding Paul Revere"
m |
|||
| (78 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
| − | |keywords=artificial, intelligence, machine, learning, models | + | |keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools |
| − | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | + | |
| + | <!-- Google tag (gtag.js) --> | ||
| + | <script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script> | ||
| + | <script> | ||
| + | window.dataLayer = window.dataLayer || []; | ||
| + | function gtag(){dataLayer.push(arguments);} | ||
| + | gtag('js', new Date()); | ||
| + | |||
| + | gtag('config', 'G-4GCWLBVJ7T'); | ||
| + | </script> | ||
}} | }} | ||
| − | [ | + | [https://www.youtube.com/results?search_query=Using+Metadata+to+Find+Paul+Revere YouTube search...] |
| − | [ | + | [https://www.google.com/search?q=Using+Metadata+to+Find+Paul+Revere ...Google search] |
| − | * [ | + | * [[Math for Intelligence]] ... [[Finding Paul Revere]] ... [[Social Network Analysis (SNA)]] ... [[Dot Product]] ... [[Kernel Trick]] |
| + | * [https://kieranhealy.org/blog/archives/2013/06/09/using-metadata-to-find-paul-revere/ Using Metadata to Find Paul Revere | Kieran Healy] | ||
* The data come from an appendix to [https://www.amazon.com/Paul-Reveres-David-Hackett-Fischer/dp/0195098315/ref=sr_1_1?keywords=David+Hackett+Fischer%27s+Paul+Revere%27s+Ride&qid=1563276971&s=gateway&sr=8-1 David Hackett Fischer's Paul Revere's Ride (Oxford University Press, 1995)] | * The data come from an appendix to [https://www.amazon.com/Paul-Reveres-David-Hackett-Fischer/dp/0195098315/ref=sr_1_1?keywords=David+Hackett+Fischer%27s+Paul+Revere%27s+Ride&qid=1563276971&s=gateway&sr=8-1 David Hackett Fischer's Paul Revere's Ride (Oxford University Press, 1995)] | ||
| − | * [ | + | * [https://www.sscnet.ucla.edu/polisci/faculty/chwe/ps269/han.pdf The Other Ride of Paul Revere: The Brokerage Role In The Making of The American Revolution | Shin-Kap Han] |
| + | |||
| − | |||
London, 1772. | London, 1772. | ||
| Line 18: | Line 28: | ||
I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the discussion of the role of “metadata” in certain recent events and the assurances of various respectable parties that the government was merely “sifting through this so-called metadata” and that the “information acquired does not include the content of any communications”. I will show how we can use this “metadata” to find key persons involved in terrorist groups operating within the Colonies at the present time. I shall also endeavour to show how these methods work in what might be called a relational manner... | I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the discussion of the role of “metadata” in certain recent events and the assurances of various respectable parties that the government was merely “sifting through this so-called metadata” and that the “information acquired does not include the content of any communications”. I will show how we can use this “metadata” to find key persons involved in terrorist groups operating within the Colonies at the present time. I shall also endeavour to show how these methods work in what might be called a relational manner... | ||
| − | + | ||
| + | <youtube>qOVz_dVbTrE</youtube> | ||
| − | <youtube> | + | == To play... == |
| + | |||
| + | 1. Download from [https://github.com/kjhealy/revere Kieran Healy files | Github] for reference | ||
| + | |||
| + | 2. Download from [https://github.com/mdmurph/CS570_MBERNICO_cloned Mark Bernico's files | GitHub]]; <i>Boston - 1776.ipynb</i> [[Jupyter]] notebook and <i>PaulRevereAppD.csv</i> data file | ||
| + | |||
| + | 3. Upload Mark Bernico's files to your Google Drive | ||
| + | |||
| + | === Notebook Setup === | ||
| + | |||
| + | 4. Obtain a [[Colaboratory]] account if you don't already have one | ||
| + | |||
| + | 5. Setup [https://drive.google.com/drive/my-drive Colab app in your Google Drive account] by watching 1:45 minutes into the following video. Optionally starting at 2:35 setting up a GPU; menu Edit | Notebook settings | ||
| + | |||
| + | <youtube>1EHWYTUL6vU</youtube> | ||
| − | + | 6. How to upload from a local file on your computer to Colab by watching the following video, and | |
| − | + | [https://colab.research.google.com/notebooks/io.ipynb#scrollTo=BaCkyg5CV5jF from this Colab's Help Notebook 'copy and paste' into new cells per the video] | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
<youtube>SHYAQHDQoU4</youtube> | <youtube>SHYAQHDQoU4</youtube> | ||
| + | |||
| + | 7. Note: As you step though the notebook, you will need to put parenthesis around two print statements; <i>print(people_x_groups.shape)</i> & <i>print(groups_x_people.shape)</i> | ||
| + | |||
| + | 8. Save your notebook; File | Save <or> <i>CNTRL+S</i> Note: [https://colab.research.google.com/notebooks/welcome.ipynb#recent=true To open your recent files in Colab click here] | ||
| + | |||
| + | 9. Extra credit: Edit the notebook to graph organizations as shown in Healy's blog by switching the order of the matrix multiplication; <i>groups_adj = groups_x_people.dot(people_x_groups)</i> and replicating the code for <i>groups_adj</i>. | ||
| + | |||
| + | === Functional Explanations === | ||
| + | |||
| + | * [[Python#NumPy |NumPy]] for [https://en.wikipedia.org/wiki/Matrix_(mathematics) Matrices] are collections of elements into rows and columns. [https://en.wikipedia.org/wiki/Matrix_multiplication Matrix multiplication] relies on [[Dot Product]] to multiply various combinations of rows and columns. A thing about multiplying matrices is that the order matters - multiply one way to see group relationships and multiply opposite way to view people relationships. | ||
| + | * [[Python#NetworkX |NetworkX]] for creation, manipulation, and study of the structure, dynamics, and functions of complex networks | ||
| + | * [[Python#Matplotlib |Matplotlib]] for generating plots, histograms, power spectra, bar charts, errorcharts, scatterplots, etc | ||
| + | * In 1974's [https://www.umasocialmedia.com/socialnetworks/glossary/duality-of-persons-and-groups/ The Duality of Persons and Groups], Ronald Breiger laid out a technique for obtaining a persons x persons adjacency matrix and a groups x groups adjacency matrix from a persons x groups affiliation matrix. | ||
| + | * [https://en.wikipedia.org/wiki/Adjacency_matrix Adjacency Matrix] - is a 2D array of size V x V where V is the number of vertices in a graph. The matrix is often used in network analysis to represent the adjacency of each person to each other person in a network. An adjacency matrix is a square person-by-person matrix | ||
| + | |||
| + | <youtube>HtTd548OCl0</youtube> | ||
| + | |||
| + | * [https://en.wikipedia.org/wiki/Eigenvector_centrality Eigenvector Centrality] - a measure of the influence of a node in a network | ||
| + | |||
| + | <youtube>DGVvm-j-NG4</youtube> | ||
| + | |||
| + | |||
| + | * [[Knowledge Graphs]] are very useful ways of presenting information about social networks. | ||
| + | |||
| + | |||
| + | -------------------------------------------------------------------------------------------- | ||
| + | |||
| + | |||
| + | Google Drive Option: How to upload from a local file on your computer to Colab by watching 6:30 minutes into the Notebook Setup video. [https://colab.research.google.com/notebooks/io.ipynb#scrollTo=p2E4EKhCWEC5 From this Colab's Help Notebook 'copy and paste' per the video] | ||
| + | |||
| + | [https://towardsdatascience.com/3-ways-to-load-csv-files-into-colab-7c14fcbdcb92 Get Started: 3 Ways to Load CSV files into Colab | A Apte - Towards Data Science] | ||
Latest revision as of 13:26, 30 June 2023
YouTube search... ...Google search
- Math for Intelligence ... Finding Paul Revere ... Social Network Analysis (SNA) ... Dot Product ... Kernel Trick
- Using Metadata to Find Paul Revere | Kieran Healy
- The data come from an appendix to David Hackett Fischer's Paul Revere's Ride (Oxford University Press, 1995)
- The Other Ride of Paul Revere: The Brokerage Role In The Making of The American Revolution | Shin-Kap Han
London, 1772.
I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the discussion of the role of “metadata” in certain recent events and the assurances of various respectable parties that the government was merely “sifting through this so-called metadata” and that the “information acquired does not include the content of any communications”. I will show how we can use this “metadata” to find key persons involved in terrorist groups operating within the Colonies at the present time. I shall also endeavour to show how these methods work in what might be called a relational manner...
To play...
1. Download from Kieran Healy files | Github for reference
2. Download from Mark Bernico's files | GitHub]; Boston - 1776.ipynb Jupyter notebook and PaulRevereAppD.csv data file
3. Upload Mark Bernico's files to your Google Drive
Notebook Setup
4. Obtain a Colaboratory account if you don't already have one
5. Setup Colab app in your Google Drive account by watching 1:45 minutes into the following video. Optionally starting at 2:35 setting up a GPU; menu Edit | Notebook settings
6. How to upload from a local file on your computer to Colab by watching the following video, and from this Colab's Help Notebook 'copy and paste' into new cells per the video
7. Note: As you step though the notebook, you will need to put parenthesis around two print statements; print(people_x_groups.shape) & print(groups_x_people.shape)
8. Save your notebook; File | Save <or> CNTRL+S Note: To open your recent files in Colab click here
9. Extra credit: Edit the notebook to graph organizations as shown in Healy's blog by switching the order of the matrix multiplication; groups_adj = groups_x_people.dot(people_x_groups) and replicating the code for groups_adj.
Functional Explanations
- NumPy for Matrices are collections of elements into rows and columns. Matrix multiplication relies on Dot Product to multiply various combinations of rows and columns. A thing about multiplying matrices is that the order matters - multiply one way to see group relationships and multiply opposite way to view people relationships.
- NetworkX for creation, manipulation, and study of the structure, dynamics, and functions of complex networks
- Matplotlib for generating plots, histograms, power spectra, bar charts, errorcharts, scatterplots, etc
- In 1974's The Duality of Persons and Groups, Ronald Breiger laid out a technique for obtaining a persons x persons adjacency matrix and a groups x groups adjacency matrix from a persons x groups affiliation matrix.
- Adjacency Matrix - is a 2D array of size V x V where V is the number of vertices in a graph. The matrix is often used in network analysis to represent the adjacency of each person to each other person in a network. An adjacency matrix is a square person-by-person matrix
- Eigenvector Centrality - a measure of the influence of a node in a network
- Knowledge Graphs are very useful ways of presenting information about social networks.
Google Drive Option: How to upload from a local file on your computer to Colab by watching 6:30 minutes into the Notebook Setup video. From this Colab's Help Notebook 'copy and paste' per the video
Get Started: 3 Ways to Load CSV files into Colab | A Apte - Towards Data Science
