Difference between revisions of "Web Automation"

From
Jump to: navigation, search
(→‎Colaboratory)
m
 
(19 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
|title=PRIMO.ai
 
|title=PRIMO.ai
 
|titlemode=append
 
|titlemode=append
−
|keywords=artificial, intelligence, machine, learning, models, algorithms, data, singularity, moonshot, Tensorflow, Google, Nvidia, Microsoft, Azure, Amazon, AWS  
+
|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools
−
|description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools  
+
 
 +
<!-- Google tag (gtag.js) -->
 +
<script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script>
 +
<script>
 +
  window.dataLayer = window.dataLayer || [];
 +
  function gtag(){dataLayer.push(arguments);}
 +
  gtag('js', new Date());
 +
 
 +
  gtag('config', 'G-4GCWLBVJ7T');
 +
</script>
 
}}
 
}}
 
[http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...]
 
[http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...]
Line 10: Line 19:
 
* [[Python#Web Automation with Python|Web Automation with Python]]  
 
* [[Python#Web Automation with Python|Web Automation with Python]]  
 
** [[Python#Requests|Requests]] ...simple HTTP library for Python
 
** [[Python#Requests|Requests]] ...simple HTTP library for Python
−
** [[Python#Beautiful Soup|Beautiful Soup]] ...for parsing HTML and XML documents. It creates parse trees
+
** [[Python#Beautiful Soup - bs4|Beautiful Soup - bs4]] ...for parsing HTML and XML documents. It creates parse trees
 
** [[Python#Scrapy|Scrapy]] ...open source and collaborative framework for extracting the data you need from websites
 
** [[Python#Scrapy|Scrapy]] ...open source and collaborative framework for extracting the data you need from websites
 
** [[Python#Selenium|Selenium]] ...a web testing library. It is used to automate browser activities.
 
** [[Python#Selenium|Selenium]] ...a web testing library. It is used to automate browser activities.
 +
* [[Natural Language Processing (NLP)#Regular Expressions (Regex)|Regular Expressions (Regex)]]
  
 
<youtube>K1xVFqT4sqY</youtube>  
 
<youtube>K1xVFqT4sqY</youtube>  
Line 22: Line 32:
  
  
−
== Colaboratory ==
+
== Jupyter Notebook ==
−
[http://www.youtube.com/results?search_query=Web+scraping+Automation+Google+Colaboratory YouTube search...]
+
[http://www.youtube.com/results?search_query=Web+scraping+Automation+Jupyter+Colaboratory YouTube search...]
−
[http://www.google.com/search?q=Web+scraping+Automation+Google+Colaboratory ...Google search]
+
[http://www.google.com/search?q=Web+scraping+Automation+Jupyter+Colaboratory ...Google search]
  
 
* [http://colab.research.google.com/drive/15AEaOsAKWgikKY7BEOWxUlKsjjBjRD6R Web Scraping Guide | StrataScratch] ...web scraping in Python with Beautiful Soup
 
* [http://colab.research.google.com/drive/15AEaOsAKWgikKY7BEOWxUlKsjjBjRD6R Web Scraping Guide | StrataScratch] ...web scraping in Python with Beautiful Soup
 
* [http://darektidwell.com/using-selenium-with-google-colaboratory/ Using Selenium with Google Colaboratory | Darek Tidwell]
 
* [http://darektidwell.com/using-selenium-with-google-colaboratory/ Using Selenium with Google Colaboratory | Darek Tidwell]
  
−
<youtube>mKxFfjNyj3c</youtube>
+
<youtube>dvw749iveJA</youtube>
−
<youtube>3xQTJi2tqgk</youtube>
+
<youtube>n188_5d9Zgo</youtube>
  
−
== Excel with VBA ==
+
== Excel ==
 
[http://www.youtube.com/results?search_query=Web+scraping+Automation+Excel YouTube search...]
 
[http://www.youtube.com/results?search_query=Web+scraping+Automation+Excel YouTube search...]
 
[http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search]
 
[http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search]
 +
 +
* [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]]
 +
* [http://automatetheweb.net/ AutomateTheWeb.net]
 +
* [http://www.wiseowl.co.uk/blog/s2554/import-web-table.htm Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl]
 +
 +
=== VBA using Selenium ===
 +
* [http://codingislove.com/browser-automation-in-excel-selenium Browser automation in Excel VBA using Selenium | Ranjith Kumar - Coding is Love]
 +
* [http://www.myonlinetraininghub.com/web-scraping-filling-forms Web Scraping – Filling in Forms | Philip Treacy]
 +
 +
=== VBA ===
 +
There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. [http://www.wiseowl.co.uk/blog/s393/scraping-websites-vba.htm WiseOwl]
  
 
* [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos]
 
* [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-query-tables/ 46 -  Querying Web Pages with Query Tables]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-pages/ 47.1 - Browsing to Websites and Scraping Web Page]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-tables/ 47.2 - Scraping Website Tables and Clicking Links]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/ie-vs-httprequest/ 47.3 - Internet Explorer vs XML HTTP Request]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/login-windows-security/ 47.4 - Logging in to a Website with Windows Security]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/get-post-requests/ 47.5 - Basic HTTP GET and POST Requests]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-multiple-web-pages/ 48 - Scraping Multiple Web Pages]
 +
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/ 49  - Downloading Files from Websites]
  
 
<youtube>ZrPEAljQjRM</youtube>
 
<youtube>ZrPEAljQjRM</youtube>
Line 46: Line 75:
 
<youtube>sGw6r5GVA5g</youtube>
 
<youtube>sGw6r5GVA5g</youtube>
 
<youtube>JPezrWwvsJM</youtube>
 
<youtube>JPezrWwvsJM</youtube>
 +
 +
* [http://gist.github.com/erajanraja24/a6b1704233c8af0b5398835dd4b21af1 Automate Internet Explorer with Excel VBA Part 3- Automatic web form filling | Rajan]
 +
* [http://newtours.demoaut.com/mercuryregister.php Mecury Tours]
 +
 +
 +
* [http://megettingerror.blogspot.com/ Extreme Automation | Kamal Girdher]
 +
* [http://khanabook.weebly.com/store/c1/Featured_Products.html Khanabook.weebly.com site]
 +
<youtube>W9jug_PrEtM</youtube>
 +
<youtube>5BZ6ltDfTWw</youtube>
 +
<youtube>ghdzG3b7ThY</youtube>
 +
<youtube>OLyY4wqnn2Y</youtube>
 +
<youtube>Qi5CF-fKYEs</youtube>
 +
<youtube>WXHD7T0D4Pk</youtube>
 +
<youtube>RstySb2lyDo</youtube>

Latest revision as of 06:44, 17 August 2023

YouTube search... ...Google search

Beautiful Soup and Requests


Jupyter Notebook

YouTube search... ...Google search

Excel

YouTube search... ...Google search

VBA using Selenium

VBA

There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. WiseOwl


Retrieved from "https://primo.ai/index.php?title=Web_Automation&oldid=33195"