Difference between revisions of "Web Automation"
(→VBA) |
m |
||
| (11 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
| − | |keywords=artificial, intelligence, machine, learning, models | + | |keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools |
| − | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | + | |
| + | <!-- Google tag (gtag.js) --> | ||
| + | <script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script> | ||
| + | <script> | ||
| + | window.dataLayer = window.dataLayer || []; | ||
| + | function gtag(){dataLayer.push(arguments);} | ||
| + | gtag('js', new Date()); | ||
| + | |||
| + | gtag('config', 'G-4GCWLBVJ7T'); | ||
| + | </script> | ||
}} | }} | ||
[http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...] | [http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...] | ||
| Line 37: | Line 46: | ||
[http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search] | [http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search] | ||
| + | * [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]] | ||
* [http://automatetheweb.net/ AutomateTheWeb.net] | * [http://automatetheweb.net/ AutomateTheWeb.net] | ||
* [http://www.wiseowl.co.uk/blog/s2554/import-web-table.htm Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl] | * [http://www.wiseowl.co.uk/blog/s2554/import-web-table.htm Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl] | ||
| Line 42: | Line 52: | ||
=== VBA using Selenium === | === VBA using Selenium === | ||
* [http://codingislove.com/browser-automation-in-excel-selenium Browser automation in Excel VBA using Selenium | Ranjith Kumar - Coding is Love] | * [http://codingislove.com/browser-automation-in-excel-selenium Browser automation in Excel VBA using Selenium | Ranjith Kumar - Coding is Love] | ||
| + | * [http://www.myonlinetraininghub.com/web-scraping-filling-forms Web Scraping – Filling in Forms | Philip Treacy] | ||
=== VBA === | === VBA === | ||
| + | There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. [http://www.wiseowl.co.uk/blog/s393/scraping-websites-vba.htm WiseOwl] | ||
| + | |||
* [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos] | * [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos] | ||
| − | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-query-tables/ 46 - Querying Web Pages with Query Tables] | + | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-query-tables/ 46 - Querying Web Pages with Query Tables] |
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-pages/ 47.1 - Browsing to Websites and Scraping Web Page] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-pages/ 47.1 - Browsing to Websites and Scraping Web Page] | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-tables/ 47.2 - Scraping Website Tables and Clicking Links] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-tables/ 47.2 - Scraping Website Tables and Clicking Links] | ||
| Line 52: | Line 65: | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/get-post-requests/ 47.5 - Basic HTTP GET and POST Requests] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/get-post-requests/ 47.5 - Basic HTTP GET and POST Requests] | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-multiple-web-pages/ 48 - Scraping Multiple Web Pages] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-multiple-web-pages/ 48 - Scraping Multiple Web Pages] | ||
| + | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/ 49 - Downloading Files from Websites] | ||
<youtube>ZrPEAljQjRM</youtube> | <youtube>ZrPEAljQjRM</youtube> | ||
| Line 61: | Line 75: | ||
<youtube>sGw6r5GVA5g</youtube> | <youtube>sGw6r5GVA5g</youtube> | ||
<youtube>JPezrWwvsJM</youtube> | <youtube>JPezrWwvsJM</youtube> | ||
| + | |||
| + | * [http://gist.github.com/erajanraja24/a6b1704233c8af0b5398835dd4b21af1 Automate Internet Explorer with Excel VBA Part 3- Automatic web form filling | Rajan] | ||
| + | * [http://newtours.demoaut.com/mercuryregister.php Mecury Tours] | ||
| + | |||
| + | |||
| + | * [http://megettingerror.blogspot.com/ Extreme Automation | Kamal Girdher] | ||
| + | * [http://khanabook.weebly.com/store/c1/Featured_Products.html Khanabook.weebly.com site] | ||
| + | <youtube>W9jug_PrEtM</youtube> | ||
| + | <youtube>5BZ6ltDfTWw</youtube> | ||
| + | <youtube>ghdzG3b7ThY</youtube> | ||
| + | <youtube>OLyY4wqnn2Y</youtube> | ||
| + | <youtube>Qi5CF-fKYEs</youtube> | ||
| + | <youtube>WXHD7T0D4Pk</youtube> | ||
| + | <youtube>RstySb2lyDo</youtube> | ||
Latest revision as of 06:44, 17 August 2023
YouTube search... ...Google search
- Web Automation with Python
- Requests ...simple HTTP library for Python
- Beautiful Soup - bs4 ...for parsing HTML and XML documents. It creates parse trees
- Scrapy ...open source and collaborative framework for extracting the data you need from websites
- Selenium ...a web testing library. It is used to automate browser activities.
- Regular Expressions (Regex)
Beautiful Soup and Requests
Jupyter Notebook
YouTube search... ...Google search
- Web Scraping Guide | StrataScratch ...web scraping in Python with Beautiful Soup
- Using Selenium with Google Colaboratory | Darek Tidwell
Excel
YouTube search... ...Google search
- Excel ... Documents ... Database; Vector & Relational ... Graph ... LlamaIndex
- AutomateTheWeb.net
- Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl
VBA using Selenium
- Browser automation in Excel VBA using Selenium | Ranjith Kumar - Coding is Love
- Web Scraping – Filling in Forms | Philip Treacy
VBA
There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. WiseOwl
- WiseOwl Training Videos
- 46 - Querying Web Pages with Query Tables
- 47.1 - Browsing to Websites and Scraping Web Page
- 47.2 - Scraping Website Tables and Clicking Links
- 47.3 - Internet Explorer vs XML HTTP Request
- 47.4 - Logging in to a Website with Windows Security
- 47.5 - Basic HTTP GET and POST Requests
- 48 - Scraping Multiple Web Pages
- 49 - Downloading Files from Websites
