Difference between revisions of "Web Automation"
m |
m |
||
| (One intermediate revision by the same user not shown) | |||
| Line 2: | Line 2: | ||
|title=PRIMO.ai | |title=PRIMO.ai | ||
|titlemode=append | |titlemode=append | ||
| − | |keywords=artificial, intelligence, machine, learning, models | + | |keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools |
| − | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | + | |
| + | <!-- Google tag (gtag.js) --> | ||
| + | <script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script> | ||
| + | <script> | ||
| + | window.dataLayer = window.dataLayer || []; | ||
| + | function gtag(){dataLayer.push(arguments);} | ||
| + | gtag('js', new Date()); | ||
| + | |||
| + | gtag('config', 'G-4GCWLBVJ7T'); | ||
| + | </script> | ||
}} | }} | ||
[http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...] | [http://www.youtube.com/results?search_query=Web+scraping+Automation YouTube search...] | ||
| Line 37: | Line 46: | ||
[http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search] | [http://www.google.com/search?q=Web+scraping+Automation+Excel ...Google search] | ||
| − | * [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database]] ... [[Graph]] ... [[ | + | * [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]] |
* [http://automatetheweb.net/ AutomateTheWeb.net] | * [http://automatetheweb.net/ AutomateTheWeb.net] | ||
* [http://www.wiseowl.co.uk/blog/s2554/import-web-table.htm Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl] | * [http://www.wiseowl.co.uk/blog/s2554/import-web-table.htm Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl] | ||
Latest revision as of 06:44, 17 August 2023
YouTube search... ...Google search
- Web Automation with Python
- Requests ...simple HTTP library for Python
- Beautiful Soup - bs4 ...for parsing HTML and XML documents. It creates parse trees
- Scrapy ...open source and collaborative framework for extracting the data you need from websites
- Selenium ...a web testing library. It is used to automate browser activities.
- Regular Expressions (Regex)
Beautiful Soup and Requests
Jupyter Notebook
YouTube search... ...Google search
- Web Scraping Guide | StrataScratch ...web scraping in Python with Beautiful Soup
- Using Selenium with Google Colaboratory | Darek Tidwell
Excel
YouTube search... ...Google search
- Excel ... Documents ... Database; Vector & Relational ... Graph ... LlamaIndex
- AutomateTheWeb.net
- Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl
VBA using Selenium
- Browser automation in Excel VBA using Selenium | Ranjith Kumar - Coding is Love
- Web Scraping – Filling in Forms | Philip Treacy
VBA
There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. WiseOwl
- WiseOwl Training Videos
- 46 - Querying Web Pages with Query Tables
- 47.1 - Browsing to Websites and Scraping Web Page
- 47.2 - Scraping Website Tables and Clicking Links
- 47.3 - Internet Explorer vs XML HTTP Request
- 47.4 - Logging in to a Website with Windows Security
- 47.5 - Basic HTTP GET and POST Requests
- 48 - Scraping Multiple Web Pages
- 49 - Downloading Files from Websites
