Difference between revisions of "Web Automation"
(→VBA) |
(→VBA) |
||
| Line 47: | Line 47: | ||
* [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos] | * [http://www.youtube.com/channel/UCbi5G5PjWBaQUFy7XU_O7yw WiseOwl Training Videos] | ||
| − | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-query-tables/ 46 - Querying Web Pages with Query Tables] | + | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-query-tables/ 46 - Querying Web Pages with Query Tables] |
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-pages/ 47.1 - Browsing to Websites and Scraping Web Page] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-pages/ 47.1 - Browsing to Websites and Scraping Web Page] | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-tables/ 47.2 - Scraping Website Tables and Clicking Links] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-web-tables/ 47.2 - Scraping Website Tables and Clicking Links] | ||
| Line 54: | Line 54: | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/get-post-requests/ 47.5 - Basic HTTP GET and POST Requests] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/get-post-requests/ 47.5 - Basic HTTP GET and POST Requests] | ||
** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-multiple-web-pages/ 48 - Scraping Multiple Web Pages] | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/scraping-multiple-web-pages/ 48 - Scraping Multiple Web Pages] | ||
| − | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/ 49 - Downloading Files from Websites] | + | ** [http://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/ 49 - Downloading Files from Websites] |
<youtube>ZrPEAljQjRM</youtube> | <youtube>ZrPEAljQjRM</youtube> | ||
Revision as of 17:26, 16 November 2019
YouTube search... ...Google search
- Web Automation with Python
- Requests ...simple HTTP library for Python
- Beautiful Soup - bs4 ...for parsing HTML and XML documents. It creates parse trees
- Scrapy ...open source and collaborative framework for extracting the data you need from websites
- Selenium ...a web testing library. It is used to automate browser activities.
- Regular Expressions (Regex)
Beautiful Soup and Requests
Jupyter Notebook
YouTube search... ...Google search
- Web Scraping Guide | StrataScratch ...web scraping in Python with Beautiful Soup
- Using Selenium with Google Colaboratory | Darek Tidwell
Excel
YouTube search... ...Google search
- AutomateTheWeb.net
- Getting data in Excel without coding VBA to scrape a website use Power Query | WiseOwl
VBA using Selenium
VBA
There are two ways to get information from websites programmatically: by downloading their data, or by parsing their HTML. WiseOwl
- WiseOwl Training Videos
- 46 - Querying Web Pages with Query Tables
- 47.1 - Browsing to Websites and Scraping Web Page
- 47.2 - Scraping Website Tables and Clicking Links
- 47.3 - Internet Explorer vs XML HTTP Request
- 47.4 - Logging in to a Website with Windows Security
- 47.5 - Basic HTTP GET and POST Requests
- 48 - Scraping Multiple Web Pages
- 49 - Downloading Files from Websites
