English | MP4 | AVC 1920×1080 | AAC 48KHz 2ch | 1 Hour | 504 MB
Learn how to scrape data from any static or dynamic / AJAX web page using Java in a short and concise way.
In this short and concise course you will learn everything to get started with web scraping using Java.
You will learn the concepts behind web scraping that you can apply to practically any web page (static AND dynamic / AJAX).
We start with an overview of what web scraping is and what you can do with it.
Then we explain the difference in scraping static pages vs dynamic / AJAX pages. You learn how to classify a website in one of the two categories and then apply the right concept in order to scrape the data you want.
Now you will learn how to export the scraped data either as CSV or JSON. These are some popular formats that can be used for further processing.
Unfortunately many websites try to block scrapers or sometimes you just do not want to be detected. In the section going undercover you will learn how to stay undetected and avoid getting blocked.
1. Course Introduction
Introduction – Course overview and requirements
2. Scraping static web pages
Concept – how to scrape static web pages
Example – scraping the top 10 Google search results
Jsoup – the jQuery for Java
What is a static web page
3. Scraping dynamic AJAX web pages
Concept – how to scrape dynamic _ AJAX web pages
Example – scraping results from peoplefinders.com
Making HTTP Requests with Unirest
What is a dynamic _ AJAX web page
4. Exporting your data
Export your data as CSV
Export your data as JSON
5. Going undercover
How to stay undetected
Conclusion and what’s next
Mind Map of the course content