Practice
In the end, I chose to use WebScraper.io as the scraping tool. After inserting the plug-in, you can quickly open the tool on the page through the "view-creator-creator tool" on the toolbar. Then click "web scrape" to enter the page, and enter the selection of scraping objects by "create new sitemap-create sitemap". The "add new selector" button can be used to complete the selection and export it to a more readable Excel format after scraping the page. For example, the selected data can not be crawled, after asking the teacher and repeatedly trying to get the answer: the page I am on and the entered URL must be consistent, and should not leave the page during the crawling process.



