Web scraping is something I considered back when I was working with Python and found out about BeautifulSoup and Scrapy. When a website doesn't have a way to request/retrieve information programmatically (like with an API), an alternative way of "requesting" the data is by scraping it, or collecting it by using a program or script. There are legal considerations when it comes to web scraping, so I'll start this off by sharing a video about that:
The latest information about the legality of web scraping based on a court decision is "any data that is publicly available and not copyrighted is fair game for web crawlers":
Now that you've watched and read that, here's a video that explains what web scraping is:
Here's some more detailed info from Wikipedia.
Thanks for checking out this post!