From 558cbe483df69b4316d8d051a9cb6bd49ce7f8fa Mon Sep 17 00:00:00 2001 From: yinnho <163239465+yinnho@users.noreply.github.com> Date: Tue, 25 Aug 2026 19:14:44 +0800 Subject: [PATCH] Add curated topic definition for web-scraping --- topics/web-scraping/index.md | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 topics/web-scraping/index.md diff --git a/topics/web-scraping/index.md b/topics/web-scraping/index.md new file mode 100644 index 00000000000..e5f4cbfee60 --- /dev/null +++ b/topics/web-scraping/index.md @@ -0,0 +1,10 @@ +--- +display_name: Web Scraping +topic: web-scraping +aliases: scraping, webscraping +related: browser-automation, headless-browser, puppeteer, playwright, selenium +short_description: Web scraping is the automated extraction of structured data from websites. +--- +Web scraping is the process of programmatically retrieving web pages and extracting structured data from them for analysis, storage, or reuse. It powers price monitoring, search indexing, market research, and training-data collection. + +Scraping ranges from plain HTTP requests and HTML parsing to full browser automation for JavaScript-rendered and anti-bot-protected pages. The ecosystem includes request libraries, HTML parsers, headless browsers, and cloud extraction platforms.