pstoh 的技术笔记 https://pstoh.github.io/ 爬虫、代理IP 与数据采集实战笔记：代理池设计、Scrapy 中间件、错误码排查、限速与合规。 zh-CN CC BY 4.0 · pstoh pstoh handwritten static HTML Sun, 27 Sep 2026 12:00:00 +0800 采集限速与合规：别把对方站点打挂 https://pstoh.github.io/posts/crawler-rate-limit.html https://pstoh.github.io/posts/crawler-rate-limit.html Fri, 25 Sep 2026 10:00:00 +0800 采集规范 Scrapy 代理中间件：每个请求自动换 IP https://pstoh.github.io/posts/scrapy-proxy-middleware.html https://pstoh.github.io/posts/scrapy-proxy-middleware.html Wed, 16 Sep 2026 10:00:00 +0800 Scrapy 代理返回 407、406、403、超时，分别怎么排查 https://pstoh.github.io/posts/proxy-error-troubleshooting.html https://pstoh.github.io/posts/proxy-error-troubleshooting.html Tue, 08 Sep 2026 10:00:00 +0800 排错 爬虫代理池的四个关键设计（附 Python 实现） https://pstoh.github.io/posts/proxy-pool-design.html https://pstoh.github.io/posts/proxy-pool-design.html Sat, 29 Aug 2026 10:00:00 +0800 架构 HTTP 代理到底怎么工作：一次请求的完整旅程 https://pstoh.github.io/posts/how-http-proxy-works.html https://pstoh.github.io/posts/how-http-proxy-works.html Tue, 18 Aug 2026 10:00:00 +0800 基础