AI assistant that explains cod…

# 豆瓣电影Top250爬虫（requests + BeautifulSoup + CSV）

一、实现思路

• 豆瓣Top250共10页，URL格式：https://movie.douban.com/top250?start=0（start每次+25）
• 用 requests 发请求，需带 User-Agent 伪装浏览器，否则可能返回403
• 用 BeautifulSoup 解析页面，提取片名（span.title）和评分（span.rating_num）
• 用 csv 模块逐行写入本地文件

二、完整代码

```python

import requests

from bs4 import BeautifulSoup

import csv

import time

headers = {

"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) "

"AppleWebKit/537.36 (KHTML, like Gecko) "

"Chrome/120.0 Safari/537.36"

}

def crawl_douban_top250():

results = []

for start in range(0, 250, 25):

url = f"https://movie.douban.com/top250?start={start}"

resp = requests.get(url, headers=headers, timeout=10)

resp.raise_for_status()

resp.encoding = "utf-8"

soup = BeautifulSoup(resp.text, "html.parser")

for item in soup.select("div.item"):

title = item.select_one("span.title").get_text(strip=True)

rating = item.select_one("span.rating_num").get_text(strip=True)

results.append([title, rating])

time.sleep(2) # 限速，避免请求过快被封

# 写入CSV

with open("douban_top250.csv", "w", newline="", encoding="utf-8-sig") as f:

writer = csv.writer(f)

writer.writerow(["片名", "评分"])

writer.writerows(results)

print(f"完成，共抓取 {len(results)} 条")

if __name__ == "__main__":

crawl_douban_top250()

```

三、安装依赖

```bash

pip install requests beautifulsoup4

```

四、关键说明

• 编码：CSV用 utf-8-sig 保存，Excel打开不乱码
• 限速：每页 sleep 2秒，降低被封IP的风险
• 容错建议：正式使用可加 try/excep