Go to file
ds19991999 78aafe5689 . 2019-11-08 11:27:23 +08:00
csdn . 2019-11-08 11:27:23 +08:00
.gitignore Initial commit 2019-10-19 18:54:26 +08:00
LICENSE Initial commit 2019-10-19 18:54:26 +08:00
README.md add muti-user 2019-10-24 23:17:40 +08:00
requirements.txt update shell 2019-10-24 21:03:51 +08:00
test.py add muti-user 2019-10-24 23:17:40 +08:00

README.md

CSDN 爬虫

主要功能:爬取 csdn 博客指定用户的所有博文并转换为 markdown 格式保存到本地。

下载脚本

git clone https://github.com/ds19991999/csdn-spider.git
cd csdn-spider
python3 -m pip install -r requirements.txt

爬取用户全部博文

import csdn
csdn.spider(["ds19991999", "u013088062"], 5)
# 参数 usernames: list, thread_num: int = 10, folder_name: str = "articles"

LICENSE

Creative Commons License

PS:随意写的爬虫脚本,佛系更新。