name: distribute-crawler
description: 使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现。
license_spdx: MIT
version: 1.0.1
spec_version: 1.0
home_url: https://github.com/yanjlee/distribute_crawler
news_url: https://libraries.io/pypi/distribute-crawler/versions.atom
date: 2024-06-01
about_resource: NONE
libraries_io_url: https://libraries.io/pypi/distribute-crawler?number=1.0.1
vcs_tool: git
vcs_repository: https://github.com/yanjlee/distribute_crawler
vcs_branch: master
