ze

Release 0.0.17.dev1

Scaper to lager portal of news in Brazil.

Homepage Repository PyPI Python

Keywords
scrapy, scraper, spider, crawler, brazil, news, estadao, veja, folha-de-sp, mongodb, newspaper, portals
License
MIT
Install
pip install ze==0.0.17.dev1

Documentation

## References0
http://xpo6.com/list-of-english-stop-words/

## Spiders

### Estadão

How To Use:

```sh
scrapy crawl estadao -a query=$ESTADAO_QUERY -a topic=$ESTADAO_TOPIC
```

**query** (opt)

Texto usado para filtrar as publicações diretamente site do Estadão

**topic** (opt)

Coletar publicações em tópico expecifico

- Esportes
- Economia
- Internacional
- Not%C3%ADcias
- Geral
- Cultura
- Pol%C3%ADtica
- Politica
- Opini%C3%A3o
- Brasil
- Eldorado%2FESPN
- S%C3%A3o+Paulo
- Link
- Educa%C3%A7%C3%A3o
- Vida+%26+Estilo
- Sa%C3%BAde
- Paladar
- Ci%C3%AAncia
- Viagem
- M%C3%BAsica

## pyspider in Docker

### MySQL
```
docker run --name argonautcrewcrawler_mysql -d -v /home/gustavorps/databases/mysql/crawler:/var/lib/mysql -e MYSQL_ALLOW_EMPTY_PASSWORD=yes mysql:latest
```

# RabbitMQ
docker run --name argonautcrewcrawler_rabbitmq -d rabbitmq:latest

Stats

Dependencies
0
Dependent packages
0
Dependent repositories
1
Total releases
2
Latest release
First release
Stars
2
Forks
4
Watchers
5
Contributors
1
Repository size
11 MB
SourceRank
6

Development practices

Source repo 2FA enabled
TEXT!
Package manager 2FA enabled
TEXT!
Is security responsive
TEXT!
Dependencies are managed
TEXT!
Issue-free release available
TEXT!
Succession plan available
TEXT!
Package manager 2FA enabled
TEXT!

The Tidelift Subscription provides access to a continuously curated stream of human-researched and maintainer-verified data on open source packages and their licenses, releases, vulnerabilities, and development practices.

Learn more →

Releases

0.0.17.dev1
0.0.8.dev1

Contributors

ligiaiv


See all contributors

Something wrong with this page? Make a suggestion

Export .ABOUT file for this package

Last synced: 2021-02-23 19:37:49 UTC

Login to resync this project