scrape-glosbe-dict
Scrape a glosbe dict
Install it
pip install scrape-glosbe-dict
# pip install git+https://github.com/ffreemt/scrape-glosbe-dict
# poetry add git+https://github.com/ffreemt/scrape-glosbe-dict
# git clone https://github.com/ffreemt/scrape-glosbe-dict && cd scrape-glosbe-dictUse it
scrape-glosbe-dict head-word-file # default english-chinese
# or python -m scrape_glosbe_dict head-word-file
# scrape-glosbe-dict head-word-file -f de # german-chinesehead word file formt: one word/phrase per line, empty lines will be ignored.
output will be saved to a tsv file.
Docs
python -m scrape_glosbe_dict --helpUsage: python -m scrape_glosbe_dict [OPTIONS] head-word-file
Arguments:
head-word-file Head word file, one word/phrase per line, each will be used
to fetch corresponding definitons from https://glosbe.com/.
[required]
Options:
-f, --from-lang TEXT Source language, check https://glosbe.com/ for valid
value, e.g. https://glosbe.com/en/zh implies
from_lang='en'. [default: en]
-t, --to-lang TEXT Target language, check https://glosbe.com/ for valid
value, e.g. https://glosbe.com/en/zh implies
to_lang='zh'. [default: zh]
-v, --verbose Show output in the process.
-V, --version Show version info and exit.
--help Show this message and exit.Miscellany
- A retry mechanism (via pypi
tenacity) is built-in to fetch info from glosbe. Refer to the source file for details. - Local cache (via pypi
joblib) is used so that you can interrupt anytime and continue later. - Scraping is often frowned upon and sometimes can result in your IP being banned from the website. Use this package at your own discretion.
