stylelens-crawl

Shopping mall crawling library for stylens.

Requirements

• Python 3.6+

Installation

pip install stylelens-crawl

Getting Started

The Example code:

Step 1: Import the stylelens crawl library

from stylelens_crawl.stylens_crawl import StylensCrawler

Step 2: Set the crawling option

options = {
    'host_code': 'HC0001'
}

Step 2-1: Enable the Jobs function

options['job_dir'] = True

Step 3: Create a stylelens crawl object

sty = StylensCrawler(options)

Step 4: Call a start function

The crawling task time is vary up to your internet speed.
It will be returned 'True' when successfully completed.

sty.start():

Step 5: Get a crawled result data.

sty.get_items()

Step 6: Remove crawled result file.

styl.delete_temp_file()

List of supported shopping malls

1. De-bow / HC0808
2. 육육걸즈 / HC0008
3. Imvely / HC0004
4. Stylenanda / HC0001
5. Thedaze / HC0012
6. Gogosinf / HC0006
7. Merongshop / HC0016
8. Angtoo / HC0015