CLIP-Crawler

Release 0.7.0

A wrapper/crawler meant to fetch information from the Campus Life Integration Platform (clip.fct.unl.pt)

Homepage PyPI

Keywords
CLIP, FCT, UNL, wrapper, crawler
License
GPL-3.0
Install
pip install CLIP-Crawler==0.7.0

Documentation

CLIPy, Campus Life Integration Platform wrapper

In case you have no clue of what CLIP is then this package is not for you.

This is a crawler which downloads relevant information from CLIP, as such it requires student credentials. It does provide an interface to lookup the crawled data.

Even if you're a student and have the all mighty credentials, it still isn't probably something you'll want to try.

If you're brave and want to try it, or want that information for something else (please don't be evil), it takes several days to fully bootstrap the database, and it's a somewhat error-prone process with a lot of disconnections along the way.

Avoid doing so during times that might disturb other students access to CLIP. This thing does several requests every second. 1AM-6AM(GMT) it's probably your best shot.

Instalation

pip install clip-crawler

Usage

from CLIPy import CacheStorage, Clip

storage = CacheStorage.postgresql('username', 'password', 'schema')
Clip.populate('CLIP ID', 'password', storage) # Run only once. Takes forever.

clip = Clip(storage)
[print(student) for student in clip.find_student("John Smith")]

Stuff that this is able to retrieve

Right now, most of CLIP data.

  • Students
  • Teachers
  • Classes (most of their information, student grades, turns, teachers)
  • Departments
  • Courses
  • Files (with deduplication :) )
  • Physical entities (buildings, classrooms, auditoriums, laboratories, ...)
  • National access contest admissions

TODO

  • Timespan filters (eg: crawl [thing] from 2015 to 2017)
  • Evaluation dates
  • Class summaries
  • Course curricular plans
  • Better student course tagging
  • Library occupied/spare rooms

Stats

Dependencies
0
Dependent packages
0
Dependent repositories
0
Total releases
11
Latest release
First release
Stars
1
Forks
1
Contributors
0
SourceRank
6

Development practices

Source repo 2FA enabled
TEXT!
Package manager 2FA enabled
TEXT!
Is security responsive
TEXT!
Dependencies are managed
TEXT!
Issue-free release available
TEXT!
Succession plan available
TEXT!
Package manager 2FA enabled
TEXT!

The Tidelift Subscription provides access to a continuously curated stream of human-researched and maintainer-verified data on open source packages and their licenses, releases, vulnerabilities, and development practices.

Learn more →

Releases

0.7.0
0.6
0.5.1
0.5.0
0.2.2
0.2.1
0.2.0
0.1.1
0.1.0
0.0.5
See all 11 releases

Something wrong with this page? Make a suggestion

Export .ABOUT file for this package

Last synced: 2021-02-13 07:33:33 UTC

Login to resync this project