crawler This repos contains the core module for web crawling. It supports authentication, sending get, post requests with files...