Data Process

Make processing 2d data more convenient

Install

pip install data-process

collect_csv_data: Collect data in a directory contains CSV files
date: Generate current date and time; get the range of and start, end day of a period date; convert bettween string and datetime.datetime type
date_range: Get the range of date from the start, end, range gap you provided
decimal_helper: Convert float to Decimal type
dict_helper: Replace the keys of a dict; infinite defaultdict data structure; get data by a series of keys
filter_date: Filter a series date string by the given start, end date
green_dict: Make the dict compatibal with the json.dumps, especially for date(time) type
group_by: Group a series of dict by a list of functions; degroup a deep grouped dict by the depths
io_csv: Read, write csv files
io_json: Read, write json files
io_files: List files in a glob pattern directories
io_lines: Read as lines from a file except the lines are blank or start with '#'
iter_dict: Convert dict for output, handled by the type of values separately
join: Left, right, inner, outer join a series of dict as like in SQL
list_helper: Flat a nested list
pandas_helper: Functions wrapper for using pandas conveniently. Convert pandas.DataFrame to a list of dict; aggregate DataFrame by a field.