Text File Splitter

Python module to split text file easy and fast, without compromising memory using big files.

Installation

You can install text-file-splitter by running the following command:

pip install text-file-splitter

Or you can download direct from Github and install it manually.

Usage

Import the module and initialise it.

    from text_files_splitter import TextFilesSplitter, ListMetrics

    source_file = './src/test/files'
    file_name = 'test_csv.csv'
    max_size_file = 10
    file_type = 'csv' # Optional - default 'csv'
    metric_units = ListMetrics.MB # Optional - default ListMetrics.B
    output_directory = './output' # Optional - default the current directory
    include_header = True # Optional - default True
    file_suffix = 'file_example' # Optional - default file_name

    file_splitter = TextFilesSplitter(source_file, file_name, max_size_file, file_type,
                                                ListMetrics.MB, output_directory, include_header, file_suffix)

    files_splitted = file_splitter.get_file_splitted()

The outcome of get_file_splitted() is a list of dict with the following details

files_splitted = [
    {
        "file_name": file_name,
        "path": output_directory,
        "file_size": file_size_in_bytes,
        "count": count
    }...
]

Files compatibility

• csv

Test

To run a test of the clone the repository and follow the instructions

pip install test-requirements.txt
python -m src.test.test

Expected Outcome

the time may vary depending on your machine performance

Ran 1 test in 0.180s

OK

List of test created

• csv

Requirements

• Python 3.4 or newer

Code Standards

Following pylint standards

License

The MIT License (MIT). Please see License File for more information.

Contributions