Innovoft.IO.SplitReaders

Innovoft.IO.SplitReaders is a library for efficient csv column reading. When reading small csv files and on one thread using a TextReader and doing a string.Split(...) is not an issue. But when reading 100 GB csv files on 48 threads, string creation ends up being an issue because of all the GC that it causes.


Keywords
csv, efficient, efficient-algorithm, efficincy, split, splitter, splitting, splitting-text, string-manipulation, csharp, dotnet, dotnet-standard, efficiency, string, strings
License
MIT
Install
Install-Package Innovoft.IO.SplitReaders -Version 1.4.44

Documentation

Innovoft.IO.SplitReaders

Innovoft.IO.SplitReaders is a library for efficient csv column reading. When reading small csv files and on one thread using a TextReader and doing a string.Split(...) is not an issue. But when reading 100 GB csv files on 48 threads, string creation ends up being an issue because of all the GC that it causes.