Use of FastFileProcessingWithCython.ipynb

[sylvain-ri]

Hi. I am interesting in your fast file reader, but couldn't get the input format. I tried to use your method by changing the python wrapper:

class PyReadFile(CyReadFile):
    """A python wrapper around a cython class."""
    def __init__(self, file_name, delimiter=b'\n'):
        super().__init__(delimiter, file_name)

and calling it in a jupyter notebook through

tmp = module_name.PyReadFile("my/local/file")

but the notebook crashes. I guess the input is wrong or the memory gets eaten up (my file is about 1GB, my machine 16GB RAM).