handling files > ~2GB

Share icon

Tue, 03/11/2008 - 06:34 am

Hi,
I was wondering if there is any work around for reading files greater than 2^32 bytes long in Igor (6.01, Win XP) aside from using another program (such as Matlab) to break them up into smaller files which is what I am currently doing. I have binary data files (16bit signed ints, typically 5-10GB long) that I would love to be able handle in Igor as a FIFO in their entirety. I don't need to load the file as a wave, I just want to be able to extract chunks of data from any point in the file.
Thanks,
Dan
I think you're current technique of using another program to break the file up is probably the best route until we are able to revamp our file I/O to support larger files.

It might be possible to break the file up using an Igor procedure. This may or may not be much more convenient than what you are already doing. If you want to pursue this, send a note to support@wavemetrics.com with more information on the nature of your file, such as what generated it and what you are doing in Igor with the data.

March 12, 2008 at 03:58 pm - Permalink

Igor Pro 6.1 (now in beta testing) can access files greater than 2^32 bytes using the FBinRead operation.

January 21, 2009 at 11:16 pm - Permalink