2021.12.16 15:35 "Re: [Tiff] Ensuring buffer alignment when creating tiff files", by Kemp Watson

Milian, are these images for geomapping or digital pathology? I am guessing so since you mentioned mipmap subIFDs.

If so, there is a good 20-25 years of experience in how to efficiently write and read these large files, and the solution has inevitably come down to tiling the data, and absolutely not mmapping. In fact, when you say the size of the image leaves you no alternative, I think perhaps you really should really think that the size of the images means mmapping should be out of the question. Are you generating the TIFFs yourself, or are they being generated as some kind of well-known TIFF derivative? If so, there may well be SDKs or well-known approaches - also, if you are not generating the data, can you really ensure that the files meet all your criteria for mmapping? If not, you will need to read/write in memory anyway... similarly, if your other software stacks are not all on the same machine, or if you are using GPUs with limited memory.

Regards,
Kemp Watson