2019.03.30 18:43 "Re: [Tiff] combining TIFF images, not multi-page", by Paul Hemmer

Thanks for all the comments and suggestions everyone.

Indeed, high-resolution, high-volume microscopy can quickly create extremely large datasets. In fact my preference now for these sorts of datasets is the HDF5 format. One file, arbitrary size, multi-channel, multi-plane datasets stored in a tiled and pyramidal way allowing for extremely fast access to any ROI. Works great. Of course this requires a suitable viewer (something like Imaris from Bitplane).. But some customers don't have those viewers, yet want the huge datasets in a useful way, and for most that still means TIFF or BigTIFF (even though BigTIFF still limits their viewing choices.) I've also implemented a zoomify/OpenSeadragon style pyramid rendering which works quite well but unfortunately produces millions of tiny files which can become extremely cumbersome to manage/move, thus the desire for a single-file container. That's really the gist of what I'm asking, what's the correct way to build out a very large TIFF file incrementally.. Sounds like Tiled Pyramids are the way and should be doable with LibTIFF. (The sizing and alignment of the source data which gets cached to individual files on disc is under my precise control, so it's not a generic solution I'm looking for necessarily.)

Thanks for pointing out ZIF again Kemp. I had looked at that briefly some time ago but forgot about it. Your page for ZIF says "support for very large images and web browser image codecs, to enable serverless delivery of images to modern web browsers and other network client applications".. I'd like to learn more about that, specifically the "serverless delivery" aspect. (but that's a topic for another thread.)

GDAL also looks rather interesting as well.

thanks!

________________________________

From: Tiff <tiff-bounces@lists.osgeo.org> on behalf of Kemp Watson <kemp@objectivepathology.com>

Sent: Saturday, March 30, 2019 10:28 AM

To: Even Rouault; tiff@lists.osgeo.org

Subject: Re: [Tiff] combining TIFF images, not multi-page

We regularly deal with images 100 - 1,000 billion pixels in BigTIFF, just mentioning this so that participants here understand well that TIFF is not just being used for fax page and high quality print layout any more, there are extremely large scientific data sets stored in the format. BigTIFF is one way to address these.

On 2019-03-30, 10:23 AM, "Tiff on behalf of Even Rouault" <tiff-bounces@lists.osgeo.org on behalf of even.rouault@spatialys.com> wrote:

    > TIFF (po