New tool for converting Parquet-formatted dataset to HDF5(WebP)+Parquet(metadata). - #39

Draft

thompsonmj wants to merge 16 commits into

mainfrom

Commits on Nov 4, 2025

Include new h5py dependency
thompsonmj
committed
87045cd
Add neew tool for converting TOL Parquet image dataset to hybrid HDF5(WebP)+Parquet(metadata)format
thompsonmj
committed
4be4e3b
Start HDF5 docs by providing hybrid format data access instructions
thompsonmj
committed
259df60

Commits on Nov 5, 2025

Incorporate UUID validation/fix into HDF5 conversion
thompsonmj
committed
69f5dcf
Remove redundant WebP quality since already specifying lossless
thompsonmj
committed
57d8173
Register HDF5 conversion tool
thompsonmj
committed
e1a6e3d

Commits on Nov 26, 2025

Implement post-conversion copy/validate scripts
thompsonmj
committed
0f79a24
Make source/dest paths generalized
thompsonmj
committed
97b208d

Commits on Dec 1, 2025

Script to delete interim artifacts for HDF5 conversion
thompsonmj
committed
4ca4b23

Commits on Dec 2, 2025

Add function to ensure new format present in destination
thompsonmj
committed
94db0e7

Commits on Dec 4, 2025

Make a sub-group-batch version of the cleanup script
thompsonmj
committed
d3402c4
Fix dry-run log to show batch in name
thompsonmj
committed
42d37e0

Commits on Dec 9, 2025