Skip to content

feat: last updates before v202611 release - #37

Merged
jeffseif merged 11 commits into
mainfrom
jeffseif/last-touchups-before-release
Nov 17, 2026
Merged

jeffseif merged 11 commits into
mainfrom
jeffseif/last-touchups-before-release

Conversation

@jeffseif

@jeffseif jeffseif commented Nov 16, 2026 •

Copy link
Copy Markdown
Member

Summary

Now that the v202611 global backfill has finished, we can update on compute timings and apply a bunch of QOL and performance changes. Only the last commit changes the output (adding a column to trace) -- so only that cache version needed to be bumped and refreshed.

The changes

  • 6a9076d, a7d7e52 docs: update timings and other docs
  • 2530bc1 QOL: we migrate all stacks that are harmonized into jdluc.harmonize.Stack so it is easier to backfill those from CLI in the future
  • e0c3ea2, c6039e3 Speed: Descals and GACED30 fast-fail when asked to ingest a tile they don't cover ... this allows for ingestion to remain on for the steps downstream like harmonize and emit without suffering noop long download times
  • ceab489 Speed: have jdluc.geo.clip_dset clip all DataArray's in a Dataset at once. This showed savings of 2-3 seconds per jurisdiction/tile during attribute, bringing an expected 6h of savings for a global refresh (!)
  • f703b12 Speed: cache mypy in GHA
  • 10142b6 Speed: have jdluc.geo.downscale_dset downscale all DataArray's in a Dataset at once. This showed savings of 2 minute per tile during the two statistical attribute algorithms, bringing an expected 10+h of savings for a gloabl refresh (!)
  • 99df26a QOL: ensure DROPPED and UNATTRIBUTED appear in all outputs, even for jurisdictions with null results
  • ac8f900 feature: include a land_occupation_m2_year_per_kg column in the trace output. Since this changed the schema, I bumped the version and refreshed the v202611 results

@jeffseif jeffseif changed the title chore: last updates before v202611 release docs: last updates before v202611 release Nov 16, 2026

@danohu danohu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

all looks excellent; my only quibble is that it's no longer really about 'docs'.

@jeffseif jeffseif changed the title docs: last updates before v202611 release feat: last updates before v202611 release Nov 17, 2026
@jeffseif

Copy link
Copy Markdown
Member Author

all looks excellent; my only quibble is that it's no longer really about 'docs'.

yes, the changes I added on expanded the scope beyond docs -- I changed the prefix from docs: to feat:

@jeffseif
jeffseif merged commit cbda2a7 into main Nov 17, 2026
2 checks passed
@jeffseif
jeffseif deleted the jeffseif/last-touchups-before-release branch November 17, 2026 14:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants