Technical overview of netcdf interface

[pp-mo]

Summary (ideally in detail) of netcdf interfacing (i.e. save + load), analagous to the one on PP/FF

@trexfeathers suggested this can be a thin skeleton to start with
-- that gives us a place to put the awkward detail items (see below) without needing to provide a fully-fledged + rounded account from the first

See also this comment and subsequent ones ...

another case for the NetCDF I/O technical paper

I reckon we've now clocked up (at least) 4 "special detail issues" relating to netcdf, that would really like a place like that to live :

• deferred saving
• guess_axis
• chunking control
• split attributes

---

The tech papers probably shouldn't stay in the Developer's Guide really

Totally, I think they should all be combined in the further topics UserGuide area

[pp-mo]

See also #5597, now ongoing

[pp-mo]

We also really need to make it clear what Iris means by "user" attributes.
Roughly, this means non-managed ones which can exist in an ".attributes"dictionary -- unlike those which are "recognised + controlled/interpreted" by Iris, e.g. _FillValue, units, scale, conventions, axis.
However ... there are are CF attributes which are not managed by Iris, at least not at present : e.g. "references", "external_variables", "coordinate_interpolation".
And then there also CF attributes which are "recognised" by Iris but can still appear in the "user" attributes dictionary : e.g. "comment", "history".

[trexfeathers]

Additional note : the split-attributes (cube attributes) description could also be be better linked into the existing documentation. Notably, here

If you look at the latest version of this page, the specialism of CubeAttrsDict is highlighted in 2 separate places.

[pp-mo]

Additional note : the split-attributes (cube attributes) description could also be be better linked into the existing documentation. Notably, here

If you look at the latest version of this page, the specialism of CubeAttrsDict is highlighted in 2 separate places.

OK I think I failed to look in the latest version !
Removed that note

[pp-mo]

For the split-attrs notes, an account written for an internal support conversation.

""
Broadly, like any FUTURE flag, we think it is the better way + you should adopt it unless you need to preserve some specific results from legacy code.

My quick summary :
In the "old" style, some specific cube attributes (defined by CF) are always "local", i.e. attached to a data variable. Ones not defined by CF are saved as netcdf "global" attributes if they have the same value for all saved cubes, otherwise local.
In the "new" version, attributes can be recorded on the cube as either 'global' or 'local', most notably by the netcdf load. This is (mostly) respected on save, except that global settings with different values in different output cubes are "demoted" to local ones.

You see, it really isn't that simple to explain concisely ...
In fact, a complete explanation of the legacy behaviour is in itself very complicated !
""

[github-actions]

In order to maintain a backlog of relevant issues, we automatically label them as stale after 500 days of inactivity.

If this issue is still important to you, then please comment on this issue and the stale label will be removed.

Otherwise this issue will be automatically closed in 28 days time.

[pp-mo]

Still worth considering, though some of it has since been done
Topics now have a home in NetCDF I/O Handling in Iris

• ignore_axis
• guess_axis
• chunking control
• deferred saving
• split attributes