separate diagnostic plots from scripted and pipeline processing

[RichardWagener]

I'd like to remove diagnostic plots from the scripted and pipeline processes and instead put them into a separate sub-package for interactive diagnostic plots, that would read the pickel dumps and create plots on demand rather than in batch.

[amcmahon01]

This sounds like a good idea, but I think we should also leave the diagnostic generation in the main code with a configuration flag to enable/disable. That way if a section of code starts failing for some reason, we will be able to enable and view diagnostics leading up to the point of failure, not just until the last intermediate save. In addition to that, having a separate module to generate the plots from existing files on demand would be great.

[amcmahon01]

Also, some plots can't be generated directly from temporary files, so we may have to think about how to best accomplish that. For example, the coordinates of forecast points in the feature extraction plots are never saved (though maybe they should be for diagnostic purposes), so as things are now you'd have to fully re-run feature extraction to generate those.