Ten million changes as I develop in production as LS4 starts#535
Open
rknop wants to merge 56 commits into
Open
Ten million changes as I develop in production as LS4 starts#535rknop wants to merge 56 commits into
rknop wants to merge 56 commits into
Conversation
…but are 32 individual FITS files.
…handle file:/// ; update tests to allow download from a local directory (env var configured) or env-var set url instead of just hardcoded nersc url
…mize provenance parameters, make exposure_processor.py able to handle something not in knownexposures.
…s so we don't have to included lots of subclass module files in everything that wants to process exposures.
… images. Use astrometry.net to measure the offsets of the chip centers and chip corners from TELE_RA and TELE_DEC (which is *not* centered on the array).
…hange into import_ls4
…fits.save_fits_image_file, as we just had to get something in a temp directory for astrometry.net to use and didn't want our own assumptions creeping i
…rting to bite me.
…lding for Darks, Biases, Flats. Fix top_level so it won't go past preprcessing for Darks, Biases, Flats.
…mask
Builds three Rice-compressed FITS per chip from a stack of LS4Cam bias
frames:
superbias_<CCD>.fits.fz float32, MED_BIAS = median of image
superbias_nmad_<CCD>.fits.fz float32, MB_NMAD = median of NMAD image
superbias_mask_<CCD>.fits.fz int16, 1 where NMAD > 3*1.4826*median(NMAD)
Two input layouts via --input-mode:
multi-ext (default): raw multi-extension exposures; runs
LS4Cam.overscan_and_trim internally per chip.
per-chip: flat directory of already-trimmed per-chip files;
groups by CCD_LOC header keyword. Different chips
may have different N.
Both modes have been verified to produce bit-identical superbias / NMAD /
mask outputs on the same underlying frames.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Add hacks/make_superbias.py: per-chip superbias / NMAD / bad-pixel mask
…. Incorporate Peter's superbias code into improc/make_flat and make that now a flat & bias maker. Test nothing!!!!! Tests are for the weak! Or tomorrow.
…nfig is what we think; if somebody left a local_overrides.yaml file in the top directory, the tests might wipe out a production database! Also, allow for conductor to search for exposures associated with known exposures based on provenance tag.
…t some 0-length files... this is a more general problem, of course, but in quick-hack-omg-must-get-stuff-done mode, I just put in the fix at the one place that was the current pain point.)
…se nersc spin is down
…'t include SIP unless you give it relax=True! D'oh!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.