Note: This fork has been merged to the lroc branch in the original pdsc repository on Sept 19th

PDSC: Planetary Data System Coincidences

The purpose of this package is to allow quick querying via Python of remote sensing observations made of a particular location on the surface of a planetary body, or overlapping with another observation from any supported instrument. Incidentally, pdsc also allows querying based on metadata and transforming between pixel and world coordinate systems. Currently, only several instruments from Mars orbiters are supported, but the system is designed to be extensible to other instruments and bodies.

Please refer to the documentation for instructions on installation, setup, and usage.

---

Copyright 2019, by the California Institute of Technology. ALL RIGHTS RESERVED. United States Government Sponsorship acknowledged. Any commercial use must be negotiated with the Office of Technology Transfer at the California Institute of Technology.

---

Updates

Emily Dunkel: updated for LROC

Usage

First, create and activate a barebones env using python 3.7:

conda env create -f env/bare_env.yml
conda activate p37

I have also tried with python2, but when doing pip install, I got an error with incompatible numpy versions, but python 3 works, so recommend to use that.

Note: I created full and mini examples (a subset of rows) for the cases. If you take a subset of the rows, you must also update the label file with the reduced number of rows.

HiRISE Example

Download HiRISE Label and Table files:

wget -O RDRCUMINDEX.LBL https://hirise-pds.lpl.arizona.edu/PDS/INDEX/RDRCUMINDEX.LBL
wget -O RDRCUMINDEX.TAB https://hirise-pds.lpl.arizona.edu/PDS/INDEX/RDRCUMINDEX.TAB

To ingest indices:

pdsc_ingest -c pdsc/config/hirise_rdr_metadata.yaml /home/edunkel/PDS/lroc_proj/pdsc/inputs/hirise/RDRCUMINDEX.LBL /home/edunkel/PDS/lroc_proj/pdsc/outputs_hirise/

Or, a mini example (I took a 9 row subset of the full table file and updated the index accordingly):

pdsc_ingest -c pdsc/config/hirise_rdr_metadata.yaml /home/edunkel/PDS/lroc_proj/pdsc/inputs_mini/hirise/RDRCUMINDEX.LBL /home/edunkel/PDS/lroc_proj/pdsc/outputs_hirise_mini/

CTX example:

pdsc_ingest /pds/pdsfs2/pdsdata/mro/ctx/mrox_4098/index/cumindex.tab /home/edunkel/PDS/lroc_proj/pdsc/outputs_ctx/ 

Or, a mini example (I took a subset of rows from the table file and updated the index accordingly):

pdsc_ingest /home/edunkel/PDS/lroc_proj/pdsc/inputs_mini/ctx/cumindex.tab /home/edunkel/PDS/lroc_proj/pdsc/outputs_ctx_mini/

LROC

Full lroc database:

pdsc_ingest -c pdsc/config/lroc_cdr_metadata.yaml /home/edunkel/PDS/lroc_proj/pdsc/inputs/lroc/CUMINDEX.LBL /home/edunkel/PDS/lroc_proj/pdsc/outputs/lroc/

Here is a mini example for lroc:

pdsc_ingest -c pdsc/config/lroc_cdr_metadata.yaml /home/edunkel/PDS/lroc_proj/pdsc/inputs_mini/lroc/CUMINDEX.LBL /home/edunkel/PDS/lroc_proj/pdsc/outputs_lroc_mini/

Note: I need to check SIS documentation for localization function coordinate system, but PDSC is now able to handle bodies other than just Mars (was originally hard-coded).

Basic Usage

Follow the docs for basic usage, but make sure you're in the python prompt:

# set the directory where the database is stored:
export PDSC_DATABASE_DIR=/home/edunkel/PDS/lroc_proj/pdsc/outputs/lroc/
python
>>> import pdsc
>>> pds_client = pdsc.PdsClient()
>>> metadata = pds_client.query_by_observation_id('lroc_cdr', ' M101014437RC')
>>> mydata = metadata[0]
>>> localizer = pdsc.get_localizer(mydata, browse=True)
>>> lat, lon = localizer.pixel_to_latlon(10, 10)

Scripts

To get lroc distributed samples around the globe, you can call get_distritubed_samples.py. Either pass in parameters from the command line, or update the defaults in the script. Here is a calling example:

conda activate p37
# point to database
export PDSC_DATABASE_DIR=/home/edunkel/PDS/lroc_proj/pdsc/outputs/lroc/
python scripts/get_distributed_samples.py -o OUTPUT/FILE -n NUM_SAMPLES

This will print a list of examples with their sun angle (which helps with labeling, since craters look different depending on where the sun is).

I have a script to assemble the data from this list in the deep learning repository here: https://github.jpl.nasa.gov/PDSIMG/deep-learning/blob/master/src/lroc/salience/scripts/assemble_data.py