342 add dap id field and wire up new dag api endpoints#344

Merged

mehalter merged 54 commits into

mainfrom

342-add-dap-id-field-and-wire-up-new-dag-api-endpoints

May 18, 2026

Commits on May 8, 2026

added pipelineId and piplineRunnable keys/values to all pipeline profiles
thecaffiend
committed
first couple (untested) configs for workflow api endpoints
thecaffiend
committed
first couple (untested) workflow api endpoints
thecaffiend
committed
added pipelineId and pipelineRunnable keys/values to dap registry items. made pipeline_id part of index for lookups
thecaffiend
committed
wired up workflow meta registry to the environment variables sent off to lambda
thecaffiend
committed
first (untested) list workflow api endpoint
thecaffiend
committed
first (untested) get profiles for workflow api endpoint
thecaffiend
committed
spelling
thecaffiend
committed
moved dapregistry module to registry as it now has 2 classes
thecaffiend
committed
(untested) speculative additions to get profiles for workflow api endpoint to handle reading from the workflw and dap registries and return response
thecaffiend
committed

Commits on May 12, 2026

Commits on May 18, 2026

added pipelineRunnable: false to bactopia base dev profile.

thecaffiend
authored and
mehalter
committed
updated capepy to 2.3.0

thecaffiend
authored and
mehalter
committed
fixed bad query param name. removed useless word from error msg

thecaffiend
authored and
mehalter
committed
fixed missing param to function call. changed get_pipeline_by_id to get_pipeline per v2.4.0 of capepy

thecaffiend
authored and
mehalter
committed
changed to use env var for mwaa env name

thecaffiend
authored and
mehalter
committed
removed range key for dap registry (it's now by id). added secondary index to dap registry for name/version queries (version range key moved here). changed marshalling for pipelineRunnable to bool …

thecaffiend
authored and
mehalter
committed
added vpc config and vpc access role for lambdas. they need to be in (and have access to) the same vpc as the mwaa environment to invoke it's api.

thecaffiend
authored and
mehalter
committed
added (untested) endpoints for getting a workflow run, workflow tasks, and a workflow run's task instances

thecaffiend
authored and
mehalter
committed
added config for new workflow endpoints

thecaffiend
authored and
mehalter
committed
wired up a vpc endpoint for the airflow env (so we can hit the api in the vpc). added pulumi call to get the aws account id

thecaffiend
authored and
mehalter
committed
got away from hard coded aws account number

thecaffiend
authored and
mehalter
committed
update capepy wheel

thecaffiend
authored and
mehalter
committed
set the airflow api endpoints to timeout at 10 sec instead of 3 as they take a little longer than others

thecaffiend
authored and
mehalter
committed
fixed path and handler alias for workflows/run/taskinstances endpoint

thecaffiend
authored and
mehalter
committed
added query perms for the new dap registry index (in a way that grants perms on all indexes in tables used by api, which will be fixed later)

thecaffiend
authored and
mehalter
committed
updated to capepy 3.0.0

thecaffiend
authored and
mehalter
committed
updated to capepy 3.0.0

thecaffiend
authored and
mehalter
committed
added ignore for changes to the gsi for dap registry table as pulumi keeps reporting changes.

thecaffiend
authored and
mehalter
committed
adde query perms to database read policy (previously only had getitem)

thecaffiend
authored and
mehalter
committed
removed code that has been moved to capepy. handled change in capepy interface for getting pipeline by name/version

thecaffiend
authored and
mehalter
committed
removed code that was moved to capepy

thecaffiend
authored and
mehalter
committed
defined variables early as some code paths didn't do that.

thecaffiend
authored and
mehalter
committed
fixed a bug in the api path to get tasks for dag runs

thecaffiend
authored and
mehalter
committed
imported missing functions from capepy. fixed bug in the naming of queryparams in the airflow api invocation

thecaffiend
authored and
mehalter
committed
fixed error in the timestamp format expected by airflow. imported missing functions from capepy. fixed bug in mixing status/data from bad_params_response and response from airflow

thecaffiend
authored and
mehalter
committed
spelling errors

thecaffiend
authored and
mehalter
committed
fixed version of capepy

thecaffiend
authored and
mehalter
committed
trying to make pyright happy feels so wrong

thecaffiend
authored and
mehalter
committed
fixed bactopia 3.2.0 base id

thecaffiend
authored and
mehalter
committed
removed pipelineRunnable from all profiles

thecaffiend
authored and
mehalter
committed
hacky fix for pyright typing with new pulumi version
mehalter
committed
removed pipeline runnable

thecaffiend
authored and
mehalter
committed
Merge remote-tracking branch 'refs/remotes/gh/342-add-dap-id-field-and-wire-up-new-dag-api-endpoints' into 342-add-dap-id-field-and-wire-up-new-dag-api-endpoints

thecaffiend
authored and
mehalter
committed
removed duplicated options and obe todo

thecaffiend
authored and
mehalter
committed