Add configurable commit lookback#455
Conversation
|
Added reference to this to https://help.jellyfish.co/hc/en-us/p/feedback-portal as well. |
ashleyredzko
left a comment
There was a problem hiding this comment.
Thank you for submitting this change @rikwasmus ! This looks really useful for customers with large amounts of data and who don't need such a long lookback for commits. This change looks good to me overall!
Since this is adding an additional configuration option, please add an example of this (using the default 31) to the example.yml file for other customers who might find this configuration helpful in the future.
Once that example is added we'll leave an approval and get this in for use!
Feel free to ignore the failing Endor Labs job, we're working out some kinks with that action wrt external pull requests.
|
|
Thanks for considering @ashleyredzko |



Summary
commit_lookback_daysgit config option for commit ingestion.Motivation
For large installations that run the agent frequently, always refetching the last 31 days of commits can make each run much longer than necessary. This lets customers tune the steady-state commit lookback window without changing backpopulation behaviour or PR ingestion.
Testing
uv run pytest tests/test_config_file.py tests/test_github.py tests/test_bitbucket_cloud_adapter.py tests/test_bitbucket_server.py tests/test_gitlab_adapter.pyuv run pre-commit run black --all-filesuv run pre-commit run detect-secrets --all-filesuv run pre-commit run isort --files jf_agent/config_file_reader.py jf_agent/git/__init__.py jf_agent/git/bitbucket_cloud_adapter.py jf_agent/git/bitbucket_server.py jf_agent/git/github.py jf_agent/git/github_gql_adapter.py jf_agent/git/gitlab_adapter.py tests/test_config_file.pyuv run pre-commit run hadolint --all-files