Skip to content

Releases: PySport/ingestify

0.14.0

10 Apr 08:38

Choose a tag to compare

What's Changed

  • Add BatchLoader + BatchTask for batched file loading by @koenvo in #68
  • Feature/string bucket transformation by @koenvo in #70
  • Add max_concurrency to Source for per-source parallelism control by @koenvo in #71
  • Truncate long identifier values in file paths by @koenvo in #72
  • Add fast skip pre-check to avoid loading full datasets for up-to-date entries by @koenvo in #73
  • Add GCP Secret Manager support to SecretsManager by @koenvo in #74

Full Changelog: 0.13.0...0.14.0

0.13.0

03 Apr 13:11

Choose a tag to compare

What's Changed

  • Add identifier expression indexes for high-cardinality dataset types by @koenvo in #66

Full Changelog: 0.12.1...0.13.0

0.12.1

23 Mar 11:57
073fd1e

Choose a tag to compare

What's Changed

  • Fix EventLogConsumer to drain all events before stopping by @koenvo in #65

Full Changelog: 0.12.0...0.12.1

0.12.0

19 Mar 13:48

Choose a tag to compare

What's Changed

  • Add GCS file repository support by @koenvo in #64

Full Changelog: 0.11.0...0.12.0

0.11.0

18 Mar 09:57

Choose a tag to compare

What's Changed

  • cascade delete revisions when dataset is removed by @koenvo in #60
  • Feat/low memory ingestion by @koenvo in #61
  • Add event log producer/consumer to infra layer by @koenvo in #62
  • Redesign event log with proper separation of concerns by @koenvo in #63

Full Changelog: 0.10.0...0.11.0

0.10.0

03 Feb 13:33

Choose a tag to compare

What's Changed

  • Test against mysql + fix for mysql by @koenvo in #59

Full Changelog: 0.9.4...0.10.0

0.9.4

13 Dec 20:08

Choose a tag to compare

What's Changed

  • Pass existing dataset to post_load_files method by @koenvo in #58

Full Changelog: 0.9.2...0.9.4

0.9.2

12 Dec 10:37

Choose a tag to compare

What's Changed

  • Fix repository bugs and ensure initial revision creation by @koenvo in #57

Full Changelog: 0.9.0...0.9.2

0.9.0

11 Dec 15:41

Choose a tag to compare

What's Changed

  • Add table prefix support for SQLAlchemy dataset store by @koenvo in #53
  • Feat/run post load files by @koenvo in #55
  • Add MISSING state to Dataset by @koenvo in #56

Full Changelog: 0.8.0...0.9.0

0.8.0

07 Oct 20:42
a324672

Choose a tag to compare

What's Changed

  • Fix warning message to reflect actual filter criteria by @koenvo in #50
  • Feat/dev engine by @koenvo in #51
  • Ducktype file passed to DatasetResource to allow any file with a 'rea… by @koenvo in #52

Full Changelog: 0.7.0...0.8.0