Skip to content

Releases: Open-ISP/isp-trace-parser

v2.0.3

Choose a tag to compare

@dylanjmcconnell dylanjmcconnell released this 30 Nov 22:27
c1c61c3

What's Changed

Full Changelog: v2.0.2...v2.0.3

v2.0.2

Choose a tag to compare

@dylanjmcconnell dylanjmcconnell released this 30 Nov 12:35
9b5884a

What's Changed

Full Changelog: v2.0.1...v2.0.2

v2.0.1 - minor dependency update

Choose a tag to compare

@dylanjmcconnell dylanjmcconnell released this 30 Nov 11:27
cd5ce3c

Added missing dependencies by @dylanjmcconnell in #25

Full Changelog: v2.0.0.0...v2.0.1

Release v2.0.0: Hive-partitioned storage format

Choose a tag to compare

@dylanjmcconnell dylanjmcconnell released this 30 Nov 08:36
64e4ea0

What's Changed

Full Changelog: v1.0.3...v2.0.0.0

Release Notes - Version 2.0.0

⚠️ Breaking Changes

Data format incompatibility: Version 2.0 of isp-trace-parser stores and reads parsed data in a new hive-partitioned storage format. Data originally parsed with version 1.x is not compatible with version 2.0. While the original API itself remains largely the same, upgrading from version 1.x requires either re-parsing your raw AEMO trace data or downloading pre-processed data.

Major features

Hive-partitioned parquet storage (#20)

Restructured from ~500k small half-year chunked files to efficient parquet format.

Changes:

  • Data organized by demand/, zone/, project/ (replaces solar/wind/demand)
  • Optional DuckDB-based partitioning for optimization
  • Standardized naming: area → zone, datetime/value/resource_type fields
  • Added resource_type to wind projects

Remote data download (#21)

Download trace data directly from object storage (data.openisp.au).

from isp_trace_parser.remote import fetch_trace_data

fetch_trace_data("example", dataset_src="isp_2024",
                  save_directory="data/", data_format="processed")

Features: Retry logic, progress tracking, automatic URL decoding

New query API (#19)

New API with multi-value filtering for better performance.

New functions: get_{project,zone,demand}_{single,multiple}_reference_year(s)

Key improvements:

  • List-based filtering: project=["A", "B", "C"] (avoids n+1 queries)
  • Custom column selection via select_columns
  • All 10 original API functions maintained as backward-compatible pass-throughs

Query multiple projects at once

df = get_project_single_reference_year(
project=["Project A", "Project B"],
start_year=2025, end_year=2030, ...
)

Migration from 1.x

  1. Update: pip install --upgrade isp-trace-parser
  2. Re-parse data OR download processed data (see above)
  3. (Optional) Migrate to new API for list-based filtering

Legacy functions still work with updated paths.

Other Changes

  • Comprehensive docstrings and end-to-end tests
  • Updated README with new patterns

Full Changelog: PRs #19, #20, #21

v1.0.3

Choose a tag to compare

@EllieKallmier EllieKallmier released this 11 Apr 02:27
56801f2

What's Changed

Full Changelog: v1.0.2...v1.0.3

v1.0.2

Choose a tag to compare

@nick-gorman nick-gorman released this 18 Mar 05:44
fc355e7

Fixes bug where two projects shared the same csv file and the second trace wasn't getting parsed.

v1.0.1

Choose a tag to compare

@nick-gorman nick-gorman released this 21 Nov 03:30
313da84
  • Fixes a bug where a small number of project names were being incorrectly mapped.

v1.0.0

Choose a tag to compare

@nick-gorman nick-gorman released this 09 Oct 03:02
2cc914a
  • Fully functional release with documentation

v0.1.0

Choose a tag to compare

@nick-gorman nick-gorman released this 30 Sep 04:48
5d9f859

Initial version of trace parser, core functionality in place, but docs and api to be finalised.