ionis-core

Core ClickHouse schemas and environment setup for the IONIS propagation analysis system

Package Contents

This package installs:

File                Path                            Description
ionis-db-init      /usr/bin/                        Database initialization script
ionis-env          /usr/bin/                        Environment variables setup
*.sql (32 files)   /usr/share/ionis-core/ddl/       ClickHouse DDL schemas
*.sh (12 files)    /usr/share/ionis-core/scripts/   Population scripts

Database Schemas

DDL                                Database     Creates
01-wspr_schema_v2.sql              wspr         bronze, v_schema_contract, v_data_integrity
02-solar_indices.sql               solar        bronze
03-solar_silver.sql                solar        v_daily_indices
04-data_mgmt.sql                   data_mgmt    config
05-geo_functions.sql               geo          v_grid_validation_example
06-lab_versions.sql                data_mgmt    lab_versions, v_lab_versions_latest
07-callsign_grid.sql               wspr         callsign_grid
08-model_features.sql              wspr         silver
09-quality_distribution_mv.sql     wspr         v_quality_distribution (MV)
10-rbn_schema_v1.sql               rbn          bronze
11-contest_schema_v1.sql           contest      bronze
12-signatures_v1.sql               wspr         signatures_v1
13-training_stratified.sql         wspr         gold_stratified
14-training_continuous.sql         wspr         gold_continuous
15-training_v6_clean.sql           wspr         gold_v6
16-validation_step_i.sql           validation   step_i_paths, step_i_voacap
17-balloon_callsigns.sql           wspr         balloon_callsigns (V1 DEPRECATED)
18-validation_quality_test.sql     validation   quality_test_paths, quality_test_voacap
19-dxpedition_synthesis.sql        dxpedition   catalog; rbn: dxpedition_paths
20-signatures_v2_terrestrial.sql   wspr         signatures_v2_terrestrial
21-balloon_callsigns_v2.sql        wspr         balloon_callsigns_v2 (date-level)
22-pskr_schema_v1.sql              pskr         bronze
23-contest_signatures.sql          contest      signatures
24-rbn_signatures.sql              rbn          signatures
25-live_conditions.sql             wspr         live_conditions
26-validation_model_results.sql    validation   model_results
27-mode_thresholds.sql             validation   mode_thresholds
28-pskr_ingest_log.sql             pskr         ingest_log
29-rbn_dxpedition_signatures.sql   rbn          dxpedition_signatures
30-rbn_ingest_log.sql              rbn          ingest_log
31-wspr_ingest_log.sql             wspr         ingest_log
32-contest_ingest_log.sql          contest      ingest_log

Installation

From COPR (Recommended)

# Enable the repository
sudo dnf copr enable ki7mt/ionis-ai

# Install
sudo dnf install ionis-core

From Source

git clone https://github.com/IONIS-AI/ionis-core.git
cd ionis-core
make build
sudo make install

Usage

1. Start ClickHouse

sudo dnf install -y clickhouse-server clickhouse-client
sudo systemctl enable --now clickhouse-server
clickhouse-client --query="SELECT version()"

2. Initialize the Database

ionis-db-init

Options:

--dry-run        Show what would be done without executing
--force          Drop and recreate tables (DESTROYS DATA)
--auto-confirm   Skip confirmation prompts (for automation)
--stamp-version  Record installed version in data_mgmt.lab_versions

3. Load Environment Variables

source /usr/bin/ionis-env

Variables exported:

CLICKHOUSE_HOST=localhost
CLICKHOUSE_PORT=9000
CLICKHOUSE_DB=wspr
DDL_PATH=/usr/share/ionis-core/ddl

Upgrading from ki7mt-ai-lab-core

The ionis-core package includes Obsoletes: ki7mt-ai-lab-core < 3.0.0, so a standard dnf upgrade will seamlessly replace the old package. Scripts are renamed:

• ki7mt-lab-db-init -> ionis-db-init
• ki7mt-lab-env -> ionis-env

Testing

make build    # Process templates
make test     # Run 7 verification tests

---

License

GPL-3.0-or-later - See COPYING

Author

Greg Beam, KI7MT

Links

• GitHub: https://github.com/IONIS-AI/ionis-core
• COPR: https://copr.fedorainfracloud.org/coprs/ki7mt/ionis-ai/
• Issues: https://github.com/IONIS-AI/ionis-core/issues