5505-public/dima
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Create new version v1.1.0. Data integration pipeline now does disk space check and skips data transfer if destination files already exist.

Browse Source
This commit is contained in:
florez_j
2025-06-28 16:21:26 +02:00
parent 0115745433
commit c40d138563
4 changed files with 735 additions and 27 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
CHANGELOG.md
View File

@ -20,3 +20,14 @@ Format based on [Keep a Changelog](https://keepachangelog.com) and [Semantic Ver
- Data integration pipeline with YAML-based configuration for cross-project adaptability
- Metadata revision and normalization pipeline
- HDF5 manager object for data extraction, handling, and visualization
## [1.1.0] - 2025-06-26
### Added
- Pre-transfer validation in data integration pipeline:
- Disk space check: Verifies sufficient free space before copying large datasets
- Duplicate detection: Skips transfer if destination files already exist
- Dry-run optimization: Reuses file discovery results to avoid redundant directory walks
- Include Licence
### Changed
- Update README.md with new description + authors and funding sections