Commit Graph

423 Commits

Author SHA1 Message Date
f07dfc0a81 Add json and yaml extensions to admissible file extension lists. 2025-01-21 08:57:38 +01:00
de9c45c21f Updated to cleared jupyter notebooks 2025-01-14 14:46:43 +01:00
ba49b168c4 Added comments to explain configuration parameters/or variables. 2025-01-14 14:25:53 +01:00
df4bd2b3ae Add directory tree structure description. 2024-12-04 17:20:35 +01:00
368e4ce6d8 Update .gitignore with output_files/ 2024-12-04 16:53:57 +01:00
4d87169732 Add .gitkeep and keep this folder empty. it is only to be used for local processing 2024-12-04 16:52:50 +01:00
32c1bd0731 Update readme with getting started section 2024-12-04 16:24:14 +01:00
b13b4a4b57 Solved binary incompatibility issue of generated environment by conda installing h5py and numpy from conda-forge or default channels. 2024-12-04 16:15:42 +01:00
5fa28ca917 Updated bash script and yml env file to set up python interpreter. 2024-12-04 13:52:35 +01:00
d787ce6972 Update to readme.md 2024-12-03 13:55:45 +01:00
941bf0e784 Update readme with key features of the repo. 2024-12-03 13:50:53 +01:00
68cf2f8d3e Updated README.md with software arquitecture figure 2024-12-02 17:28:22 +01:00
99cc6faf11 Updated README.md with software arquitecture figure 2024-12-02 17:24:48 +01:00
39eec2679e Updated README 2024-12-02 17:22:52 +01:00
6319c36cfb Updated figure name. 2024-12-02 17:08:36 +01:00
c97ff1208e Updated ci runner pipeline fot gitlab page 2024-12-02 16:31:49 +01:00
6899894ba1 Updated documentation and built doc website 2024-12-02 16:31:03 +01:00
fc139e0ae5 Relocated to visualization module 2024-12-02 15:39:41 +01:00
ef8cf9bb4e Add __init__.py 2024-12-02 15:36:03 +01:00
d79877cc9b Moved hdf5_lib.py to visualization folder 2024-12-02 15:34:44 +01:00
fa9edcb115 Removed no longer useful notebook 2024-12-02 15:32:57 +01:00
1bc145530c Added env file specification and bash script for env setup 2024-12-02 15:10:21 +01:00
2eec2155b5 removed review folder. This is now supposed to be create for review of experimental campaign data objects metadata. 2024-12-02 14:32:34 +01:00
b6a41c3378 Configure GitLab Pages 2024-11-26 13:43:09 +01:00
13f070e4c9 Add draft of dima documentation 2024-11-26 13:40:43 +01:00
22e201d063 Removed bacause some of the functionalities have been outsourced to other modules src/hdf5_ops.py and src/hdf5_writer.py 2024-11-26 11:55:06 +01:00
80a7b650af Merge branch 'main' of https://gitlab.psi.ch/5505/dima 2024-11-25 15:50:25 +01:00
f483e8d7fe Updated instrument dictionaries with variable descriptor names aligned with CF metadata conventions. 2024-11-25 15:49:49 +01:00
fed9aa0a1b Update to DIMA package path resolution from file. 2024-11-24 19:45:18 +01:00
85d44d71d6 Attempt to dynamically resolve path to dima package, when excecuted from command line. 2024-11-24 17:37:38 +01:00
6dc89d34fe Commented out metadata info about group members for a given group. This is to simplify yaml or json representation of the metadata. 2024-11-24 15:57:54 +01:00
60f9278f10 Reimplemented code snippet using hdf5_Writer module 2024-11-24 11:32:26 +01:00
3db2eeb041 Moved func create_hdf5_file_from_dataframe() from hdf5_lib_part2 into hdf5_write.py 2024-11-24 11:30:08 +01:00
2740330709 Moved read_mtable_as_dataframe(filename) to src/hdf5_ops.py 2024-11-24 11:03:44 +01:00
ff31c14f92 Removed logs/ folder. This is usually created locally to trace certain file copying, transfer and conversion processes. 2024-11-24 10:51:05 +01:00
01767340f9 Rerun jupyternotebooks to check their functionality after relocating them to notebooks. OpenBis related python scripts still need to be tested. 2024-11-24 10:45:40 +01:00
7708153a62 Add hidden.py to the list. This file may contain sensitive information is only to be accessed locally or from a secure location. 2024-11-24 10:41:32 +01:00
53fae27472 Check whether h5 file being written exists. If so, we do not overwrite it because it may be underdoing refinement, changes or updates, for archiving, sharing, or publishing. 2024-11-24 10:38:13 +01:00
d10786a534 Add utility functions add_project_path_to_sys_path() to set up path to DIMA's modules dynamically. 2024-11-24 10:08:19 +01:00
058b82ff88 Moved demos .py to notebooks. Note: Maybe turn them to jupyternotebooks for consistency 2024-11-24 07:49:50 +01:00
2988d816af Added read_mtable_as_dataframe(filename) back so that jupyter notebook can use it to demonstrate some functionality 2024-11-23 16:31:29 +01:00
ac80b9a3ca Implemented sanitize dataframe function to deal with 'O' which may have numbers or strings detected as string types. Then we use it prior to convert dataframe into structured numpy array. 2024-11-23 16:28:49 +01:00
ca23e363c9 Moved to notebooks/ 2024-11-23 12:29:55 +01:00
feee8762ed Moved to notebooks/ 2024-11-23 12:16:13 +01:00
cc7ad749ca Moved to notebooks/ to improve repo organization 2024-11-23 12:06:27 +01:00
13cb5476b1 Moved data integration ipynb to notebooks folder to improve readability 2024-11-23 11:24:28 +01:00
05f16bf717 Added .pkl extension in the list of admissible file extensions 2024-11-21 11:47:41 +01:00
59e910a0f9 Modified logger setup to create monthly logs 2024-11-21 11:46:11 +01:00
90ae93c124 Added a logs/ and envs/ folder to gitignore. 2024-11-21 11:44:38 +01:00
870d60a789 Improved progress description stdout 2024-11-10 18:21:00 +01:00