96 Commits

Author SHA1 Message Date
bed43d6785 * remove usage of imc::object
* introduce imc_channel with collection of affiliate blocks
* imc::keys as list instead of map with custom check/get methods
* imc_raw: start generation of affiliate blocks
2021-02-11 12:48:49 +01:00
fb16935829 makefile: force removal of object files to suppress error 2021-02-11 08:48:32 +01:00
c649961abb makefile: use PYT variable 2021-02-11 08:45:15 +01:00
42583eb51f makefile: restore python targets + readjust cython setup 2021-02-11 08:42:10 +01:00
26ff196676 remove redundant docu 2021-02-10 20:09:20 +01:00
2697e0b578 rename directories 2021-02-10 20:04:47 +01:00
f4ecf48218 start group - channel - component - buffer association 2021-02-10 20:01:11 +01:00
9bac0f1063 * list specific blocks
* key comparison operator
* imc::object: fix timestamp, fix analog vs. digital index
* imc_raw: convert datatype
2021-02-10 18:17:54 +01:00
eb13088257 rename samples and datasets/files 2021-02-10 16:09:33 +01:00
cfca5310ef remove old (makefile + main.cpp) 2021-02-10 15:38:43 +01:00
0eb034196d imc::object: all objects parsed 2021-02-10 15:37:24 +01:00
fe3befc5f2 start parsing imc::objects 2021-02-10 13:08:32 +01:00
eb2c49549a integrate imc::object into parsing workflow 2021-02-10 11:08:08 +01:00
4f3e816dbf wrapper for imc::object, include imc::object in imc::block 2021-02-09 20:57:44 +01:00
a808a001a9 imc::objects: preliminary complete 2021-02-09 19:31:27 +01:00
e952764e4f reduce computational complexity 2021-02-09 18:11:06 +01:00
79c1b19e33 check block consistency, reset block.end for length that exceeds buffer size (e.g. final CS) 2021-02-09 16:40:11 +01:00
c918746d29 add examples from IMC documentation 2021-02-09 15:06:55 +01:00
ee7f70d36f add imc_meta.hpp 2021-02-08 18:09:02 +01:00
09737a93fb imcdatatype: simplify class name 2021-02-08 17:27:17 +01:00
cb8365a897 implement imcdatatype 2021-02-08 17:21:37 +01:00
cf7d51e2fb imc::block: fix parameters parsing 2021-02-08 16:48:22 +01:00
cf6f91a324 extract all block/parameters data 2021-02-08 16:22:28 +01:00
3c91583ede adjust to new revision, main.cpp fix help message typo 2021-02-08 10:27:20 +01:00
584243f466 full imc raw format revision 2021-02-05 19:45:33 +01:00
09011b50ba tidy up parquet from lib 2021-02-05 12:30:01 +01:00
b869c1df3f clean up docu 2021-02-05 11:00:29 +01:00
e6be107950 update name/labeling 2021-02-05 10:14:48 +01:00
21039b5225 use single docu file for format 2021-02-05 09:16:10 +01:00
Mario Fink
700a1bed82 add technical docu 2021-02-04 17:20:25 +01:00
Mario Fink
5d0b330d9e update description 2021-02-04 14:06:00 +01:00
4ca398fa8c README: fix some formatting 2021-02-04 12:06:35 +01:00
debb4c4ec0 docu revision 2021-02-04 12:02:35 +01:00
42f1ebc0b8 update README.md 2021-02-03 16:50:15 +01:00
Mario Fink
acec174b8d
Create LICENSE 2021-02-03 16:41:11 +01:00
19ff83f1d5 lib/raweat.hpp: reset validity flag when setting next file v1.0.1 2020-11-17 15:28:50 +01:00
Mario Fink
f99c37e6dd raweat.hpp: introduce error queue, find_markers: check for/consider corrupted markers v1.0.0 2020-10-14 15:30:46 +02:00
Mario Fink
043784d278 * rawmerge.hpp: generalize/fix condition for consistent timeseries
* introduce propagation of C++ exceptions to Cython/Python
* convert all cout/cerr output to exceptions
* Cython: introduce separate 'do_conversion' => avoid constructor to
trigger conversion
2020-09-18 18:43:25 +02:00
Mario Fink
3611e43276 raw_merge.hpp: fix condition for consistent time series 2020-09-15 19:34:06 +02:00
Mario Fink
17e8df68ef introduce actual default/nullary constructor in cython wrapper 2020-09-15 14:01:53 +02:00
Mario Fink
956bf8ee58 lib/raweat.hpp: constructor: only start conversion for non-empty file names 2020-08-14 11:46:49 +02:00
Mario Fink
c328bf6945 initialize raw_merger python object with empty string 2020-08-14 11:41:49 +02:00
Mario Fink
4ce51b55c7 rawmerger: write_table_all() for direct csv output of merged table 2020-08-13 16:01:54 +02:00
Mario Fink
0bd96a1426 fix bugs in lib/rawmerge.hpp: merge_channels(...) and improve example.py
- raweat.hpp: find_markers(): properly (re)adjust valid_ flag when doing multiple conversion
- rawmerge.hpp: improve logging, merge_channels(): add condition to avoid range error in vector
- example.py: obtain return flag from add_channel(), write csv output from parquet table
- main.cpp: return to pure raw_eater test version
2020-08-12 11:55:38 +02:00
Mario Fink
8d92bce9f0 simplify directory structure, adjust makefile 2020-08-12 09:30:34 +02:00
Mario Fink
4843dcf774 - cython: raw_meat: add/adjust getter method
- implement full app example in pyt/example.py
	- merges time series of all consistent channels
	- extract them into pyarrow table
	- save pyarrow table as compressed parquet file
2020-08-11 17:40:11 +02:00
Mario Fink
9bbbada6c9 - adjust example main.cpp for test of rawmerge.hpp
- add getter methods including get_num_channels in rawmerge.hpp
2020-08-11 16:07:48 +02:00
Mario Fink
99e10a4f41 rawmerge.hpp: merge core method working/debugged 2020-08-11 15:36:23 +02:00
Mario Fink
9f739d68fd python example: numpy to pyarrow and parquet 2020-08-11 11:39:17 +02:00
Mario Fink
1ee05c03a2 rawmerge.hpp: start implementation of merge 2020-08-10 17:29:49 +02:00