798fc22d7a
imc_conversion.hpp: more comprehensive error message, imc_datatype: imc_Ulongint,imc_Slongint typedef for x86_64 vs. arm
2021-04-27 12:42:24 +02:00
2b2e69f0e5
* add support for datatype 11 = 2-byte-word digital
...
* usage.py: raise proper exception
* usage_adv.py: use different example file
2021-04-27 11:38:43 +02:00
Mario Fink
8708d2d008
* cython/py_imc_termite.pyx: json loads take care of floats, fix column assignment
...
* imc_channel.hpp: fix floating precision for get_channel()
* extend/include advanced usage in examples
2021-04-26 19:41:56 +02:00
97c2195f98
ignore hexshow.hpp, version 1.2.3
2021-03-05 09:19:06 +01:00
4c082451fa
finalize README.md + example + cython interface
2021-02-12 13:22:15 +01:00
dd78b37290
cython setup imc_termite pytho module
2021-02-12 11:30:16 +01:00
3d9305a1be
prepare imc_channel + imc_raw for cython interface
2021-02-12 09:52:52 +01:00
3948bfeac6
fix/improve printing and CLI
2021-02-11 19:54:09 +01:00
6b41dbe00a
add printing methods
2021-02-11 19:39:11 +01:00
0107e367c4
finished conversion + CLI
2021-02-11 19:21:26 +01:00
3afa7fe345
channel: add origin NO
2021-02-11 17:21:39 +01:00
a03930515e
finished metadata extraction
2021-02-11 17:17:09 +01:00
6f9133c638
start extraction
2021-02-11 16:03:49 +01:00
acd55194a5
imc_raw + imc_channels: channel extraction from blocks and environment
2021-02-11 15:49:11 +01:00
1596ca15b5
generate channel_envs
2021-02-11 13:38:07 +01:00
4b510ea91b
remove redundant stuff related to imc_object
2021-02-11 12:52:53 +01:00
bed43d6785
* remove usage of imc::object
...
* introduce imc_channel with collection of affiliate blocks
* imc::keys as list instead of map with custom check/get methods
* imc_raw: start generation of affiliate blocks
2021-02-11 12:48:49 +01:00
f4ecf48218
start group - channel - component - buffer association
2021-02-10 20:01:11 +01:00
9bac0f1063
* list specific blocks
...
* key comparison operator
* imc::object: fix timestamp, fix analog vs. digital index
* imc_raw: convert datatype
2021-02-10 18:17:54 +01:00
0eb034196d
imc::object: all objects parsed
2021-02-10 15:37:24 +01:00
fe3befc5f2
start parsing imc::objects
2021-02-10 13:08:32 +01:00
eb2c49549a
integrate imc::object into parsing workflow
2021-02-10 11:08:08 +01:00
4f3e816dbf
wrapper for imc::object, include imc::object in imc::block
2021-02-09 20:57:44 +01:00
a808a001a9
imc::objects: preliminary complete
2021-02-09 19:31:27 +01:00
e952764e4f
reduce computational complexity
2021-02-09 18:11:06 +01:00
79c1b19e33
check block consistency, reset block.end for length that exceeds buffer size (e.g. final CS)
2021-02-09 16:40:11 +01:00
ee7f70d36f
add imc_meta.hpp
2021-02-08 18:09:02 +01:00
09737a93fb
imcdatatype: simplify class name
2021-02-08 17:27:17 +01:00
cb8365a897
implement imcdatatype
2021-02-08 17:21:37 +01:00
cf7d51e2fb
imc::block: fix parameters parsing
2021-02-08 16:48:22 +01:00
cf6f91a324
extract all block/parameters data
2021-02-08 16:22:28 +01:00
584243f466
full imc raw format revision
2021-02-05 19:45:33 +01:00
09011b50ba
tidy up parquet from lib
2021-02-05 12:30:01 +01:00
19ff83f1d5
lib/raweat.hpp: reset validity flag when setting next file
2020-11-17 15:28:50 +01:00
Mario Fink
f99c37e6dd
raweat.hpp: introduce error queue, find_markers: check for/consider corrupted markers
2020-10-14 15:30:46 +02:00
Mario Fink
043784d278
* rawmerge.hpp: generalize/fix condition for consistent timeseries
...
* introduce propagation of C++ exceptions to Cython/Python
* convert all cout/cerr output to exceptions
* Cython: introduce separate 'do_conversion' => avoid constructor to
trigger conversion
2020-09-18 18:43:25 +02:00
Mario Fink
3611e43276
raw_merge.hpp: fix condition for consistent time series
2020-09-15 19:34:06 +02:00
Mario Fink
956bf8ee58
lib/raweat.hpp: constructor: only start conversion for non-empty file names
2020-08-14 11:46:49 +02:00
Mario Fink
4ce51b55c7
rawmerger: write_table_all() for direct csv output of merged table
2020-08-13 16:01:54 +02:00
Mario Fink
0bd96a1426
fix bugs in lib/rawmerge.hpp: merge_channels(...) and improve example.py
...
- raweat.hpp: find_markers(): properly (re)adjust valid_ flag when doing multiple conversion
- rawmerge.hpp: improve logging, merge_channels(): add condition to avoid range error in vector
- example.py: obtain return flag from add_channel(), write csv output from parquet table
- main.cpp: return to pure raw_eater test version
2020-08-12 11:55:38 +02:00
Mario Fink
4843dcf774
- cython: raw_meat: add/adjust getter method
...
- implement full app example in pyt/example.py
- merges time series of all consistent channels
- extract them into pyarrow table
- save pyarrow table as compressed parquet file
2020-08-11 17:40:11 +02:00
Mario Fink
9bbbada6c9
- adjust example main.cpp for test of rawmerge.hpp
...
- add getter methods including get_num_channels in rawmerge.hpp
2020-08-11 16:07:48 +02:00
Mario Fink
99e10a4f41
rawmerge.hpp: merge core method working/debugged
2020-08-11 15:36:23 +02:00
Mario Fink
1ee05c03a2
rawmerge.hpp: start implementation of merge
2020-08-10 17:29:49 +02:00
Mario Fink
7316d59c2c
- add cython .cpp files to .gitignore
...
- raweat.hpp: add empty constructor and introduce "set_file"
- rawmerge.hpp: add initial channel and write_table method
- add rawmeat example to pyt/example.py
- add raw_merger.hpp to main.cpp
2020-08-10 14:54:15 +02:00
Mario Fink
23f933f68e
check markers resolving #1
2020-08-10 12:33:11 +02:00
Mario Fink
f8dcc6493f
initialize new cython module raw_meat
2020-08-10 12:03:35 +02:00
Mario Fink
ecd364d482
fix typo
2020-08-10 10:28:58 +02:00
2e8fea74a6
pyarrow_test.py: changed compression to BROTLI, fixed encoding in text
2020-08-05 11:58:17 +02:00
3618ed9ee8
-> correction write_table vs. write_data in main.cpp
...
-> container build of pyarrow (i.a. for armv7l build)
2020-08-05 11:32:02 +02:00
