Matthias Bisping
0842ec0d91
metadata as part of storage item WIP
2022-05-23 15:36:18 +02:00
Matthias Bisping
c944cdb1a7
refactoring: splitting source data from encoded data in data fixture
2022-05-23 13:53:50 +02:00
Matthias Bisping
7b998cdaf6
refactoring
2022-05-23 13:14:18 +02:00
Matthias Bisping
426967ee46
refactoring
2022-05-23 11:39:30 +02:00
Matthias Bisping
54ca81d577
moved parameter combination based test skipping into operation factory
2022-05-23 11:28:35 +02:00
Matthias Bisping
13888524fb
refactoring
2022-05-23 10:40:28 +02:00
Matthias Bisping
a7ffaeb18f
changed return value of file name listing function for storages to return strings of filenames rather than tuples of bucket name and file name
2022-05-23 10:19:07 +02:00
Matthias Bisping
c97393f690
skipping undefined combinations for analysis_task
2022-05-23 10:07:28 +02:00
Matthias Bisping
7ff466e0ea
added test for empty return-data operation, like classification
2022-05-23 09:58:43 +02:00
Matthias Bisping
02b0009219
data AND metadata is being uploaded instead of data only
2022-05-18 16:35:18 +02:00
Matthias Bisping
cf13f67394
refactoring: serve_test can now be run with input_data_items like image, pdf etc
2022-05-18 10:56:14 +02:00
Matthias Bisping
0ab86206ec
fixed bug introduced by overwritng 'body' as explanatory variable within try-block, which resultet in republish() receiving parsed body, instead of body as bytes
2022-05-18 10:32:54 +02:00
Matthias Bisping
35542f994c
integration test for lazy pipeline
2022-05-18 09:24:12 +02:00
Matthias Bisping
6cb13051eb
fixed following bugs:
...
- upper() did yield instead of return
- metdadata was not repeated when zipping with results generator
- since test metadata was empty dict, target data was therefore empty always, since results were zipped with {}
- hence added check for target lengths > 0
- fixed return value of queued stream function dispatcher; only returned first item of 1 -> n results
2022-05-17 21:48:16 +02:00
Matthias Bisping
456cb4157d
refactoring: move
2022-05-17 17:27:58 +02:00
Matthias Bisping
6945760045
refactoring: move
2022-05-17 15:59:04 +02:00
Matthias Bisping
fb325ce43d
renaming
2022-05-17 12:10:24 +02:00
Matthias Bisping
5590669939
pipelin laziness test works again
2022-05-17 10:44:43 +02:00
Matthias Bisping
9c262e7138
non-rest pipeline works again
2022-05-17 10:27:32 +02:00
Matthias Bisping
e5a4e7e994
applied black
2022-05-16 15:00:09 +02:00
Matthias Bisping
89f562aa71
refactoring: move
2022-05-16 14:58:19 +02:00
Matthias Bisping
1074f44b30
no buffer capacity test; commented out probably dead codde -- removing next
2022-05-16 14:34:37 +02:00
Matthias Bisping
96bf831b00
refactoring: move
2022-05-16 13:31:11 +02:00
Matthias Bisping
5d2b71d647
target data fixture and test for flat stream buffer on different data
2022-05-16 13:21:31 +02:00
Matthias Bisping
d12124b2d5
refactoring
2022-05-16 13:04:37 +02:00
Matthias Bisping
7adbdefb4e
refactoring: skipping invalid parameter combinations
2022-05-16 12:18:04 +02:00
Matthias Bisping
a1c292a485
refactoring: pulled core operation taking only data out from operation taking data and metadata
2022-05-16 11:53:52 +02:00
Matthias Bisping
948575d199
renaming
2022-05-16 11:43:48 +02:00
Matthias Bisping
2070f300c9
refactoring: queued stream function returns first of generator
2022-05-16 10:28:53 +02:00
Matthias Bisping
092a0e2964
renaming
2022-05-13 17:16:27 +02:00
Matthias Bisping
40777ae609
refactoring: simplyfing lazy processor to queued function WIP
2022-05-13 16:59:50 +02:00
Matthias Bisping
2434e0ea55
refactoring; stream buffer tests
2022-05-13 16:38:20 +02:00
Matthias Bisping
9870aa38d1
renaming
2022-05-13 15:02:05 +02:00
Matthias Bisping
c09e5df23e
refactoring: introduced flat stream buffer class
2022-05-13 12:13:59 +02:00
Matthias Bisping
bfdce62ccf
refactoring; renaming
2022-05-12 19:46:29 +02:00
Matthias Bisping
8b0c2d4e07
refactoring: further simplified queue consuming function; added one -> many test fixture param
2022-05-12 17:55:45 +02:00
Matthias Bisping
e3793e5c7c
refactoring: split stream processor into two functions; moved queue streaming Nothing check from caller to stream function
2022-05-12 17:12:26 +02:00
Matthias Bisping
de0deaa2f4
renaming
2022-05-10 12:19:42 +02:00
Matthias Bisping
83ce7692e6
renaming; adjusted and added tests for lazy bufferize (formerlay on-demand processor)
2022-05-10 12:18:20 +02:00
Matthias Bisping
949413af4a
fixed bug in compute_next of on demand processor that skipped all but the first return value of 1 -> n functions
2022-05-10 11:07:58 +02:00
Matthias Bisping
5b913983eb
refactoring: move; added null value param to bufferize
2022-05-09 14:50:54 +02:00
Matthias Bisping
f29bd7d4d3
removed need for bufferize wrapper by composing with first(chunks(...)) and applying to on-demand processor execution chain; broke mock pipeline, fixing next
2022-05-09 11:06:14 +02:00
Matthias Bisping
ec620abf54
lazy pipeline test
2022-05-09 01:17:53 +02:00
Matthias Bisping
5b30a32fff
added client pipeline without webserver backend
2022-05-09 00:43:21 +02:00
Matthias Bisping
c092e7bcab
refactoring; server pipeline WIP
2022-05-08 18:36:15 +02:00
Matthias Bisping
8c1ad64464
refactoring; additional buffer test
2022-05-07 00:29:58 +02:00
Matthias Bisping
1e21913e37
processor test; refactoring
2022-05-07 00:23:22 +02:00
Matthias Bisping
132a1a1b50
renaming
2022-05-06 23:46:21 +02:00
Matthias Bisping
f99d779c29
refactoring
2022-05-06 23:39:29 +02:00
Matthias Bisping
f428372511
renaming
2022-05-06 23:19:25 +02:00
