61 Commits

Author SHA1 Message Date
Matthias Bisping
bf9f6ba8e2 tweaked response upload related logic and repaired visitor tests that were broken by new visitor code written for accomodating the aggregation storage strategy 2022-05-30 12:10:14 +02:00
Matthias Bisping
54ca81d577 moved parameter combination based test skipping into operation factory 2022-05-23 11:28:35 +02:00
Matthias Bisping
13888524fb refactoring 2022-05-23 10:40:28 +02:00
Matthias Bisping
a7ffaeb18f changed return value of file name listing function for storages to return strings of filenames rather than tuples of bucket name and file name 2022-05-23 10:19:07 +02:00
Matthias Bisping
0ab86206ec fixed bug introduced by overwritng 'body' as explanatory variable within try-block, which resultet in republish() receiving parsed body, instead of body as bytes 2022-05-18 10:32:54 +02:00
Matthias Bisping
6cb13051eb fixed following bugs:
- upper() did yield instead of return
 - metdadata was not repeated when zipping with results generator
 - since test metadata was empty dict,  target data was therefore empty always, since results were zipped with {}
 - hence added check for target lengths > 0
 - fixed return value of queued stream function dispatcher; only returned first item of 1 -> n results
2022-05-17 21:48:16 +02:00
Matthias Bisping
456cb4157d refactoring: move 2022-05-17 17:27:58 +02:00
Matthias Bisping
6945760045 refactoring: move 2022-05-17 15:59:04 +02:00
Matthias Bisping
fb325ce43d renaming 2022-05-17 12:10:24 +02:00
Matthias Bisping
5590669939 pipelin laziness test works again 2022-05-17 10:44:43 +02:00
Matthias Bisping
9c262e7138 non-rest pipeline works again 2022-05-17 10:27:32 +02:00
Matthias Bisping
e5a4e7e994 applied black 2022-05-16 15:00:09 +02:00
Matthias Bisping
89f562aa71 refactoring: move 2022-05-16 14:58:19 +02:00
Matthias Bisping
1074f44b30 no buffer capacity test; commented out probably dead codde -- removing next 2022-05-16 14:34:37 +02:00
Matthias Bisping
96bf831b00 refactoring: move 2022-05-16 13:31:11 +02:00
Matthias Bisping
5d2b71d647 target data fixture and test for flat stream buffer on different data 2022-05-16 13:21:31 +02:00
Matthias Bisping
d12124b2d5 refactoring 2022-05-16 13:04:37 +02:00
Matthias Bisping
7adbdefb4e refactoring: skipping invalid parameter combinations 2022-05-16 12:18:04 +02:00
Matthias Bisping
948575d199 renaming 2022-05-16 11:43:48 +02:00
Matthias Bisping
2070f300c9 refactoring: queued stream function returns first of generator 2022-05-16 10:28:53 +02:00
Matthias Bisping
092a0e2964 renaming 2022-05-13 17:16:27 +02:00
Matthias Bisping
40777ae609 refactoring: simplyfing lazy processor to queued function WIP 2022-05-13 16:59:50 +02:00
Matthias Bisping
2434e0ea55 refactoring; stream buffer tests 2022-05-13 16:38:20 +02:00
Matthias Bisping
e3793e5c7c refactoring: split stream processor into two functions; moved queue streaming Nothing check from caller to stream function 2022-05-12 17:12:26 +02:00
Matthias Bisping
de0deaa2f4 renaming 2022-05-10 12:19:42 +02:00
Matthias Bisping
83ce7692e6 renaming; adjusted and added tests for lazy bufferize (formerlay on-demand processor) 2022-05-10 12:18:20 +02:00
Matthias Bisping
949413af4a fixed bug in compute_next of on demand processor that skipped all but the first return value of 1 -> n functions 2022-05-10 11:07:58 +02:00
Matthias Bisping
5b913983eb refactoring: move; added null value param to bufferize 2022-05-09 14:50:54 +02:00
Matthias Bisping
f29bd7d4d3 removed need for bufferize wrapper by composing with first(chunks(...)) and applying to on-demand processor execution chain; broke mock pipeline, fixing next 2022-05-09 11:06:14 +02:00
Matthias Bisping
ec620abf54 lazy pipeline test 2022-05-09 01:17:53 +02:00
Matthias Bisping
5b30a32fff added client pipeline without webserver backend 2022-05-09 00:43:21 +02:00
Matthias Bisping
c092e7bcab refactoring; server pipeline WIP 2022-05-08 18:36:15 +02:00
Matthias Bisping
8c1ad64464 refactoring; additional buffer test 2022-05-07 00:29:58 +02:00
Matthias Bisping
1e21913e37 processor test; refactoring 2022-05-07 00:23:22 +02:00
Matthias Bisping
132a1a1b50 renaming 2022-05-06 23:46:21 +02:00
Matthias Bisping
f428372511 renaming 2022-05-06 23:19:25 +02:00
Matthias Bisping
54359501f9 renaming 2022-05-06 23:19:03 +02:00
Matthias Bisping
cbba561116 replaced eager endpoint in sender test 2022-05-06 23:18:37 +02:00
Matthias Bisping
3ae4fd8986 refactoring / formatting 2022-05-06 19:57:33 +02:00
Matthias Bisping
ec650464a8 bufferize test 2022-05-06 19:56:43 +02:00
Matthias Bisping
ed69011bf6 removed comment out lines 2022-05-06 19:16:17 +02:00
Matthias Bisping
5760a6f354 fixed buffer issue: buffer can overflow when called lazily, for some reason. looking into it next. 2022-05-06 19:15:02 +02:00
Matthias Bisping
dca3eaaa54 fixed buffering and result streaming: all items are yielded individually and computed on demand now 2022-05-06 12:14:09 +02:00
Matthias Bisping
1b04c46853 removed code related to eager endpoint 2022-05-05 17:25:42 +02:00
Matthias Bisping
68c24c863f removed eager endpoint (/process) 2022-05-05 17:21:47 +02:00
Matthias Bisping
bd5fe82e06 refactoring: rename 2022-05-05 15:47:25 +02:00
Matthias Bisping
b62652957a refactoring: pipeline 2022-05-05 15:15:05 +02:00
Matthias Bisping
a7a44267f1 refactoring: added pipeline class 2022-05-05 12:49:49 +02:00
Matthias Bisping
7a1db32c3b refactoring: rename 2022-05-05 11:22:17 +02:00
Matthias Bisping
456fb1db06 refactoring: move 2022-05-05 10:23:51 +02:00