Matthias Bisping
efd36d0fc4
refactoring: multi dl strat -> downloader, rm single dl strat
2022-06-23 18:33:51 +02:00
Matthias Bisping
2c80d7cec0
refactoring: introduced input- and output-file specific methods to file descr mngr
2022-06-23 10:59:57 +02:00
Matthias Bisping
1adeb4038a
removed direct download strategy usages in test setups
2022-06-22 13:56:12 +02:00
Matthias Bisping
23876501dc
refactoring: de-hardcorded operation by refactoring queue message metadata fixture
2022-06-22 12:00:42 +02:00
Matthias Bisping
8e3badd053
removed .*FileExtension fields from everywhere but mock_client script
2022-06-21 10:21:31 +02:00
Matthias Bisping
343637aaf7
- modified aggr strat to produce only one response message, which now contains a list of response files instead of a single response file
...
- introduced response formatter
2022-06-20 15:22:59 +02:00
Matthias Bisping
3a6e9281ce
fixed bug in check for empty data in refactored aggregation strategy... was correct before
2022-06-20 14:45:09 +02:00
Matthias Bisping
0d455422b7
added aggregation strategy test + fixed bug in check for empty data in refactored aggregation strategy
2022-06-20 14:03:01 +02:00
Matthias Bisping
5392d03295
refactoring; removed dispatch callback from aggregation strategy
2022-06-20 12:45:59 +02:00
Matthias Bisping
2c902f3129
refactored visitor init
2022-06-19 00:06:24 +02:00
Matthias Bisping
02da828268
wrapped gzip.(de)compress
2022-06-18 23:15:22 +02:00
Matthias Bisping
8ab13fe4fb
comment changed; logging level of blob parser set to below debug
2022-06-18 22:42:21 +02:00
Matthias Bisping
f7e4953a4e
refactored visitor module: split into various submodules
2022-06-18 22:41:09 +02:00
Matthias Bisping
1558398c56
made object name construction logic part of download strategies
2022-06-15 12:25:27 +02:00
Matthias Bisping
e64ade3135
added comments to new config params
2022-06-14 15:33:11 +02:00
Matthias Bisping
d179fdede6
consumer test runs again...?
2022-06-14 14:17:08 +02:00
Julius Unverfehrt
9b975b759b
set xfail for broken tests
2022-06-14 14:06:06 +02:00
Julius Unverfehrt
c033d98acd
adjust test for new return type of visitor, add download strategy parameter to config
2022-06-14 12:33:56 +02:00
Julius Unverfehrt
bb7e631f91
introduce flag to distinguish between server side tests and complete integration tests
2022-06-14 11:56:47 +02:00
Matthias Bisping
14ab23b2cc
fixed bug in operation wrapper returning a tuple instead of an singleton-iterable with a tuple in one of the return-cases.
2022-06-13 15:36:17 +02:00
Matthias Bisping
e43504f08d
commented out consumer tests. something is wrong with the fixtures, leading to the tests failing when run together with other tests. Consumer functionality is covered by serve_test.py, but dedicated tests should be restored at a later point.
2022-06-08 11:03:50 +02:00
Matthias Bisping
bffaa0786e
readded correct consumer test code which git messed up
2022-06-07 15:48:54 +02:00
Matthias Bisping
8d209d63c7
Merge branch 'master' of ssh://git.iqser.com:2222/rr/pyinfra into fixing_consumer_tests
2022-06-07 15:44:39 +02:00
Matthias Bisping
0dee98b23d
consumer test adjustment WIP
2022-06-07 15:11:38 +02:00
Matthias Bisping
91701929e5
adjusted stream buffer test for core-operations taking tuples now
2022-06-07 15:08:58 +02:00
Matthias Bisping
c55e41f2d8
refactoring; tweaked json-blob-parser; added standardization case for decodable strings as storage items
2022-06-07 14:55:40 +02:00
Matthias Bisping
7730950b50
cleaning up standardization method for downloaded storage items (WIP)
2022-06-03 14:08:40 +02:00
Matthias Bisping
bf9f6ba8e2
tweaked response upload related logic and repaired visitor tests that were broken by new visitor code written for accomodating the aggregation storage strategy
2022-05-30 12:10:14 +02:00
Matthias Bisping
54ca81d577
moved parameter combination based test skipping into operation factory
2022-05-23 11:28:35 +02:00
Matthias Bisping
13888524fb
refactoring
2022-05-23 10:40:28 +02:00
Matthias Bisping
a7ffaeb18f
changed return value of file name listing function for storages to return strings of filenames rather than tuples of bucket name and file name
2022-05-23 10:19:07 +02:00
Matthias Bisping
0ab86206ec
fixed bug introduced by overwritng 'body' as explanatory variable within try-block, which resultet in republish() receiving parsed body, instead of body as bytes
2022-05-18 10:32:54 +02:00
Matthias Bisping
6cb13051eb
fixed following bugs:
...
- upper() did yield instead of return
- metdadata was not repeated when zipping with results generator
- since test metadata was empty dict, target data was therefore empty always, since results were zipped with {}
- hence added check for target lengths > 0
- fixed return value of queued stream function dispatcher; only returned first item of 1 -> n results
2022-05-17 21:48:16 +02:00
Matthias Bisping
456cb4157d
refactoring: move
2022-05-17 17:27:58 +02:00
Matthias Bisping
6945760045
refactoring: move
2022-05-17 15:59:04 +02:00
Matthias Bisping
fb325ce43d
renaming
2022-05-17 12:10:24 +02:00
Matthias Bisping
5590669939
pipelin laziness test works again
2022-05-17 10:44:43 +02:00
Matthias Bisping
9c262e7138
non-rest pipeline works again
2022-05-17 10:27:32 +02:00
Matthias Bisping
e5a4e7e994
applied black
2022-05-16 15:00:09 +02:00
Matthias Bisping
89f562aa71
refactoring: move
2022-05-16 14:58:19 +02:00
Matthias Bisping
1074f44b30
no buffer capacity test; commented out probably dead codde -- removing next
2022-05-16 14:34:37 +02:00
Matthias Bisping
96bf831b00
refactoring: move
2022-05-16 13:31:11 +02:00
Matthias Bisping
5d2b71d647
target data fixture and test for flat stream buffer on different data
2022-05-16 13:21:31 +02:00
Matthias Bisping
d12124b2d5
refactoring
2022-05-16 13:04:37 +02:00
Matthias Bisping
7adbdefb4e
refactoring: skipping invalid parameter combinations
2022-05-16 12:18:04 +02:00
Matthias Bisping
948575d199
renaming
2022-05-16 11:43:48 +02:00
Matthias Bisping
2070f300c9
refactoring: queued stream function returns first of generator
2022-05-16 10:28:53 +02:00
Matthias Bisping
092a0e2964
renaming
2022-05-13 17:16:27 +02:00
Matthias Bisping
40777ae609
refactoring: simplyfing lazy processor to queued function WIP
2022-05-13 16:59:50 +02:00
Matthias Bisping
2434e0ea55
refactoring; stream buffer tests
2022-05-13 16:38:20 +02:00
