Matthias Bisping
|
2362619bef
|
fixed bug introduced by aggr strat refac: singleton lists are now unpacked before upload via default merge function
|
2022-06-20 16:36:40 +02:00 |
|
Matthias Bisping
|
343637aaf7
|
- modified aggr strat to produce only one response message, which now contains a list of response files instead of a single response file
- introduced response formatter
|
2022-06-20 15:22:59 +02:00 |
|
Matthias Bisping
|
3a6e9281ce
|
fixed bug in check for empty data in refactored aggregation strategy... was correct before
|
2022-06-20 14:45:09 +02:00 |
|
Matthias Bisping
|
0d455422b7
|
added aggregation strategy test + fixed bug in check for empty data in refactored aggregation strategy
|
2022-06-20 14:03:01 +02:00 |
|
Matthias Bisping
|
5392d03295
|
refactoring; removed dispatch callback from aggregation strategy
|
2022-06-20 12:45:59 +02:00 |
|
Matthias Bisping
|
2c902f3129
|
refactored visitor init
|
2022-06-19 00:06:24 +02:00 |
|
Matthias Bisping
|
02da828268
|
wrapped gzip.(de)compress
|
2022-06-18 23:15:22 +02:00 |
|
Matthias Bisping
|
8ab13fe4fb
|
comment changed; logging level of blob parser set to below debug
|
2022-06-18 22:42:21 +02:00 |
|
Matthias Bisping
|
f7e4953a4e
|
refactored visitor module: split into various submodules
|
2022-06-18 22:41:09 +02:00 |
|
Matthias Bisping
|
ca6a2f8d32
|
fixed docker fixture
|
2022-06-15 14:14:38 +02:00 |
|
Matthias Bisping
|
86eb3a6f7e
|
enanbled docker fixture
|
2022-06-15 14:01:56 +02:00 |
|
Matthias Bisping
|
1558398c56
|
made object name construction logic part of download strategies
|
2022-06-15 12:25:27 +02:00 |
|
Matthias Bisping
|
45f04590cc
|
removed obsolete code
|
2022-06-15 10:25:58 +02:00 |
|
Matthias Bisping
|
bb729b6c26
|
wrapped retry decortaor, so retry behaviour can be controlled via config and set to a lower value for tests to save time
|
2022-06-15 10:25:53 +02:00 |
|
Matthias Bisping
|
24be8d3f13
|
test config options for logging and docker; changed object name construction
|
2022-06-15 09:59:47 +02:00 |
|
Matthias Bisping
|
771df7c78d
|
make bucket before running test; rabbitmq 3.9 again
|
2022-06-14 16:58:27 +02:00 |
|
Matthias Bisping
|
c1b5cbeb51
|
logging setup changed
|
2022-06-14 16:28:45 +02:00 |
|
Matthias Bisping
|
4fcc89f938
|
s3 backend fixture no longer needs to not come last
|
2022-06-14 15:40:23 +02:00 |
|
Matthias Bisping
|
d1242aee6c
|
enable docker-compose fixture
|
2022-06-14 15:33:34 +02:00 |
|
Matthias Bisping
|
e64ade3135
|
added comments to new config params
|
2022-06-14 15:33:11 +02:00 |
|
Matthias Bisping
|
d179fdede6
|
consumer test runs again...?
|
2022-06-14 14:17:08 +02:00 |
|
Julius Unverfehrt
|
9b975b759b
|
set xfail for broken tests
|
2022-06-14 14:06:06 +02:00 |
|
Julius Unverfehrt
|
c033d98acd
|
adjust test for new return type of visitor, add download strategy parameter to config
|
2022-06-14 12:33:56 +02:00 |
|
Julius Unverfehrt
|
bb7e631f91
|
introduce flag to distinguish between server side tests and complete integration tests
|
2022-06-14 11:56:47 +02:00 |
|
Matthias Bisping
|
a69f613fe6
|
completed multi download to single response logic. but broke pipeline test again, maybe?
|
2022-06-14 11:08:03 +02:00 |
|
Matthias Bisping
|
14ab23b2cc
|
fixed bug in operation wrapper returning a tuple instead of an singleton-iterable with a tuple in one of the return-cases.
|
2022-06-13 15:36:17 +02:00 |
|
Matthias Bisping
|
8a64e5d868
|
narrowed down the pytest bug: n_items interacts with s3_backend: when n_items has more than one entry, s3_backend must not be the last decorator
|
2022-06-13 10:36:26 +02:00 |
|
Matthias Bisping
|
051cea3ded
|
found bug in pytest fixture setup causing serve_test to fail (s3 backend fixture function vs s3 backend decorator fixture)
|
2022-06-13 10:15:33 +02:00 |
|
Matthias Bisping
|
40bc8c2c2c
|
debugging of queue problem, when queue is not consumed by skipping a test configuration WIP
|
2022-06-13 09:49:10 +02:00 |
|
Matthias Bisping
|
9962651d88
|
download strategy WIP: added 1 -> n upload logic
|
2022-06-10 14:06:19 +02:00 |
|
Matthias Bisping
|
1940b974b1
|
added id setting to operatin mocks and thus removed need for random seed of randomly seeded hash in storage item identifier
|
2022-06-09 15:18:41 +02:00 |
|
Matthias Bisping
|
7e46a66698
|
fixed bug in stream_pages: return -> yield
|
2022-06-09 14:58:42 +02:00 |
|
Matthias Bisping
|
e43504f08d
|
commented out consumer tests. something is wrong with the fixtures, leading to the tests failing when run together with other tests. Consumer functionality is covered by serve_test.py, but dedicated tests should be restored at a later point.
|
2022-06-08 11:03:50 +02:00 |
|
Matthias Bisping
|
bffaa0786e
|
readded correct consumer test code which git messed up
|
2022-06-07 15:48:54 +02:00 |
|
Matthias Bisping
|
8d209d63c7
|
Merge branch 'master' of ssh://git.iqser.com:2222/rr/pyinfra into fixing_consumer_tests
|
2022-06-07 15:44:39 +02:00 |
|
Matthias Bisping
|
0dee98b23d
|
consumer test adjustment WIP
|
2022-06-07 15:11:38 +02:00 |
|
Matthias Bisping
|
91701929e5
|
adjusted stream buffer test for core-operations taking tuples now
|
2022-06-07 15:08:58 +02:00 |
|
Matthias Bisping
|
c55e41f2d8
|
refactoring; tweaked json-blob-parser; added standardization case for decodable strings as storage items
|
2022-06-07 14:55:40 +02:00 |
|
Matthias Bisping
|
f718b2f7ef
|
parser composer checks for either-type
|
2022-06-03 16:34:37 +02:00 |
|
Matthias Bisping
|
e48fa85784
|
replaced trial and error logic for parsing blobs in visitor with parser composer instance
|
2022-06-03 16:18:56 +02:00 |
|
Matthias Bisping
|
6e5af4092e
|
added parsers and parser composer for clean handling of storage blobs in the context of interpreting downloaded blobs
|
2022-06-03 16:13:15 +02:00 |
|
Matthias Bisping
|
7730950b50
|
cleaning up standardization method for downloaded storage items (WIP)
|
2022-06-03 14:08:40 +02:00 |
|
Matthias Bisping
|
9a47388017
|
adjusted param fixtures for serve test
|
2022-06-03 13:48:33 +02:00 |
|
Matthias Bisping
|
8a2b60a8f5
|
applied black
|
2022-06-03 13:42:52 +02:00 |
|
Matthias Bisping
|
9232385dea
|
modified core operations to return metadata for better classification mock test
|
2022-06-03 13:40:59 +02:00 |
|
Matthias Bisping
|
eb81e96400
|
added extraction test case (with page index) to serving test
|
2022-06-03 13:13:45 +02:00 |
|
Julius Unverfehrt
|
e7ee0cda42
|
add compression for storage item before upload, update script for extraction
|
2022-06-02 15:49:28 +02:00 |
|
Matthias Bisping
|
3046b4dc26
|
misc minor fixes while integrating with pdf2image
|
2022-05-31 17:58:28 +02:00 |
|
Matthias Bisping
|
dd591bd24b
|
removed obsolete code
|
2022-05-31 16:23:14 +02:00 |
|
Matthias Bisping
|
12fa52f38c
|
removed obsolete code
|
2022-05-31 16:22:27 +02:00 |
|