380 Commits

Author SHA1 Message Date
Matthias Bisping
fb0b64f8d5 added hash method to config, so lru_cache can distinguish between different configs. but something is broken again in te fixture setup. using many_to_n = [True, False] hangs, while independently both pass. the consumer does not get requests in the former case, probably. 2022-06-22 15:21:14 +02:00
Matthias Bisping
1adeb4038a removed direct download strategy usages in test setups 2022-06-22 13:56:12 +02:00
Matthias Bisping
bb6b28bb4e refactoring; single dl strat now uses file descriptor manager 2022-06-22 12:30:36 +02:00
Matthias Bisping
23876501dc refactoring: de-hardcorded operation by refactoring queue message metadata fixture 2022-06-22 12:00:42 +02:00
Matthias Bisping
af88e2d7d4 file pattern matching WIP: using of different operations to select file pattern config section -- semi-hardcoded multi input file operation. next: refactor fixtures in order to de-hardcode 2022-06-22 11:18:55 +02:00
Matthias Bisping
5728961b26 file pattern matching WIP: pulled out file descriptor logic from multi dl strat and put into dedicated class; added single dl strat as default for dl strat in visitor 2022-06-22 10:18:41 +02:00
Matthias Bisping
473362b86f file pattern matching WIP: reimplememyed logic in a way that allows unifying upload (for tests) and download file descriptors. 2022-06-21 18:11:52 +02:00
Matthias Bisping
3f03e25bd3 refactoring; added operations to test config + overwriting main config in components fixture 2022-06-21 16:59:43 +02:00
Matthias Bisping
21daab2404 introduced component factory to wrap compnent getters into a config parametrized clojure 2022-06-21 14:21:56 +02:00
Matthias Bisping
562e383bdd file pattern matching WIP: added first bit of file pattern matching logic to multi dl strat 2.0.0-input-output-file-pattern-for-download-strategy_2 2022-06-21 14:02:51 +02:00
Matthias Bisping
8e3badd053 removed .*FileExtension fields from everywhere but mock_client script 2022-06-21 10:21:31 +02:00
Matthias Bisping
2362619bef fixed bug introduced by aggr strat refac: singleton lists are now unpacked before upload via default merge function 2.0.0-refactoring_18 2022-06-20 16:36:40 +02:00
Matthias Bisping
d52ac8fd74 response formatter selects map fn or fn by type of message 2022-06-20 16:34:16 +02:00
Matthias Bisping
ed7c3fabc2 omit response_files 2022-06-20 15:33:34 +02:00
Matthias Bisping
b967f3e931 map format in response formatter 2022-06-20 15:32:01 +02:00
Matthias Bisping
343637aaf7 - modified aggr strat to produce only one response message, which now contains a list of response files instead of a single response file
- introduced response formatter
2.0.0-refactoring_15
2022-06-20 15:22:59 +02:00
Matthias Bisping
3a6e9281ce fixed bug in check for empty data in refactored aggregation strategy... was correct before 2.0.0-refactoring_14 2022-06-20 14:45:09 +02:00
Matthias Bisping
0d455422b7 added aggregation strategy test + fixed bug in check for empty data in refactored aggregation strategy 2.0.0-refactoring_13 2022-06-20 14:03:01 +02:00
Matthias Bisping
e73cfe5d87 Merge branch '2.0.0' into 2.0.0-refactoring 2022-06-20 12:46:50 +02:00
Matthias Bisping
5392d03295 refactoring; removed dispatch callback from aggregation strategy 2022-06-20 12:45:59 +02:00
Julius Unverfehrt
0d87c60fce parametrize download strategy 2.0.0_25 2.0.2 2022-06-20 11:43:33 +02:00
Julius Unverfehrt
2dff7d62aa remove duplicate pickup metrics 2.0.0_24 2022-06-20 10:27:36 +02:00
Matthias Bisping
aeb60a97a9 refactoring 2022-06-20 10:09:58 +02:00
Julius Unverfehrt
e9424aee04 remove duplicate pickup metrics 2.0.0_23 2022-06-20 08:29:33 +02:00
Julius Unverfehrt
9d73f42982 remove duplicate pickup metrics 2.0.0_22 2022-06-20 08:19:51 +02:00
Matthias Bisping
5978c7d09e renaming 2.0.0-refactoring_10 2022-06-19 00:53:53 +02:00
Matthias Bisping
d69c3c32f7 removed obsolete imports 2022-06-19 00:46:10 +02:00
Matthias Bisping
27ceff60c1 info log for callback 2022-06-19 00:43:30 +02:00
Matthias Bisping
a15a792130 renaming 2.0.0-refactoring_7 2022-06-19 00:08:43 +02:00
Matthias Bisping
ece918fc0e renaming 2022-06-19 00:06:59 +02:00
Matthias Bisping
2c902f3129 refactored visitor init 2022-06-19 00:06:24 +02:00
Matthias Bisping
4df5b8f72c misc refactoring 2.0.0-refactoring_5 2022-06-18 23:53:51 +02:00
Matthias Bisping
c6c1b121a3 topological sorting of definitions by caller hierarchy 2022-06-18 23:17:13 +02:00
Matthias Bisping
02da828268 wrapped gzip.(de)compress 2.0.0-refactoring_4 2022-06-18 23:15:22 +02:00
Matthias Bisping
f795cdbc9c refactored multi download strategy 2.0.0-refactoring_3 2022-06-18 23:01:02 +02:00
Matthias Bisping
8ab13fe4fb comment changed; logging level of blob parser set to below debug 2.0.0-refactoring_2 2022-06-18 22:42:21 +02:00
Matthias Bisping
f7e4953a4e refactored visitor module: split into various submodules 2022-06-18 22:41:09 +02:00
Matthias Bisping
4aef3316a3 renaming 2.0.0_21 2.0.1 2022-06-15 15:14:17 +02:00
Matthias Bisping
41172d6abb formatting 2022-06-15 15:13:46 +02:00
Matthias Bisping
71af6f703b using function local registry for prometheus 2022-06-15 15:13:10 +02:00
Julius Unverfehrt
a5ff59069a Merge branch '2.0.0' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0 2022-06-15 14:56:06 +02:00
Julius Unverfehrt
965d79b08f add prometheus endpoint to analysis server 2022-06-15 14:52:22 +02:00
Matthias Bisping
ca6a2f8d32 fixed docker fixture 2022-06-15 14:14:38 +02:00
Matthias Bisping
86eb3a6f7e enanbled docker fixture 2022-06-15 14:01:56 +02:00
Matthias Bisping
87cf1ad189 removed obsolete imports 2022-06-15 14:00:36 +02:00
Matthias Bisping
7865a767c7 added type hint 2022-06-15 14:00:09 +02:00
Matthias Bisping
3897e44378 Merge branch '2.0.0' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0 2022-06-15 12:25:55 +02:00
Matthias Bisping
1558398c56 made object name construction logic part of download strategies 2022-06-15 12:25:27 +02:00
Matthias Bisping
8537d4af50 made object name construction logic part of download strategies 2022-06-15 12:02:41 +02:00
Matthias Bisping
116c2b8924 changed default target file extension 2022-06-15 10:31:05 +02:00