Matthias Bisping
|
c85800aefc
|
refactoring; removed obsolete config entries and code
|
2022-06-23 19:22:51 +02:00 |
|
Matthias Bisping
|
4be125952d
|
removed obsolete code
|
2022-06-23 19:14:47 +02:00 |
|
Matthias Bisping
|
ac69a5c8e3
|
refactoring: rm dl strat module
|
2022-06-23 18:58:41 +02:00 |
|
Matthias Bisping
|
efd36d0fc4
|
refactoring: multi dl strat -> downloader, rm single dl strat
|
2022-06-23 18:33:51 +02:00 |
|
Matthias Bisping
|
afffdeb993
|
operations section in config cleaned up
|
2022-06-23 16:39:22 +02:00 |
|
Julius Unverfehrt
|
671129af3e
|
rename prometheus metric name to include service name
|
2022-06-23 16:09:16 +02:00 |
|
Matthias Bisping
|
932a3e314b
|
cleaned up file descr mngr
|
2022-06-23 14:43:23 +02:00 |
|
Matthias Bisping
|
79350b4ce7
|
refactoring WIP: moving response stratgey logic into storage strategy (needs to be refactored as well, later) and file descr mngr. Here the moved code needs to be cleaned up.
|
2022-06-23 12:26:15 +02:00 |
|
Matthias Bisping
|
7e48c66f0c
|
refactoring; removed operation / response folder from output path
|
2022-06-23 12:00:48 +02:00 |
|
Matthias Bisping
|
8e6cbdaf23
|
refactoring; added operation -> file pattern mapping to file descr mngr (mainly for self-documentaton purposes)
|
2022-06-23 11:08:37 +02:00 |
|
Matthias Bisping
|
2c80d7cec0
|
refactoring: introduced input- and output-file specific methods to file descr mngr
|
2022-06-23 10:59:57 +02:00 |
|
Matthias Bisping
|
ecced37150
|
refactoring
|
2022-06-23 10:43:26 +02:00 |
|
Matthias Bisping
|
3828341e98
|
refactoring
|
2022-06-23 10:42:46 +02:00 |
|
Julius Unverfehrt
|
9a7c412523
|
add prometheus metric name for default operation
|
2022-06-22 17:04:54 +02:00 |
|
Julius Unverfehrt
|
d207b2e274
|
Merge config
|
2022-06-22 17:02:55 +02:00 |
|
Matthias Bisping
|
d3fdf36b12
|
added fixmes / todos
|
2022-06-22 17:01:12 +02:00 |
|
Julius Unverfehrt
|
f49d0b9cb7
|
update script
|
2022-06-22 16:28:25 +02:00 |
|
Julius Unverfehrt
|
5363c632d7
|
Merge branch '2.0.0-input-output-file-pattern-for-download-strategy' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0-input-output-file-pattern-for-download-strategy
|
2022-06-22 16:24:30 +02:00 |
|
Matthias Bisping
|
ac1d9781e8
|
filtering of empty data-metadata packs adjusted for dicts instead of tuples
|
2022-06-22 16:22:46 +02:00 |
|
Julius Unverfehrt
|
a37da37bbf
|
Merge branch '2.0.0-input-output-file-pattern-for-download-strategy' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0-input-output-file-pattern-for-download-strategy
|
2022-06-22 16:18:19 +02:00 |
|
Julius Unverfehrt
|
89aca22bc8
|
merge config
|
2022-06-22 16:17:57 +02:00 |
|
Matthias Bisping
|
99e7f059a7
|
filtering of callback results, such that only results remain, where at least of of data and metadata is not empty
|
2022-06-22 16:17:13 +02:00 |
|
Matthias Bisping
|
4a0bd216a4
|
Merge branch '2.0.0-refactoring' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0-input-output-file-pattern-for-download-strategy
|
2022-06-22 16:04:24 +02:00 |
|
Matthias Bisping
|
b83428d1cd
|
added fixmes
|
2022-06-22 16:02:19 +02:00 |
|
Matthias Bisping
|
36614097f3
|
update default operation config entry
|
2022-06-22 15:53:05 +02:00 |
|
Matthias Bisping
|
f51c0175ee
|
added dependencies
|
2022-06-22 15:50:40 +02:00 |
|
Matthias Bisping
|
fb0b64f8d5
|
added hash method to config, so lru_cache can distinguish between different configs. but something is broken again in te fixture setup. using many_to_n = [True, False] hangs, while independently both pass. the consumer does not get requests in the former case, probably.
|
2022-06-22 15:21:14 +02:00 |
|
Matthias Bisping
|
1adeb4038a
|
removed direct download strategy usages in test setups
|
2022-06-22 13:56:12 +02:00 |
|
Matthias Bisping
|
bb6b28bb4e
|
refactoring; single dl strat now uses file descriptor manager
|
2022-06-22 12:30:36 +02:00 |
|
Matthias Bisping
|
23876501dc
|
refactoring: de-hardcorded operation by refactoring queue message metadata fixture
|
2022-06-22 12:00:42 +02:00 |
|
Matthias Bisping
|
af88e2d7d4
|
file pattern matching WIP: using of different operations to select file pattern config section -- semi-hardcoded multi input file operation. next: refactor fixtures in order to de-hardcode
|
2022-06-22 11:18:55 +02:00 |
|
Matthias Bisping
|
5728961b26
|
file pattern matching WIP: pulled out file descriptor logic from multi dl strat and put into dedicated class; added single dl strat as default for dl strat in visitor
|
2022-06-22 10:18:41 +02:00 |
|
Matthias Bisping
|
473362b86f
|
file pattern matching WIP: reimplememyed logic in a way that allows unifying upload (for tests) and download file descriptors.
|
2022-06-21 18:11:52 +02:00 |
|
Matthias Bisping
|
3f03e25bd3
|
refactoring; added operations to test config + overwriting main config in components fixture
|
2022-06-21 16:59:43 +02:00 |
|
Matthias Bisping
|
21daab2404
|
introduced component factory to wrap compnent getters into a config parametrized clojure
|
2022-06-21 14:21:56 +02:00 |
|
Matthias Bisping
|
562e383bdd
|
file pattern matching WIP: added first bit of file pattern matching logic to multi dl strat
2.0.0-input-output-file-pattern-for-download-strategy_2
|
2022-06-21 14:02:51 +02:00 |
|
Julius Unverfehrt
|
47a095709e
|
add script to inspect compressed jsons
|
2022-06-21 13:16:35 +02:00 |
|
Julius Unverfehrt
|
453637ed59
|
refactor
2.0.0-refactoring_22
|
2022-06-21 11:45:11 +02:00 |
|
Julius Unverfehrt
|
49de36c5a0
|
refactor
|
2022-06-21 11:35:01 +02:00 |
|
Julius Unverfehrt
|
0ac5621099
|
Merge branch '2.0.0-refactoring' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0-refactoring
2.0.0-refactoring_20
|
2022-06-21 11:27:55 +02:00 |
|
Julius Unverfehrt
|
92b4416f21
|
refactor processing server set up to also work with mappings of operations to functions
|
2022-06-21 11:27:38 +02:00 |
|
Matthias Bisping
|
8e3badd053
|
removed .*FileExtension fields from everywhere but mock_client script
|
2022-06-21 10:21:31 +02:00 |
|
Matthias Bisping
|
2362619bef
|
fixed bug introduced by aggr strat refac: singleton lists are now unpacked before upload via default merge function
2.0.0-refactoring_18
|
2022-06-20 16:36:40 +02:00 |
|
Matthias Bisping
|
d52ac8fd74
|
response formatter selects map fn or fn by type of message
|
2022-06-20 16:34:16 +02:00 |
|
Matthias Bisping
|
ed7c3fabc2
|
omit response_files
|
2022-06-20 15:33:34 +02:00 |
|
Matthias Bisping
|
b967f3e931
|
map format in response formatter
|
2022-06-20 15:32:01 +02:00 |
|
Matthias Bisping
|
343637aaf7
|
- modified aggr strat to produce only one response message, which now contains a list of response files instead of a single response file
- introduced response formatter
2.0.0-refactoring_15
|
2022-06-20 15:22:59 +02:00 |
|
Matthias Bisping
|
3a6e9281ce
|
fixed bug in check for empty data in refactored aggregation strategy... was correct before
2.0.0-refactoring_14
|
2022-06-20 14:45:09 +02:00 |
|
Matthias Bisping
|
0d455422b7
|
added aggregation strategy test + fixed bug in check for empty data in refactored aggregation strategy
2.0.0-refactoring_13
|
2022-06-20 14:03:01 +02:00 |
|
Matthias Bisping
|
e73cfe5d87
|
Merge branch '2.0.0' into 2.0.0-refactoring
|
2022-06-20 12:46:50 +02:00 |
|