362 Commits

Author SHA1 Message Date
Matthias Bisping
701b43403c made adjustments for image classification with pyinfra 2.x; added related fixmes image-prediction-v2-support_2 2022-07-04 17:26:53 +02:00
Matthias Bisping
7a794bdcc9 removed obsolete imports 2.0.0-documentation_10 2022-07-04 13:05:26 +02:00
Matthias Bisping
3fc6a7ef5d enable docker-compose fixture 2.0.0-documentation_9 2022-07-04 11:47:12 +02:00
Matthias Bisping
36d8d3bc85 renaming 2022-07-04 11:46:53 +02:00
Matthias Bisping
3bf00d11cd refactoring: added cached pipeline factory 2022-06-30 12:47:57 +02:00
Matthias Bisping
90e735852a renaming 2022-06-29 13:47:08 +02:00
Matthias Bisping
93b3d4b202 further refactored server setup code: moving and decomplecting 2022-06-29 13:32:07 +02:00
Matthias Bisping
8b2ed83c7a refactored server setup code: factored out and decoupled operation registry and prometheus summary registry 2022-06-29 12:53:17 +02:00
Matthias Bisping
da2dce762b adjusted test target 2022-06-28 19:40:04 +02:00
Matthias Bisping
70df7911b9 minor refactoring 2022-06-28 19:32:38 +02:00
Matthias Bisping
0937b63dc0 support for empty operation suffix 2022-06-27 13:59:59 +02:00
Matthias Bisping
5e56917970 minor refactoring 2022-06-27 12:52:36 +02:00
Matthias Bisping
40665a7815 optimization: prefix filtering via storage API for get_all_object_names 2.0.0-documentation_2 2022-06-27 10:57:04 +02:00
Matthias Bisping
af0892a899 topological sorting of definitions by caller hierarchy 2022-06-27 10:55:47 +02:00
Matthias Bisping
94254e1681 Pull request #38: 2.0.0 input output file pattern for download strategy
Merge in RR/pyinfra from 2.0.0-input-output-file-pattern-for-download-strategy to 2.0.0

Squashed commit of the following:

commit c7ce79ebbeace6a8cb7925ed69eda2d7cd2a4783
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Fri Jun 24 12:35:29 2022 +0200

    refactor

commit 80f04e544962760adb2dc60c9dd03ccca22167d6
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Fri Jun 24 11:06:10 2022 +0200

    refactoring of component factory, callback and client-pipeline getter

commit 6c024e1a789e1d55f0739c6846e5c02e8b7c943d
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 20:04:10 2022 +0200

    operations section in config cleaned up; added upload formatter

commit c85800aefc224967cea591c1ec4cf1aaa3ac8215
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 19:22:51 2022 +0200

    refactoring; removed obsolete config entries and code

commit 4be125952d82dc868935c8c73ad87fd8f0bd1d6c
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 19:14:47 2022 +0200

    removed obsolete code

commit ac69a5c8e3f1e2fd7e828a17eeab97984f4f9746
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 18:58:41 2022 +0200

    refactoring: rm dl strat module

commit efd36d0fc4f8f36d267bfa9d35415811fe723ccc
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 18:33:51 2022 +0200

    refactoring: multi dl strat -> downloader, rm single dl strat

commit afffdeb993500a6abdb6fe85a549e3d6e97e9ee7
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 16:39:22 2022 +0200

    operations section in config cleaned up

commit 671129af3e343490e0fb277a2b0329aa3027fd73
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 16:09:16 2022 +0200

    rename prometheus metric name to include service name

commit 932a3e314b382315492aecab95b1f02f2916f8a6
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 14:43:23 2022 +0200

    cleaned up file descr mngr

commit 79350b4ce71fcd095ed6a5e1d3a598ea246fae53
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 12:26:15 2022 +0200

    refactoring WIP: moving response stratgey logic into storage strategy (needs to be refactored as well, later) and file descr mngr. Here the moved code needs to be cleaned up.

commit 7e48c66f0c378b25a433a4034eefdc8a0957e775
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 12:00:48 2022 +0200

    refactoring; removed operation / response folder from output path

commit 8e6cbdaf23c48f6eeb52512b7f382d5727e206d6
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 11:08:37 2022 +0200

    refactoring; added operation -> file pattern mapping to file descr mngr (mainly for self-documentaton purposes)

commit 2c80d7cec0cc171e099e5b13aadd2ae0f9bf4f02
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 10:59:57 2022 +0200

    refactoring: introduced input- and output-file specific methods to file descr mngr

commit ecced37150eaac3008cc1b01b235e5f7135e504b
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 10:43:26 2022 +0200

    refactoring

commit 3828341e98861ff8d63035ee983309ad5064bb30
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Jun 23 10:42:46 2022 +0200

    refactoring

commit 9a7c412523d467af40feb6924823ca89e28aadfe
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 17:04:54 2022 +0200

    add prometheus metric name for default operation

commit d207b2e274ba53b2a21a18c367bb130fb05ee1cd
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 17:02:55 2022 +0200

    Merge config

commit d3fdf36b12d8def18810454765e731599b833bfc
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Wed Jun 22 17:01:12 2022 +0200

    added fixmes / todos

commit f49d0b9cb7764473ef9d127bc5d88525a4a16a23
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 16:28:25 2022 +0200

    update script

... and 47 more commits
2.0.0_27
2022-06-24 12:59:26 +02:00
Julius Unverfehrt
0d87c60fce parametrize download strategy 2.0.0_25 2.0.2 2022-06-20 11:43:33 +02:00
Julius Unverfehrt
2dff7d62aa remove duplicate pickup metrics 2.0.0_24 2022-06-20 10:27:36 +02:00
Julius Unverfehrt
e9424aee04 remove duplicate pickup metrics 2.0.0_23 2022-06-20 08:29:33 +02:00
Julius Unverfehrt
9d73f42982 remove duplicate pickup metrics 2.0.0_22 2022-06-20 08:19:51 +02:00
Matthias Bisping
4aef3316a3 renaming 2.0.0_21 2.0.1 2022-06-15 15:14:17 +02:00
Matthias Bisping
41172d6abb formatting 2022-06-15 15:13:46 +02:00
Matthias Bisping
71af6f703b using function local registry for prometheus 2022-06-15 15:13:10 +02:00
Julius Unverfehrt
a5ff59069a Merge branch '2.0.0' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0 2022-06-15 14:56:06 +02:00
Julius Unverfehrt
965d79b08f add prometheus endpoint to analysis server 2022-06-15 14:52:22 +02:00
Matthias Bisping
ca6a2f8d32 fixed docker fixture 2022-06-15 14:14:38 +02:00
Matthias Bisping
86eb3a6f7e enanbled docker fixture 2022-06-15 14:01:56 +02:00
Matthias Bisping
87cf1ad189 removed obsolete imports 2022-06-15 14:00:36 +02:00
Matthias Bisping
7865a767c7 added type hint 2022-06-15 14:00:09 +02:00
Matthias Bisping
3897e44378 Merge branch '2.0.0' of ssh://git.iqser.com:2222/rr/pyinfra into 2.0.0 2022-06-15 12:25:55 +02:00
Matthias Bisping
1558398c56 made object name construction logic part of download strategies 2022-06-15 12:25:27 +02:00
Matthias Bisping
8537d4af50 made object name construction logic part of download strategies 2022-06-15 12:02:41 +02:00
Matthias Bisping
116c2b8924 changed default target file extension 2022-06-15 10:31:05 +02:00
Matthias Bisping
45f04590cc removed obsolete code 2022-06-15 10:25:58 +02:00
Matthias Bisping
bb729b6c26 wrapped retry decortaor, so retry behaviour can be controlled via config and set to a lower value for tests to save time 2022-06-15 10:25:53 +02:00
Matthias Bisping
24be8d3f13 test config options for logging and docker; changed object name construction 2022-06-15 09:59:47 +02:00
Matthias Bisping
147416bfad pin minio and rabbitmq again 2.0.0_2 file_extensions_and_index_handler_via_config_22 2022-06-14 17:05:33 +02:00
Matthias Bisping
c8fb15b9f7 rm retry decorator on clear_bucket, unpin minio 2022-06-14 17:02:22 +02:00
Matthias Bisping
771df7c78d make bucket before running test; rabbitmq 3.9 again 2022-06-14 16:58:27 +02:00
Matthias Bisping
f9972a95a7 fixed minio version 2022-06-14 16:44:46 +02:00
Matthias Bisping
83e1b5f029 added retry to clear bucket 2022-06-14 16:34:10 +02:00
Matthias Bisping
c1b5cbeb51 logging setup changed 2022-06-14 16:28:45 +02:00
Matthias Bisping
4fcc89f938 s3 backend fixture no longer needs to not come last 2022-06-14 15:40:23 +02:00
Matthias Bisping
d1242aee6c enable docker-compose fixture 2022-06-14 15:33:34 +02:00
Matthias Bisping
0442ecd7b3 Merge branch 'file_extensions_and_index_handler_via_config' of ssh://git.iqser.com:2222/rr/pyinfra into file_extensions_and_index_handler_via_config 2022-06-14 15:33:14 +02:00
Matthias Bisping
e64ade3135 added comments to new config params 2022-06-14 15:33:11 +02:00
Julius Unverfehrt
ace919d078 set xfail for broken tests, set docker-compose rabbitmq version to version running on production server 2022-06-14 15:10:08 +02:00
Matthias Bisping
d179fdede6 consumer test runs again...? 2022-06-14 14:17:08 +02:00
Julius Unverfehrt
9b975b759b set xfail for broken tests 2022-06-14 14:06:06 +02:00
Julius Unverfehrt
c033d98acd adjust test for new return type of visitor, add download strategy parameter to config 2022-06-14 12:33:56 +02:00
Julius Unverfehrt
bb7e631f91 introduce flag to distinguish between server side tests and complete integration tests 2022-06-14 11:56:47 +02:00