164 Commits

Author SHA1 Message Date
Jonathan Kössler
b46fcbd977 feat: add AioPikaInstrumentor 2024-09-25 11:58:51 +02:00
Francisco Schulz
8ec13502a9 fix: add semaphore to AsyncQueueManager to limit concurrent tasks 2024-09-23 15:19:40 +02:00
francisco.schulz
2b129b35f4 fix(queuemanager): add retries to prevent container from shutting down when queues are not available yet 2024-08-29 11:17:11 -04:00
Jonathan Kössler
b6a2069a6a feat: add ClientConnectorError 2024-08-28 10:28:12 +02:00
Jonathan Kössler
318779413a fix: add signal to webserver 2024-08-23 17:23:53 +02:00
Jonathan Kössler
f2018f9c86 fix: process message in thread in event loop 2024-08-23 16:56:24 +02:00
Jonathan Kössler
1e939febc2 refactor: function naming 2024-08-21 17:02:04 +02:00
Jonathan Kössler
fa44f36088 feat: add async webserver for probes 2024-08-21 16:24:20 +02:00
Jonathan Kössler
dba348a621 refactor: tenant queues settings 2024-08-19 14:37:48 +02:00
Jonathan Kössler
2bc332831e fix: use is_initialized instead of is_open 2024-08-16 12:37:28 +02:00
Jonathan Kössler
06ce8bbb22 Merge branch 'master' into feat/RES-757-protobuffer 2024-08-05 11:01:40 +02:00
Jonathan Kössler
cb8509b120 refactor: message counter 2024-08-01 17:42:59 +02:00
Jonathan Kössler
47b42e95e2 refactor: graceful shutdown 2024-08-01 15:31:58 +02:00
Jonathan Kössler
b12b1ce42b refactor: use protoc 4.25.x as compiler to avoid dependency issues 2024-07-31 16:04:43 +02:00
Jonathan Kössler
50b7a877e9 fix: poetry lock 2024-07-30 10:45:37 +02:00
Jonathan Kössler
f3d0f24ea6 Merge branch 'master' into feat/RES-757-protobuffer 2024-07-30 10:40:56 +02:00
Jonathan Kössler
2a2028085e feat: add async retry for tenant server calls 2024-07-25 14:45:19 +02:00
Jonathan Kössler
23aaaf68b1 refactor: simplify rabbitmq config 2024-07-23 18:34:50 +02:00
Jonathan Kössler
c7e0df758e feat: add async health endpoint 2024-07-23 15:42:48 +02:00
Jonathan Kössler
1520e96287 refactor: cleanup codebase 2024-07-22 16:57:02 +02:00
Jonathan Kössler
596d4a9bd0 feat: add expiration for tenant event queue and retry to tenant api call 2024-07-22 16:48:31 +02:00
Julius Unverfehrt
70d3a210a1 feat: update data loader tests
We now compare the output proto json conversion to expected json files.
This revealed multiple differences between the file.

FIXED: int64 type was cast into string in python. We now get proper
integers

TODO: Empty fields are omitted by proto, but the jsons have them and the
pyinfra implementing services might expect them. We have to test this
behaviour and adjusts the tests accordingly.
2024-07-18 12:36:29 +02:00
Jonathan Kössler
f935056fa9 refactor: dataloader to not crash on unknown file formats 2024-07-17 13:54:50 +02:00
Jonathan Kössler
eeb4c3ce29 fix: add await to is_ready 2024-07-17 11:41:31 +02:00
Jonathan Kössler
b8833c7560 fix: settings mapping 2024-07-17 10:51:14 +02:00
Julius Unverfehrt
0d232226fd feat: integrate proto data loader in pipeline 2024-07-16 17:34:39 +02:00
Julius Unverfehrt
9d55b3be89 feat: implement proto data loader 2024-07-16 16:32:58 +02:00
Julius Unverfehrt
edba6fc4da feat: track proto schmemata & add compilations to package 2024-07-16 16:31:48 +02:00
Jonathan Kössler
02665a5ef8 feat: align async queue manager 2024-07-12 15:14:13 +02:00
Jonathan Kössler
3c3580d3bc feat: add backwards compatibility 2024-07-12 12:26:56 +02:00
Jonathan Kössler
8ac16de0fa feat: add backwards compatibility 2024-07-12 12:23:45 +02:00
Jonathan Kössler
8844df44ce feat: add async_v2 2024-07-12 12:12:55 +02:00
Jonathan Kössler
2da4f37620 feat: wip for multiple tenants - for pkg build 2024-07-11 12:49:07 +02:00
Jonathan Kössler
9b20a67ace feat: wip for multiple tenants - for pkg build 2024-07-11 11:41:09 +02:00
Jonathan Kössler
7b6408e0de feat: wip for multiple tenants - for pkg build 2024-07-11 11:04:02 +02:00
Jonathan Kössler
6e7c4ccb7b feat: wip for multiple tenants - for pkg build 2024-07-10 11:45:47 +02:00
Jonathan Kössler
b2e3ae092f feat: wip for multiple tenants 2024-07-09 18:20:55 +02:00
Jonathan Kössler
de41030e69 feat: wip for multiple tenants 2024-07-05 13:27:16 +02:00
Jonathan Kössler
c81d967aee feat: wip for multiple tenants 2024-07-03 17:51:47 +02:00
Jonathan Kössler
30330937ce feat: wip for multiple tenants 2024-07-02 18:07:23 +02:00
Jonathan Kössler
7624208188 feat: wip for multiple tenants 2024-07-01 18:15:04 +02:00
Jonathan Kössler
6fabe1ae8c feat: wip for multiple tenants 2024-06-28 15:41:53 +02:00
Jonathan Kössler
3532f949a9 refactor: remove second trace setup 2024-06-26 18:15:51 +02:00
Jonathan Kössler
65cc1c9aad fix: improve error handling for tracing settings 2024-06-26 18:02:52 +02:00
Jonathan Kössler
18a0ddc2d3 feat: add tracing settings to validator 2024-06-13 08:47:50 +02:00
Jonathan Kössler
5328e8de03 refactor: streamline tracing types 2024-06-12 10:41:52 +02:00
Jonathan Kössler
9661d75d8a refactor: update tracing info for Azure Monitor 2024-06-11 14:31:06 +02:00
Jonathan Kössler
7dbcdf1650 feat: add azure opentelemtry monitoring 2024-06-11 12:00:18 +02:00
Julius Unverfehrt
b810449bba feat: add multiple file download
The download function is now overloaded and additionlly supports a
dict with file paths as values, in addition to the present string as
file path. The data is forwarded as dict of the same structure in the
first case.
2024-04-18 16:35:55 +02:00
Julius Unverfehrt
021222475b fix: add error handling for file not found error
When a file couldn't be downloaded from storage, the queue consumer now
informs the operator with a log and rejects the message, without crashing
but continuing its honest work.
2024-04-16 16:20:08 +02:00