Julius Unverfehrt
87cbf89672
finnish config loading logic
2024-01-19 14:05:05 +01:00
Julius Unverfehrt
9c2f34e694
Put add health check in own function
2024-01-19 13:13:12 +01:00
Julius Unverfehrt
fbbfc553ae
fix message encoding for response, rename some functions
2024-01-19 12:46:02 +01:00
Julius Unverfehrt
b7f860f36b
WIP: add callback factory and update example scripts
2024-01-18 17:10:04 +01:00
Julius Unverfehrt
6802bf5960
refactor: download and upload file logic, module structure, remove redundant files so far
2024-01-18 15:54:38 +01:00
Julius Unverfehrt
ec5ad09fa8
refactor: multi tenant storage connection
2024-01-18 11:34:21 +01:00
Julius Unverfehrt
17c5eebdf6
finnish prometheus
2024-01-18 08:19:46 +01:00
Julius Unverfehrt
358e227251
fix prometheus tests WIP
2024-01-17 17:39:53 +01:00
Julius Unverfehrt
f31693d36a
refactor: adapt prometheus monitoring logic to work with other webservers WIP
2024-01-16 17:24:53 +01:00
Julius Unverfehrt
e5c8a6e9f1
refactor: update storages with dynaconf logic, add validators, repair test
2024-01-16 15:34:56 +01:00
Julius Unverfehrt
27917863c9
refactor: finnish queue manager, queue manager tests, also add validation logic, integrate new settings
2024-01-16 14:35:23 +01:00
Julius Unverfehrt
ebc519ee0d
refactor: finnish queue manager, queue manager tests, also add validation logic, integrate new settings
2024-01-16 14:16:27 +01:00
Julius Unverfehrt
b49645cce4
refactor: queue manager and config logic WIP
2024-01-15 16:46:33 +01:00
Julius Unverfehrt
64871bbb62
refactor: add basic queue manager test
2024-01-15 10:30:07 +01:00
Julius Unverfehrt
1f482f2476
fix: storage test
2024-01-09 16:07:48 +01:00
Francisco Schulz
8dfba74682
Merge branch 'RED-7958-logging-issues-of-python-services' into 'master'
...
Red 7958 logging issues of python services
See merge request knecon/research/pyinfra!81
2023-11-28 10:21:37 +01:00
francisco.schulz
570689ed9b
increment version
2023-11-28 09:35:46 +01:00
francisco.schulz
5db56d8449
update CI template
2023-11-28 09:20:22 +01:00
francisco.schulz
3a9d34f9c0
add loglevel tests & fix broken exception and error log tests
2023-11-28 09:16:42 +01:00
francisco.schulz
3084d6338c
update dependencies for kn-utils@0.2.4.dev112
2023-11-28 09:16:05 +01:00
Julius Unverfehrt
3a3a8e4ce1
Merge branch 'feature/version-upgrade-knutils-logging' into 'master'
...
Upgrade python version & change logger
See merge request knecon/research/pyinfra!80
2023-11-13 15:48:22 +01:00
Julius Unverfehrt
bb00c83a80
Upgrade python version & change logger
...
- Upgrades python version to 3.10 and sync packages with isaacs list.
- Changes loguru logger to kn_utlis logger.
- Overrides python version in CI script (temporarily until all services
are updated and CI template can be adjusted).
2023-11-13 15:28:49 +01:00
Julius Unverfehrt
b297894505
Merge branch 'feature/stack-trace-for-exeptions' into 'master'
...
Add stacktrace to processing failures
See merge request knecon/research/pyinfra!79
2023-09-05 13:04:00 +02:00
Julius Unverfehrt
261b991049
Add stacktrace to processing failures
...
If a processing failure occures in the processing callback, pyinfra now
additionally to the exeption prints the stack trace.
Also removes knutils logging for now, since it still contains bugs and
it should be tested first in a non-production environment if
production-readiness is given.
2023-09-05 12:59:45 +02:00
Julius Unverfehrt
84c4e7601f
Update kn-utils package
...
Update kn-utils for missing loglevels fix, which is needed for queue
manager error logging.
2023-08-30 15:58:29 +02:00
Julius Unverfehrt
201ed5b9a8
Merge branch 'feature/RED-6685-support-absolute-paths' into 'master'
...
Add support for absolute file paths
See merge request knecon/research/pyinfra!77
2023-08-23 14:11:46 +02:00
Julius Unverfehrt
72547201f3
Adjust log levels to reduce log clutter
...
Also updates readme and adds pytest execution to CI script.
2023-08-23 12:38:34 +02:00
Julius Unverfehrt
c09476cfae
Update tests
...
All components from payload processing downwards are tested.
Tests that depend on docker compose have been disabled by default
because they take too long to use during development. Furthermore, the
queue manager tests are not stable, a refactoring with inversion of
control is urgently needed to make the components properly testable. The
storage tests are stable and should be run once before releasing, this
should be implemented via the CI script.
Also adds, if present, tenant Id and operation kwargs to storage and
queue response.
2023-08-22 17:33:22 +02:00
Julius Unverfehrt
e580a66347
Refactor storage provider & payload parser
...
Applies strategy pattern to payload parsing logic to improve
maintainability and testability.
Renames storage manager to storage provider.
2023-08-22 10:46:27 +02:00
Julius Unverfehrt
294688ea66
RED-7002 Forward exceptions from thread context
...
PyInfra now reports exceptions that happen inside the processing
callback.
Also refactors queue manager logging to fit new logger by
changing "%s", var logic to f string, since this syntax is not supported
with knutlis logging.
2023-08-22 10:46:27 +02:00
Julius Unverfehrt
7187f0ec0c
RES-343 Update logging to knutils logger
2023-08-22 10:46:14 +02:00
Julius Unverfehrt
ef916ee790
Refactor payload processing logic
...
Streamlines payload processor class by encapsulating closely dependent
logic, to improve readability and maintainability.
2023-08-18 12:49:21 +02:00
Julius Unverfehrt
48d74b4307
Add support for absolute file paths
...
Introduces new payload parsing logic to be able to process absolute file
paths. The queue message is expected to contain the keys
"targetFilePath" and "responseFilePath".
To ensure backward-compatibility, the legacy "dossierId", "fileId"
messages are still supported.
2023-08-18 12:45:53 +02:00
Francisco Schulz
692ff204c3
Merge branch 'bugfix/RES-269' into 'master'
...
Bugfix/res 269
See merge request knecon/research/pyinfra!75
2023-08-17 09:55:27 +02:00
Francisco Schulz
03eddadcb9
update template
2023-08-17 09:48:35 +02:00
francisco.schulz
daddec7dc3
increment version
2023-07-18 16:59:50 +02:00
francisco.schulz
370e978fa7
upgrade dependencies, allow python>=3.8
2023-07-18 16:54:29 +02:00
Julius Unverfehrt
366d040ceb
Merge branch 'RES-201-red-research-services-investigate-why-k-8-s-startup-probes-are-not-starting' into 'master'
...
RES-201 red research services investigate why k 8 s startup probes are not starting
See merge request knecon/research/pyinfra!74
2023-06-26 13:57:25 +02:00
francisco.schulz
9598b963ee
remove dist/* files
2023-06-21 15:28:12 +02:00
francisco.schulz
2bacc4d971
update dependencies
2023-06-21 14:13:48 +02:00
francisco.schulz
d228c0a891
temporarily disable tests
2023-06-21 08:12:20 +02:00
francisco.schulz
4e6b4e2969
update dependencies
2023-06-20 17:13:26 +02:00
francisco.schulz
892b6e8236
use template CI
2023-06-20 17:13:08 +02:00
francisco.schulz
d63435e092
change k8s startup probe script to function call
2023-06-20 17:04:03 +02:00
Julius Unverfehrt
7e995bd78b
Merge branch 'RES-196-red-hotfix-persistent-service-address' into 'master'
...
Fix: New tenant storage information endpoint
See merge request knecon/research/pyinfra!73
2023-06-15 16:29:38 +02:00
Julius Unverfehrt
c4e03d4641
Fix: New tenant storage information endpoint
...
Parametrize tenant enpoint and publick decryption key as environment
variable and set the default value to new endpoint.
2023-06-15 16:22:30 +02:00
Francisco Schulz
233b546f6f
Merge branch 'update-azure-dependencies' into 'master'
...
update azure dependencies
See merge request knecon/research/pyinfra!72
2023-05-16 14:47:09 +02:00
francisco.schulz
5ed41a392a
update version number
2023-05-16 14:18:46 +02:00
francisco.schulz
4a0c59b070
update deps
2023-05-16 13:42:53 +02:00
Christoph Schabert
e67ebc27b1
Merge branch 'RES-109-add-gitlab-ci' into 'master'
...
RES-109: add gitlab ci
See merge request knecon/research/pyinfra!71
2023-04-20 09:43:36 +02:00
