267 Commits

Author SHA1 Message Date
Jonathan Kössler
b2e3ae092f feat: wip for multiple tenants 2024-07-09 18:20:55 +02:00
Jonathan Kössler
de41030e69 feat: wip for multiple tenants 2024-07-05 13:27:16 +02:00
Jonathan Kössler
c81d967aee feat: wip for multiple tenants 2024-07-03 17:51:47 +02:00
Jonathan Kössler
30330937ce feat: wip for multiple tenants 2024-07-02 18:07:23 +02:00
Jonathan Kössler
7624208188 feat: wip for multiple tenants 2024-07-01 18:15:04 +02:00
Jonathan Kössler
6fabe1ae8c feat: wip for multiple tenants 2024-06-28 15:41:53 +02:00
Jonathan Kössler
3532f949a9 refactor: remove second trace setup 2024-06-26 18:15:51 +02:00
Jonathan Kössler
65cc1c9aad fix: improve error handling for tracing settings 2024-06-26 18:02:52 +02:00
Jonathan Kössler
2484a5e9f7 chore: bump pyinfra version 2.3.0 2024-06-17 13:53:42 +02:00
Julius Unverfehrt
88fe7383f3 Merge branch 'feature/RES-718-add-azure-monitoring' into 'master'
RES-718: add azure tracing

See merge request knecon/research/pyinfra!85
2024-06-17 12:25:09 +02:00
Jonathan Kössler
18a0ddc2d3 feat: add tracing settings to validator 2024-06-13 08:47:50 +02:00
Jonathan Kössler
5328e8de03 refactor: streamline tracing types 2024-06-12 10:41:52 +02:00
Jonathan Kössler
9661d75d8a refactor: update tracing info for Azure Monitor 2024-06-11 14:31:06 +02:00
Jonathan Kössler
7dbcdf1650 feat: add azure opentelemtry monitoring 2024-06-11 12:00:18 +02:00
Julius Unverfehrt
4536f9d35b Merge branch 'RES-671-multi-file-dl' into 'master'
feat: add multiple file download

See merge request knecon/research/pyinfra!84
2.2.0
2024-04-18 16:47:00 +02:00
Julius Unverfehrt
a1e7b3b565 build: add SBOM and increment package version 2024-04-18 16:39:46 +02:00
Julius Unverfehrt
b810449bba feat: add multiple file download
The download function is now overloaded and additionlly supports a
dict with file paths as values, in addition to the present string as
file path. The data is forwarded as dict of the same structure in the
first case.
2024-04-18 16:35:55 +02:00
Julius Unverfehrt
f67813702a Merge branch 'RED-8978-no-crash-on-non-existing-files' into 'master'
fix: add error handling for file not found error

See merge request knecon/research/pyinfra!83
2024-04-16 16:28:25 +02:00
Julius Unverfehrt
ed4f912acf build: increment service version 2024-04-16 16:21:57 +02:00
Julius Unverfehrt
021222475b fix: add error handling for file not found error
When a file couldn't be downloaded from storage, the queue consumer now
informs the operator with a log and rejects the message, without crashing
but continuing its honest work.
2024-04-16 16:20:08 +02:00
Julius Unverfehrt
876253b3fb tests: add test for file not found error 2024-04-16 16:19:45 +02:00
Julius Unverfehrt
1689cd762b fix(CI): fix CI 2.0.0 2024-01-31 12:03:07 +01:00
Julius Unverfehrt
dc413cea82 Merge branch 'opentel' into 'master'
RES-506, RES-507, RES-499, RES-434, RES-398

See merge request knecon/research/pyinfra!82
2024-01-31 11:21:17 +01:00
Julius Unverfehrt
bfb27383e4 fix(settings): change precedence to ENV ROOT_PATH > root_path arg 2024-01-31 10:24:29 +01:00
Julius Unverfehrt
af914ab3ae fix(argparse): automatically output settings path 2024-01-31 10:12:32 +01:00
Julius Unverfehrt
7093e01925 feat(opentelemetry): add webserver tracing to default pipeline 2024-01-31 09:09:13 +01:00
Julius Unverfehrt
88cfb2b1c1 fix(settings): add debug log 2024-01-30 14:52:35 +01:00
Julius Unverfehrt
c1301d287f fix(dependencies): move opentel deps to main since groups are not packaged with CI script 2024-01-30 14:31:08 +01:00
Julius Unverfehrt
f1b8e5a25f refac(arg parse): rename settings parsing fn for clarity 2024-01-30 13:27:19 +01:00
Julius Unverfehrt
fff5be2e50 feat(settings): improve config loading logic
Load settings from .toml files, .env and environment variables. Also ensures a ROOT_PATH environment variable is
set. If ROOT_PATH is not set and no root_path argument is passed, the current working directory is used as root.
Settings paths can be a single .toml file, a folder containing .toml files or a list of .toml files and folders.
If a folder is passed, all .toml files in the folder are loaded. If settings path is None, only .env and
environment variables are loaded. If settings_path are relative paths, they are joined with the root_path argument.
2024-01-30 12:56:58 +01:00
Julius Unverfehrt
ec9ab21198 package: increment major version and update kn-utils 2024-01-25 11:08:50 +01:00
Julius Unverfehrt
b2f073e0c5 refactor: IoC for callback, update readme 2024-01-25 10:41:48 +01:00
Julius Unverfehrt
f6f56b8d8c refactoy: simplify storage connection logic 2024-01-25 09:08:51 +01:00
Isaac Riley
8ff637d6ba chore: add opentelemetry subsection to README.md; formatting 2024-01-25 08:25:19 +01:00
Julius Unverfehrt
c18475a77d feat(opentelemetry): improve readability 2024-01-24 17:46:54 +01:00
Julius Unverfehrt
e0b32fa448 feat(opentelemetry): fastAPI tracing
The tests don't work yet since the webserver has to run in a thread and
the traces don't get exported from the thread with local json exporting.
However, with an export to an external server this should still work.
WIP
2024-01-24 15:52:42 +01:00
Julius Unverfehrt
da163897c4 feat(opentelemetry): add fastapi instumentation 2024-01-24 14:26:10 +01:00
Julius Unverfehrt
a415666830 feat(opentelemetry): put logic in own module 2024-01-24 14:00:11 +01:00
Julius Unverfehrt
739a7c0731 feat(opentelemetry): add queue instrumenting test 2024-01-24 13:26:01 +01:00
Isaac Riley
936bb4fe80 feat: add opentelemetry on top of newly refactored pyinfra 2024-01-24 08:09:42 +01:00
Julius Unverfehrt
725d6dce45 Update readme 2024-01-23 18:08:57 +01:00
Julius Unverfehrt
be602d8411 Adjust logs 2024-01-23 14:10:56 +01:00
Julius Unverfehrt
429a85b609 Disable automated tests until we found a way to rund docker compose before 2024-01-23 10:26:44 +01:00
Julius Unverfehrt
d6eeb65ccc Update scripts 2024-01-23 10:25:56 +01:00
Julius Unverfehrt
adfbd650e6 Add config tests, add type validation to config loading 2024-01-23 08:51:44 +01:00
Julius Unverfehrt
73eba97ede Add serving example
TODO: - update readme
      - check if logs are adequate
2024-01-19 14:53:06 +01:00
Julius Unverfehrt
8cd1d6b283 add retries to queue consuming, so we retray at least a bit if something happens. Eventually the container should crash though since there do exist unfixable problems sadly. 2024-01-19 14:15:00 +01:00
Julius Unverfehrt
87cbf89672 finnish config loading logic 2024-01-19 14:05:05 +01:00
Julius Unverfehrt
9c2f34e694 Put add health check in own function 2024-01-19 13:13:12 +01:00
Julius Unverfehrt
fbbfc553ae fix message encoding for response, rename some functions 2024-01-19 12:46:02 +01:00