235 Commits

Author SHA1 Message Date
Jonathan Kössler
28adb50330 chore: update pyinfra to v3.3.4 2024-11-13 16:39:49 +01:00
Jonathan Kössler
7a3fdf8fa4 chore: update pyinfra to v3.3.3 2024-11-13 14:54:29 +01:00
Jonathan Kössler
3fbcd65e9b chore: update pyinfra to v3.3.2 2024-11-13 09:56:55 +01:00
Jonathan Kössler
526de8984c chore: update pyinfra to v3.2.11 2024-09-30 10:12:40 +02:00
Jonathan Kössler
99cbf3c9bf Merge branch 'feature/RED-10017-fix-config' into 'master'
RED-10017: fix pyinfra config

Closes RED-10017

See merge request redactmanager/image-classification-service!18
2.14.0
2024-09-27 08:22:00 +02:00
Jonathan Kössler
986137e729 chore: update pyinfra to v3.2.10 2024-09-26 13:40:49 +02:00
Jonathan Kössler
f950b96cfb fix: pyinfra config 2024-09-24 14:31:10 +02:00
Francisco Schulz
2385d19bc2 Merge branch 'RED-10017-investigate-crashing-py-services-when-upload-large-number-of-files' into 'master'
RED-10017 "Investigate crashing py services when upload large number of files"

See merge request redactmanager/image-classification-service!17
2.13.0
2024-09-23 18:55:01 +02:00
Francisco Schulz
16f2f0d557 RED-10017 "Investigate crashing py services when upload large number of files" 2024-09-23 18:55:01 +02:00
Julius Unverfehrt
afa6fc34cb Merge branch 'improvement/RED-10018' into 'master'
feat: parameterize image stiching tolerance

Closes RED-10018

See merge request redactmanager/image-classification-service!16
2.12.0
2024-09-06 16:27:36 +02:00
Julius Unverfehrt
a192e05be2 feat: parameterize image stiching tolerance
Also sets image stitching tolerance default to one (pixel) and adds
informative log of which settings are loaded when initializing the
image classification pipeline.
2024-09-06 15:51:17 +02:00
Francisco Schulz
d23034e38a Merge branch 'fix/RED-9948' into 'master'
fix: regression of predictions

Closes RED-9948

See merge request redactmanager/image-classification-service!15
2.11.0
2024-08-30 16:06:50 +02:00
Julius Unverfehrt
4bc53cf88b chore: update pyinfra (for current features) 2024-08-30 15:54:52 +02:00
Julius Unverfehrt
e737f64ed2 fix: pin dependencies to working versions
BREAKING CHANGE

Recent pyinfra changes update tensorflow implicitely (see RED-9948).
This can be fixed by pinning tensorflow and protobuf.
However this makes the service incompatible with the current pyinfra
versions.
2024-08-30 15:54:52 +02:00
Julius Unverfehrt
4b099f0106 chore: bump poetry version 2024-08-30 15:53:35 +02:00
Julius Unverfehrt
b3a58d6777 chore: add tests to ensure no regression happens ever again 2024-08-30 15:53:07 +02:00
Julius Unverfehrt
c888453cc6 fix: pin dependencies to working versions
BREAKING CHANGE

Recent pyinfra changes update tensorflow implicitely (see RED-9948).
This can be fixed by pinning tensorflow and protobuf.
However this makes the service incompatible with the current pyinfra
versions.
2024-08-30 15:52:55 +02:00
Julius Unverfehrt
bf9ab4b1a2 chore: update run pipline script to use all parameters that are used in production 2024-08-30 15:51:10 +02:00
Julius Unverfehrt
9ff88a1e5d chore: update test data 2024-08-30 15:51:10 +02:00
Julius Unverfehrt
c852434b75 chore: add script for local and container debug 2024-08-30 15:51:10 +02:00
Jonathan Kössler
8655e25ec0 Merge branch 'feature/RES-840-add-client-connector-error' into 'master'
fix: add exception handling for ClientConnectorError

Closes RES-840

See merge request redactmanager/image-classification-service!13
2.10.0
2024-08-28 15:46:55 +02:00
Jonathan Kössler
103c19d4cd chore: update pyinfra version 2024-08-28 14:50:39 +02:00
Jonathan Kössler
530001a0af Merge branch 'feature/RES-826-pyinfra-update' into 'master'
chore: bump pyinfra version

Closes RES-826

See merge request redactmanager/image-classification-service!12
2.9.0
2024-08-26 16:15:25 +02:00
Jonathan Kössler
a6c11a9db5 chore: bump pyinfra version 2024-08-26 15:14:34 +02:00
Julius Unverfehrt
1796c1bcbb fix: RED-3813: ensure image hashes are always 25 chars long
The hashing algorithm omits leading bits without information. Since this
proves problematic for later processing, we restore this
information and ensure the hashes are always 25 characters long.
2.8.0
2024-08-22 11:15:41 +02:00
Jonathan Kössler
f4b9ff54aa chore: bump pyinfra version 2024-08-22 09:34:40 +02:00
Jonathan Kössler
278b42e368 Merge branch 'bugfix/set-image-tags' into 'master'
fix: version reference

See merge request redactmanager/image-classification-service!11
2.7.0
2024-08-20 09:46:55 +02:00
Jonathan Kössler
9600e4ca23 chore: bump version 2024-08-20 09:34:54 +02:00
Jonathan Kössler
8485345dd1 fix: version reference 2024-08-19 16:32:44 +02:00
Jonathan Kössler
d1a523c7d6 Merge branch 'feature/RES-731-add-queues-per-tenant' into 'master'
RES-731: add queues per tenant

Closes RES-731

See merge request redactmanager/image-classification-service!9
2.6.0
2024-08-19 15:12:03 +02:00
Jonathan Kössler
278f54eaa7 RES-731: add queues per tenant 2024-08-19 15:12:03 +02:00
Julius Unverfehrt
443c2614f9 Merge branch 'RED-9746' into 'master'
fix: add small image filter logic

Closes RED-9746

See merge request redactmanager/image-classification-service!10
2.5.0
2024-08-07 13:50:28 +02:00
Julius Unverfehrt
4102a564a3 fix: add small image filter logic
Introduces a preprocessing that scans each page for page sized images.
If one is encountered, all images that are below a configured ratio in
respect to the page size are dropped.

This step has to occur before the image stiching logic, but MIGHT
introduce the problem of dropping image parts that might constitue an
image. This hoever is not solveable since we want to drop the small
images before further processing since the faulty character images are
also stiched to a valid image, that in reality isn't an image.
2024-08-06 16:52:05 +02:00
Julius Unverfehrt
7f49642ba0 fix: RED-8978: update pyinfra 2.4.0 2024-04-16 16:42:10 +02:00
Julius Unverfehrt
ba8d1dfdfe chore(logger): support spring log levels 2.3.0 2024-02-28 16:34:23 +01:00
Julius Unverfehrt
150d0d64e5 chore(prediction filters): adapt class specific filter logic 2.2.0 2024-02-09 11:36:51 +01:00
Julius Unverfehrt
a024ddfcf7 Merge branch 'RES-534-update-pyinfra' into 'master'
feat(opentel,dynaconf): adapt new pyinfra

Closes RES-534

See merge request redactmanager/image-classification-service!8
2.1.0 2.0.0
2024-02-09 09:59:11 +01:00
Julius Unverfehrt
13cbfa4ddf chore(tests): disable integration test 2024-02-09 09:50:59 +01:00
Julius Unverfehrt
75af55dbda chore(project structure): use src/ structure 2024-02-09 09:47:42 +01:00
Julius Unverfehrt
499c501acf feat(opentel,dynaconf): adapt new pyinfra
Also changes logging to knutils logging.
2024-02-09 09:47:31 +01:00
Julius Unverfehrt
6163e29d6b fix(pdf conversion): repair broken bad x-ref handling 2024-02-08 17:16:41 +01:00
Francisco Schulz
dadc0a4163 Merge branch 'RED-7958-logging-issues-of-python-services' into 'master'
RED-7958 "Logging issues of python services"

See merge request redactmanager/image-classification-service!6
1.34.0
2023-12-12 11:29:46 +01:00
Francisco Schulz
729ce17de0 use .pdf as integration test file 2023-12-11 11:32:14 +01:00
francisco.schulz
88fbe077e6 fix: poetry install --without=dev 2023-12-11 10:40:06 +01:00
francisco.schulz
f8ecef1054 update dependencies 2023-12-11 10:39:27 +01:00
Francisco Schulz
5f44cc6560 use integration test default branch 2023-12-07 13:23:53 +01:00
francisco.schulz
b60f4d0383 use python 3.10 2023-11-28 15:57:53 +01:00
francisco.schulz
87873cc3a3 update dependencies 2023-11-28 15:57:45 +01:00
francisco.schulz
523ca1db7d use latest CI template 2023-11-28 15:57:36 +01:00
Julius Unverfehrt
c25f6902e0 Merge branch 'feature/RED-6685-support-absolute-paths' into 'master'
Upgrade pyinfra (absolute FP support)

Closes RED-6685

See merge request redactmanager/image-classification-service!5
1.33.0
2023-08-23 15:04:59 +02:00