Francisco Schulz
2385d19bc2
Merge branch 'RED-10017-investigate-crashing-py-services-when-upload-large-number-of-files' into 'master'
...
RED-10017 "Investigate crashing py services when upload large number of files"
See merge request redactmanager/image-classification-service!17
2024-09-23 18:55:01 +02:00
Francisco Schulz
16f2f0d557
RED-10017 "Investigate crashing py services when upload large number of files"
2024-09-23 18:55:01 +02:00
Julius Unverfehrt
afa6fc34cb
Merge branch 'improvement/RED-10018' into 'master'
...
feat: parameterize image stiching tolerance
Closes RED-10018
See merge request redactmanager/image-classification-service!16
2024-09-06 16:27:36 +02:00
Julius Unverfehrt
a192e05be2
feat: parameterize image stiching tolerance
...
Also sets image stitching tolerance default to one (pixel) and adds
informative log of which settings are loaded when initializing the
image classification pipeline.
2024-09-06 15:51:17 +02:00
Francisco Schulz
d23034e38a
Merge branch 'fix/RED-9948' into 'master'
...
fix: regression of predictions
Closes RED-9948
See merge request redactmanager/image-classification-service!15
2024-08-30 16:06:50 +02:00
Julius Unverfehrt
4bc53cf88b
chore: update pyinfra (for current features)
2024-08-30 15:54:52 +02:00
Julius Unverfehrt
e737f64ed2
fix: pin dependencies to working versions
...
BREAKING CHANGE
Recent pyinfra changes update tensorflow implicitely (see RED-9948).
This can be fixed by pinning tensorflow and protobuf.
However this makes the service incompatible with the current pyinfra
versions.
2024-08-30 15:54:52 +02:00
Julius Unverfehrt
4b099f0106
chore: bump poetry version
2024-08-30 15:53:35 +02:00
Julius Unverfehrt
b3a58d6777
chore: add tests to ensure no regression happens ever again
2024-08-30 15:53:07 +02:00
Julius Unverfehrt
c888453cc6
fix: pin dependencies to working versions
...
BREAKING CHANGE
Recent pyinfra changes update tensorflow implicitely (see RED-9948).
This can be fixed by pinning tensorflow and protobuf.
However this makes the service incompatible with the current pyinfra
versions.
2024-08-30 15:52:55 +02:00
Julius Unverfehrt
bf9ab4b1a2
chore: update run pipline script to use all parameters that are used in production
2024-08-30 15:51:10 +02:00
Julius Unverfehrt
9ff88a1e5d
chore: update test data
2024-08-30 15:51:10 +02:00
Julius Unverfehrt
c852434b75
chore: add script for local and container debug
2024-08-30 15:51:10 +02:00
Jonathan Kössler
8655e25ec0
Merge branch 'feature/RES-840-add-client-connector-error' into 'master'
...
fix: add exception handling for ClientConnectorError
Closes RES-840
See merge request redactmanager/image-classification-service!13
2024-08-28 15:46:55 +02:00
Jonathan Kössler
103c19d4cd
chore: update pyinfra version
2024-08-28 14:50:39 +02:00
Jonathan Kössler
530001a0af
Merge branch 'feature/RES-826-pyinfra-update' into 'master'
...
chore: bump pyinfra version
Closes RES-826
See merge request redactmanager/image-classification-service!12
2024-08-26 16:15:25 +02:00
Jonathan Kössler
a6c11a9db5
chore: bump pyinfra version
2024-08-26 15:14:34 +02:00
Julius Unverfehrt
1796c1bcbb
fix: RED-3813: ensure image hashes are always 25 chars long
...
The hashing algorithm omits leading bits without information. Since this
proves problematic for later processing, we restore this
information and ensure the hashes are always 25 characters long.
2024-08-22 11:15:41 +02:00
Jonathan Kössler
f4b9ff54aa
chore: bump pyinfra version
2024-08-22 09:34:40 +02:00
Jonathan Kössler
278b42e368
Merge branch 'bugfix/set-image-tags' into 'master'
...
fix: version reference
See merge request redactmanager/image-classification-service!11
2024-08-20 09:46:55 +02:00
Jonathan Kössler
9600e4ca23
chore: bump version
2024-08-20 09:34:54 +02:00
Jonathan Kössler
8485345dd1
fix: version reference
2024-08-19 16:32:44 +02:00
Jonathan Kössler
d1a523c7d6
Merge branch 'feature/RES-731-add-queues-per-tenant' into 'master'
...
RES-731: add queues per tenant
Closes RES-731
See merge request redactmanager/image-classification-service!9
2024-08-19 15:12:03 +02:00
Jonathan Kössler
278f54eaa7
RES-731: add queues per tenant
2024-08-19 15:12:03 +02:00
Julius Unverfehrt
443c2614f9
Merge branch 'RED-9746' into 'master'
...
fix: add small image filter logic
Closes RED-9746
See merge request redactmanager/image-classification-service!10
2024-08-07 13:50:28 +02:00
Julius Unverfehrt
4102a564a3
fix: add small image filter logic
...
Introduces a preprocessing that scans each page for page sized images.
If one is encountered, all images that are below a configured ratio in
respect to the page size are dropped.
This step has to occur before the image stiching logic, but MIGHT
introduce the problem of dropping image parts that might constitue an
image. This hoever is not solveable since we want to drop the small
images before further processing since the faulty character images are
also stiched to a valid image, that in reality isn't an image.
2024-08-06 16:52:05 +02:00
Julius Unverfehrt
7f49642ba0
fix: RED-8978: update pyinfra
2024-04-16 16:42:10 +02:00
Julius Unverfehrt
ba8d1dfdfe
chore(logger): support spring log levels
2024-02-28 16:34:23 +01:00
Julius Unverfehrt
150d0d64e5
chore(prediction filters): adapt class specific filter logic
2024-02-09 11:36:51 +01:00
Julius Unverfehrt
a024ddfcf7
Merge branch 'RES-534-update-pyinfra' into 'master'
...
feat(opentel,dynaconf): adapt new pyinfra
Closes RES-534
See merge request redactmanager/image-classification-service!8
2024-02-09 09:59:11 +01:00
Julius Unverfehrt
13cbfa4ddf
chore(tests): disable integration test
2024-02-09 09:50:59 +01:00
Julius Unverfehrt
75af55dbda
chore(project structure): use src/ structure
2024-02-09 09:47:42 +01:00
Julius Unverfehrt
499c501acf
feat(opentel,dynaconf): adapt new pyinfra
...
Also changes logging to knutils logging.
2024-02-09 09:47:31 +01:00
Julius Unverfehrt
6163e29d6b
fix(pdf conversion): repair broken bad x-ref handling
2024-02-08 17:16:41 +01:00
Francisco Schulz
dadc0a4163
Merge branch 'RED-7958-logging-issues-of-python-services' into 'master'
...
RED-7958 "Logging issues of python services"
See merge request redactmanager/image-classification-service!6
2023-12-12 11:29:46 +01:00
Francisco Schulz
729ce17de0
use .pdf as integration test file
2023-12-11 11:32:14 +01:00
francisco.schulz
88fbe077e6
fix: poetry install --without=dev
2023-12-11 10:40:06 +01:00
francisco.schulz
f8ecef1054
update dependencies
2023-12-11 10:39:27 +01:00
Francisco Schulz
5f44cc6560
use integration test default branch
2023-12-07 13:23:53 +01:00
francisco.schulz
b60f4d0383
use python 3.10
2023-11-28 15:57:53 +01:00
francisco.schulz
87873cc3a3
update dependencies
2023-11-28 15:57:45 +01:00
francisco.schulz
523ca1db7d
use latest CI template
2023-11-28 15:57:36 +01:00
Julius Unverfehrt
c25f6902e0
Merge branch 'feature/RED-6685-support-absolute-paths' into 'master'
...
Upgrade pyinfra (absolute FP support)
Closes RED-6685
See merge request redactmanager/image-classification-service!5
2023-08-23 15:04:59 +02:00
Julius Unverfehrt
9e336ecc01
Upgrade pyinfra (absolute FP support)
...
- Update pyinfra with absolute file path support (still supports
dossierID fileID format)
- Update CI, use new template
2023-08-23 14:53:40 +02:00
Julius Unverfehrt
0efa2127d7
Merge branch 'fix/RED-7388-nack-message-if-processing-failure' into 'master'
...
Adjust error handling of processing sub-process
Closes RED-7388
See merge request redactmanager/image-classification-service!4
2023-08-17 13:40:11 +02:00
Julius Unverfehrt
501fd48d69
Adjust error handling of processing sub-process
...
Removes exception catching when collecting subprocess result which led
to the service silently go over failing file processing.
Now, the sub-process doesn't return any results if it failed. It is made
sure that an empty result is still returned if no images were present on
the file to process.
2023-08-17 13:26:27 +02:00
Julius Unverfehrt
4a825cb264
Merge branch 'RES-196-red-hotfix-persistent-service-address' into 'master'
...
Resolve RES-196 "Red hotfix persistent service address"
Closes RES-196
See merge request redactmanager/image-classification-service!2
2023-06-26 12:56:13 +02:00
francisco.schulz
694a6ccb33
copy test dir into container
2023-06-22 12:03:09 +02:00
francisco.schulz
1d043f97fc
add ipykernel
2023-06-22 12:02:50 +02:00
francisco.schulz
7cac73f07b
update dependencies, pyinfra@1.5.9
2023-06-21 15:43:24 +02:00
