Marmelator/image-classification-service
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 29 Wiki Activity
214 Commits 4 Branches 400 Tags
Commit Graph

214 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
francisco.schulz
892742ef17 update 2023-06-07 17:44:35 +02:00
francisco.schulz
06b1af9f1a update 2023-06-07 17:44:30 +02:00
francisco.schulz
0194ce3f7e add setup convenience script 2023-06-07 17:44:23 +02:00
francisco.schulz
41d08f7b5b update dependencies 2023-06-07 17:42:25 +02:00
francisco.schulz
b91d5a0ab2 move to script folder 2023-06-07 17:42:11 +02:00
francisco.schulz
7b37f3c913 update Dockerfiles 2023-06-07 17:41:54 +02:00
francisco.schulz
c32005b841 remove old CI files 2023-06-07 17:12:14 +02:00
Julius Unverfehrt
6406ce6b25 Pull request #48: RED-6273 multi tenant storage 
Merge in RR/image-prediction from RED-6273-multi-tenant-storage to master

* commit '4ecafb29770b7392462c71d79550c5f788cb36e6':
  update pyinfra version with removed falsy dependencies from pyinfra
  update pyinfra for bugfix
  Update pyinfra for multi-tenancy support
1.29.0 		2023-03-28 18:11:09 +02:00
Julius Unverfehrt
4ecafb2977 update pyinfra version with removed falsy dependencies from pyinfra RED-6273-multi-tenant-storage_4 2023-03-28 18:03:38 +02:00
Julius Unverfehrt
967c2fad1b update pyinfra for bugfix 2023-03-28 17:27:57 +02:00
Julius Unverfehrt
b74e79f113 Update pyinfra for multi-tenancy support RED-6273-multi-tenant-storage_2 2023-03-28 15:36:05 +02:00
Julius Unverfehrt
50c791f6ca Pull request #47: update pyinfra with fixed prometheus port 
Merge in RR/image-prediction from bugfix/RED-6205-prometheus-port to master

* commit 'adb363842dff3d43b3a0dc499daa16588d34233c':
  update pyinfra with fixed prometheus port
1.28.0 		2023-03-21 16:08:27 +01:00
Julius Unverfehrt
adb363842d update pyinfra with fixed prometheus port bugfix/RED-6205-prometheus-port_2 2023-03-21 16:01:39 +01:00
Julius Unverfehrt
81520b1a53 Pull request #46: RED-6205 add prometheus monitoring 
Merge in RR/image-prediction from RED-6205-add-prometheus-monitoring to master

Squashed commit of the following:

commit 6932b5ee579a31d0317dc3f76acb8dd2845fdb4b
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Mar 16 17:30:57 2023 +0100

    update pyinfra

commit d6e55534623eae2edcddaa6dd333f93171d421dc
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Mar 16 16:30:14 2023 +0100

    set pyinfra subproject to current master commit

commit 030dc660e6060ae326c32fba8c2944a10866fbb6
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Mar 16 16:25:19 2023 +0100

    adapt serve script to advanced pyinfra API including monitoring of the processing time of images.

commit 0fa0c44c376c52653e517d257a35793797f7be31
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Mar 16 15:19:57 2023 +0100

    Update dockerfile to work with new pyinfra package setup utilizing pyproject.toml instad of setup.py and requirments.txt

commit aad53c4d313f908de93a13e69e2cb150db3be6cb
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Mar 16 14:16:04 2023 +0100

    remove no longer needed dependencies
1.27.0 		2023-03-17 16:12:59 +01:00
Shamel Hussain
ed25af33ad Pull request #45: RED-5718: Revert user changes to allow using a random id 
Merge in RR/image-prediction from RED-5718-revertUser to master

* commit '1967945ff7550d706295a1a46f50393959852773':
  RED-5718: Revert user changes to allow using a random id
 2023-02-28 14:56:23 +01:00
shamel-hussain
1967945ff7 RED-5718: Revert user changes to allow using a random id RED-5718-revertUser_2 2023-02-28 12:08:32 +01:00
Shamel Hussain
faf4d7ed0f Pull request #44: RED-5718: Add a specific user to the image-prediction service 
Merge in RR/image-prediction from RED-5718-imageUser to master

* commit '7c7b038491b39d2162e901a5a0ef62b2f1ebd4a9':
  RED-5718: Add a specific user to the image-prediction service
 2023-02-27 09:26:12 +01:00
shamel-hussain
7c7b038491 RED-5718: Add a specific user to the image-prediction service RED-5718-imageUser_7 imageUser1001-3 2023-02-27 09:19:37 +01:00
Julius Unverfehrt
cd3e215776 Pull request #43: upgrade references 
Merge in RR/image-prediction from RED-6118-multi-tenancy-patch to master

* commit 'bc1bd96e6c8fe904f0fc61a5701cd03dd369806c':
  upgrade references
1.25.0 		2023-02-16 16:52:23 +01:00
Julius Unverfehrt
bc1bd96e6c upgrade references RED-6118-multi-tenancy-patch_2 2023-02-16 16:50:59 +01:00
Francisco Schulz
2001e9d7f3 Pull request #42: Bugfix/RED-5277 heartbeat 
Merge in RR/image-prediction from bugfix/RED-5277-heartbeat to master

* commit '846f127d3ba75c1be124ddc780a4f9c849dc84af':
  update reference
  fix type
  remove commented out code
  import logger from `__init__.py`
  add log config to `__init__.py`
  remove extra stream handler
  update reference
  update refrence
  update reference
  update reference
  update reference
  build dev image and push to nexus
  add logging & only return one object from `process_request()`
  cache loaded pipeline & disable tqdm output by default
  format + set verbose to False by default
  update
1.24.0 		2023-02-16 09:54:07 +01:00
Francisco Schulz
846f127d3b update reference bugfix/RED-5277-heartbeat_11 2023-02-16 09:50:17 +01:00
Francisco Schulz
d4657f1ab1 fix type bugfix/RED-5277-heartbeat_10 2023-02-15 16:46:47 +01:00
Francisco Schulz
ee99d76aab remove commented out code bugfix/RED-5277-heartbeat_9 2023-02-15 15:51:33 +01:00
Francisco Schulz
00b40c0632 import logger from __init__.py bugfix/RED-5277-heartbeat_8 2023-02-15 15:45:20 +01:00
Francisco Schulz
c1ae8e6a4b add log config to __init__.py 2023-02-15 15:44:56 +01:00
Francisco Schulz
0bdf5a726a remove extra stream handler bugfix/RED-5277-heartbeat_7 2023-02-15 15:25:13 +01:00
Francisco Schulz
d505ac4e50 update reference bugfix/RED-5277-heartbeat_6 2023-02-15 15:01:29 +01:00
Francisco Schulz
7dca05a53d update refrence bugfix/RED-5277-heartbeat_5 2023-02-15 11:11:23 +01:00
Francisco Schulz
c1449134ec update reference bugfix/RED-5277-heartbeat_4 2023-02-15 10:23:27 +01:00
Francisco Schulz
29c76e7ebf update reference bugfix/RED-5277-heartbeat_3 2023-02-14 18:02:09 +01:00
Francisco Schulz
ecc9f69d9c update reference bugfix/RED-5277-heartbeat_2 2023-02-14 16:52:56 +01:00
Francisco Schulz
4bcadcd266 build dev image and push to nexus 2023-02-14 16:30:18 +01:00
Francisco Schulz
9065ec1d12 add logging & only return one object from process_request() 2023-02-14 16:29:04 +01:00
Francisco Schulz
d239368d70 cache loaded pipeline & disable tqdm output by default 2023-02-14 16:27:21 +01:00
Francisco Schulz
b5dc5aa777 format + set verbose to False by default 2023-02-14 16:26:24 +01:00
Francisco Schulz
54b7ba24e8 update 2023-02-14 16:25:49 +01:00
Julius Unverfehrt
463f4da92b Pull request #41: RED-6189 bugfix 
Merge in RR/image-prediction from RED-6189-bugfix to master

* commit '79455f0dd6da835ef2261393c5a57ba8ef2550ab': (25 commits)
  revert refactoring  changes
  replace image extraction logic final
  introduce normalizing function for image extraction
  refactoring
  adjust behavior of filtering of invalid images
  add log in callback to diplay which file is processed
  add ad hoc logic for bad xref handling
  beautify
  beautify
  implement ad hoc channel count detection for new image extraction
  improve performance
  refactor scanned page filtering
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor scanned page filtering WIP
  refactor
  ...
1.23.0 		2023-02-13 17:35:04 +01:00
Julius Unverfehrt
79455f0dd6 Merge branch 'master' of ssh://git.iqser.com:2222/rr/image-prediction into RED-6189-bugfix RED-6189-bugfix_6 2023-02-13 17:23:07 +01:00
Julius Unverfehrt
2bc9c24f6a revert refactoring changes 
- revert functional refactoring changes to be able
to determine where the error described in the ticket comes from
- change array normalization to dimensionally
sparse arrays to reduce memory consumption
1.22.1 RED-6189-bugfix_4 		2023-02-13 13:53:35 +01:00
Julius Unverfehrt
ea301b4df2 Pull request #40: replace trace log level by debug 
Merge in RR/image-prediction from adjust-falsy-loglevel to master

Squashed commit of the following:

commit 66794acb1a64be6341f98c7c0ce0bc202634a9f4
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Fri Feb 10 10:15:41 2023 +0100

    replace trace log level by debug

    - trace method is not supported by buld-in logging module
1.22.0 		2023-02-10 10:18:38 +01:00
Matthias Bisping
5cdf93b923 Pull request #39: RED-6084 Improve image extraction speed 
Merge in RR/image-prediction from RED-6084-adhoc-scanned-pages-filtering-refactoring to master

Squashed commit of the following:

commit bd6d83e7363b1c1993babcceb434110a6312c645
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Thu Feb 9 16:08:25 2023 +0100

    Tweak logging

commit 55bdd48d2a3462a8b4a6b7194c4a46b21d74c455
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Thu Feb 9 15:47:31 2023 +0100

    Update dependencies

commit 970275b25708c05e4fbe78b52aa70d791d5ff17a
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Thu Feb 9 15:35:37 2023 +0100

    Refactoring

    Make alpha channel check monadic to streamline error handling

commit e99e97e23fd8ce16f9a421d3e5442fccacf71ead
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Tue Feb 7 14:32:29 2023 +0100

    Refactoring

    - Rename
    - Refactor image extraction functions

commit 76b1b0ca2401495ec03ba2b6483091b52732eb81
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Tue Feb 7 11:55:30 2023 +0100

    Refactoring

commit cb1c461049d7c43ec340302f466447da9f95a499
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Tue Feb 7 11:44:01 2023 +0100

    Refactoring

commit 092069221a85ac7ac19bf838dcbc7ab1fde1e12b
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Tue Feb 7 10:18:53 2023 +0100

    Add to-do

commit 3cea4dad2d9703b8c79ddeb740b66a3b8255bb2a
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Tue Feb 7 10:11:35 2023 +0100

    Refactoring

    - Rename
    - Add typehints everywhere

commit 865e0819a14c420bc2edff454d41092c11c019a4
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 19:38:57 2023 +0100

    Add type explanation

commit 01d3d5d33f1ccb05aea1cec1d1577572b1a4deaa
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 19:37:49 2023 +0100

    Formatting

commit dffe1c18fc3a322a6b08890d4438844e8122faaf
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 19:34:13 2023 +0100

    [WIP] Either refactoring

    Add alternative formulation for monadic chain

commit 066cf17add404a313520cd794c06e3264cf971c9
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 18:40:30 2023 +0100

    [WIP] Either refactoring

commit f53f0fea298cdab88deb090af328b34d37e0198e
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 18:18:34 2023 +0100

    [WIP] Either refactoring

    Propagate error and metadata

commit 274a5f56d4fcb9c67fac5cf43e9412ec1ab5179e
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 17:51:35 2023 +0100

    [WIP] Either refactoring

    Fix test assertion

commit 3235a857f6e418e50484cbfff152b0f63efb2f53
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 16:57:31 2023 +0100

    [WIP] Either-refactoring

    Replace Maybe with Either to allow passing on error information or
    metadata which otherwise get sucked up by Nothing.

commit 89989543d87490f8b20a0a76055605d34345e8f4
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 16:12:40 2023 +0100

    [WIP] Monadic refactoring

    Integrate image validation step into monadic chain.

    At the moment we lost the error information through this. Refactoring to
    Either monad can bring it back.

commit 022bd4856a51aa085df5fe983fd77b99b53d594c
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 15:16:41 2023 +0100

    [WIP] Monadic refactoring

commit ca3898cb539607c8c3dd01c57e60211a5fea8a7d
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 15:10:34 2023 +0100

    [WIP] Monadic refactoring

commit d8f37bed5cbd6bdd2a0b52bae46fcdbb50f9dff2
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 15:09:51 2023 +0100

    [WIP] Monadic refactoring

commit 906fee0e5df051f38076aa1d2725e52a182ade13
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date:   Mon Feb 6 15:03:35 2023 +0100

    [WIP] Monadic refactoring

... and 35 more commits
1.21.0 		2023-02-10 08:33:13 +01:00
Julius Unverfehrt
4d43e385c5 replace image extraction logic final RED-6084-adhoc-scanned-pages-filtering-alternative_16 RED-6189-bugfix_2 test 2023-02-06 09:43:28 +01:00
Julius Unverfehrt
bd0279ddd1 introduce normalizing function for image extraction 2023-02-03 12:25:27 +01:00
Julius Unverfehrt
2995d5ee48 refactoring 2023-02-03 11:14:14 +01:00
Julius Unverfehrt
eff1bb4124 adjust behavior of filtering of invalid images 1.20.6 RED-6084-adhoc-scanned-pages-filtering-alternative_14 2023-02-03 09:04:02 +01:00
Julius Unverfehrt
c478333111 add log in callback to diplay which file is processed 2023-02-03 08:25:36 +01:00
Julius Unverfehrt
978f48e8f9 add ad hoc logic for bad xref handling 1.20.5 RED-6084-adhoc-scanned-pages-filtering-alternative_8 2023-02-02 15:39:44 +01:00
Julius Unverfehrt
94652aafe4 beautify 2023-02-02 15:26:33 +01:00
Julius Unverfehrt
c4416636c0 beautify 1.20.4 RED-6084-adhoc-scanned-pages-filtering-alternative_6 2023-02-02 14:10:32 +01:00