Shamel Hussain
ed25af33ad
Pull request #45 : RED-5718: Revert user changes to allow using a random id
...
Merge in RR/image-prediction from RED-5718-revertUser to master
* commit '1967945ff7550d706295a1a46f50393959852773':
RED-5718: Revert user changes to allow using a random id
2023-02-28 14:56:23 +01:00
shamel-hussain
1967945ff7
RED-5718: Revert user changes to allow using a random id
2023-02-28 12:08:32 +01:00
Shamel Hussain
faf4d7ed0f
Pull request #44 : RED-5718: Add a specific user to the image-prediction service
...
Merge in RR/image-prediction from RED-5718-imageUser to master
* commit '7c7b038491b39d2162e901a5a0ef62b2f1ebd4a9':
RED-5718: Add a specific user to the image-prediction service
2023-02-27 09:26:12 +01:00
shamel-hussain
7c7b038491
RED-5718: Add a specific user to the image-prediction service
2023-02-27 09:19:37 +01:00
Julius Unverfehrt
cd3e215776
Pull request #43 : upgrade references
...
Merge in RR/image-prediction from RED-6118-multi-tenancy-patch to master
* commit 'bc1bd96e6c8fe904f0fc61a5701cd03dd369806c':
upgrade references
2023-02-16 16:52:23 +01:00
Julius Unverfehrt
bc1bd96e6c
upgrade references
2023-02-16 16:50:59 +01:00
Francisco Schulz
2001e9d7f3
Pull request #42 : Bugfix/RED-5277 heartbeat
...
Merge in RR/image-prediction from bugfix/RED-5277-heartbeat to master
* commit '846f127d3ba75c1be124ddc780a4f9c849dc84af':
update reference
fix type
remove commented out code
import logger from `__init__.py`
add log config to `__init__.py`
remove extra stream handler
update reference
update refrence
update reference
update reference
update reference
build dev image and push to nexus
add logging & only return one object from `process_request()`
cache loaded pipeline & disable tqdm output by default
format + set verbose to False by default
update
2023-02-16 09:54:07 +01:00
Francisco Schulz
846f127d3b
update reference
2023-02-16 09:50:17 +01:00
Francisco Schulz
d4657f1ab1
fix type
2023-02-15 16:46:47 +01:00
Francisco Schulz
ee99d76aab
remove commented out code
2023-02-15 15:51:33 +01:00
Francisco Schulz
00b40c0632
import logger from __init__.py
2023-02-15 15:45:20 +01:00
Francisco Schulz
c1ae8e6a4b
add log config to __init__.py
2023-02-15 15:44:56 +01:00
Francisco Schulz
0bdf5a726a
remove extra stream handler
2023-02-15 15:25:13 +01:00
Francisco Schulz
d505ac4e50
update reference
2023-02-15 15:01:29 +01:00
Francisco Schulz
7dca05a53d
update refrence
2023-02-15 11:11:23 +01:00
Francisco Schulz
c1449134ec
update reference
2023-02-15 10:23:27 +01:00
Francisco Schulz
29c76e7ebf
update reference
2023-02-14 18:02:09 +01:00
Francisco Schulz
ecc9f69d9c
update reference
2023-02-14 16:52:56 +01:00
Francisco Schulz
4bcadcd266
build dev image and push to nexus
2023-02-14 16:30:18 +01:00
Francisco Schulz
9065ec1d12
add logging & only return one object from process_request()
2023-02-14 16:29:04 +01:00
Francisco Schulz
d239368d70
cache loaded pipeline & disable tqdm output by default
2023-02-14 16:27:21 +01:00
Francisco Schulz
b5dc5aa777
format + set verbose to False by default
2023-02-14 16:26:24 +01:00
Francisco Schulz
54b7ba24e8
update
2023-02-14 16:25:49 +01:00
Julius Unverfehrt
463f4da92b
Pull request #41 : RED-6189 bugfix
...
Merge in RR/image-prediction from RED-6189-bugfix to master
* commit '79455f0dd6da835ef2261393c5a57ba8ef2550ab': (25 commits)
revert refactoring changes
replace image extraction logic final
introduce normalizing function for image extraction
refactoring
adjust behavior of filtering of invalid images
add log in callback to diplay which file is processed
add ad hoc logic for bad xref handling
beautify
beautify
implement ad hoc channel count detection for new image extraction
improve performance
refactor scanned page filtering
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor scanned page filtering WIP
refactor
...
2023-02-13 17:35:04 +01:00
Julius Unverfehrt
79455f0dd6
Merge branch 'master' of ssh://git.iqser.com:2222/rr/image-prediction into RED-6189-bugfix
2023-02-13 17:23:07 +01:00
Julius Unverfehrt
2bc9c24f6a
revert refactoring changes
...
- revert functional refactoring changes to be able
to determine where the error described in the ticket comes from
- change array normalization to dimensionally
sparse arrays to reduce memory consumption
2023-02-13 13:53:35 +01:00
Julius Unverfehrt
ea301b4df2
Pull request #40 : replace trace log level by debug
...
Merge in RR/image-prediction from adjust-falsy-loglevel to master
Squashed commit of the following:
commit 66794acb1a64be6341f98c7c0ce0bc202634a9f4
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date: Fri Feb 10 10:15:41 2023 +0100
replace trace log level by debug
- trace method is not supported by buld-in logging module
2023-02-10 10:18:38 +01:00
Matthias Bisping
5cdf93b923
Pull request #39 : RED-6084 Improve image extraction speed
...
Merge in RR/image-prediction from RED-6084-adhoc-scanned-pages-filtering-refactoring to master
Squashed commit of the following:
commit bd6d83e7363b1c1993babcceb434110a6312c645
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Thu Feb 9 16:08:25 2023 +0100
Tweak logging
commit 55bdd48d2a3462a8b4a6b7194c4a46b21d74c455
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Thu Feb 9 15:47:31 2023 +0100
Update dependencies
commit 970275b25708c05e4fbe78b52aa70d791d5ff17a
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Thu Feb 9 15:35:37 2023 +0100
Refactoring
Make alpha channel check monadic to streamline error handling
commit e99e97e23fd8ce16f9a421d3e5442fccacf71ead
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Tue Feb 7 14:32:29 2023 +0100
Refactoring
- Rename
- Refactor image extraction functions
commit 76b1b0ca2401495ec03ba2b6483091b52732eb81
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Tue Feb 7 11:55:30 2023 +0100
Refactoring
commit cb1c461049d7c43ec340302f466447da9f95a499
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Tue Feb 7 11:44:01 2023 +0100
Refactoring
commit 092069221a85ac7ac19bf838dcbc7ab1fde1e12b
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Tue Feb 7 10:18:53 2023 +0100
Add to-do
commit 3cea4dad2d9703b8c79ddeb740b66a3b8255bb2a
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Tue Feb 7 10:11:35 2023 +0100
Refactoring
- Rename
- Add typehints everywhere
commit 865e0819a14c420bc2edff454d41092c11c019a4
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 19:38:57 2023 +0100
Add type explanation
commit 01d3d5d33f1ccb05aea1cec1d1577572b1a4deaa
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 19:37:49 2023 +0100
Formatting
commit dffe1c18fc3a322a6b08890d4438844e8122faaf
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 19:34:13 2023 +0100
[WIP] Either refactoring
Add alternative formulation for monadic chain
commit 066cf17add404a313520cd794c06e3264cf971c9
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 18:40:30 2023 +0100
[WIP] Either refactoring
commit f53f0fea298cdab88deb090af328b34d37e0198e
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 18:18:34 2023 +0100
[WIP] Either refactoring
Propagate error and metadata
commit 274a5f56d4fcb9c67fac5cf43e9412ec1ab5179e
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 17:51:35 2023 +0100
[WIP] Either refactoring
Fix test assertion
commit 3235a857f6e418e50484cbfff152b0f63efb2f53
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 16:57:31 2023 +0100
[WIP] Either-refactoring
Replace Maybe with Either to allow passing on error information or
metadata which otherwise get sucked up by Nothing.
commit 89989543d87490f8b20a0a76055605d34345e8f4
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 16:12:40 2023 +0100
[WIP] Monadic refactoring
Integrate image validation step into monadic chain.
At the moment we lost the error information through this. Refactoring to
Either monad can bring it back.
commit 022bd4856a51aa085df5fe983fd77b99b53d594c
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 15:16:41 2023 +0100
[WIP] Monadic refactoring
commit ca3898cb539607c8c3dd01c57e60211a5fea8a7d
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 15:10:34 2023 +0100
[WIP] Monadic refactoring
commit d8f37bed5cbd6bdd2a0b52bae46fcdbb50f9dff2
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 15:09:51 2023 +0100
[WIP] Monadic refactoring
commit 906fee0e5df051f38076aa1d2725e52a182ade13
Author: Matthias Bisping <matthias.bisping@axbit.com>
Date: Mon Feb 6 15:03:35 2023 +0100
[WIP] Monadic refactoring
... and 35 more commits
2023-02-10 08:33:13 +01:00
Julius Unverfehrt
4d43e385c5
replace image extraction logic final
2023-02-06 09:43:28 +01:00
Julius Unverfehrt
bd0279ddd1
introduce normalizing function for image extraction
2023-02-03 12:25:27 +01:00
Julius Unverfehrt
2995d5ee48
refactoring
2023-02-03 11:14:14 +01:00
Julius Unverfehrt
eff1bb4124
adjust behavior of filtering of invalid images
2023-02-03 09:04:02 +01:00
Julius Unverfehrt
c478333111
add log in callback to diplay which file is processed
2023-02-03 08:25:36 +01:00
Julius Unverfehrt
978f48e8f9
add ad hoc logic for bad xref handling
2023-02-02 15:39:44 +01:00
Julius Unverfehrt
94652aafe4
beautify
2023-02-02 15:26:33 +01:00
Julius Unverfehrt
c4416636c0
beautify
2023-02-02 14:10:32 +01:00
Julius Unverfehrt
c0b41e77b8
implement ad hoc channel count detection for new image extraction
2023-02-02 13:57:56 +01:00
Julius Unverfehrt
73f7491c8f
improve performance
...
- disable scanned page filter, since dropping these disables the
computation of the images hash and the frontend OCR hint, which are both
wanted
- optimize image extraction by using arrays instead of byte streams for
the conversion to PIL images
2023-02-02 13:37:03 +01:00
Julius Unverfehrt
2385584dcb
refactor scanned page filtering
2023-02-01 15:49:36 +01:00
Julius Unverfehrt
b880e892ec
refactor scanned page filtering WIP
2023-02-01 15:47:40 +01:00
Julius Unverfehrt
8c7349c2d1
refactor scanned page filtering WIP
2023-02-01 15:36:16 +01:00
Julius Unverfehrt
c55777e339
refactor scanned page filtering WIP
2023-02-01 15:16:12 +01:00
Julius Unverfehrt
0f440bdb09
refactor scanned page filtering WIP
2023-02-01 15:14:27 +01:00
Julius Unverfehrt
436a32ad2b
refactor scanned page filtering WIP
2023-02-01 15:07:35 +01:00
Julius Unverfehrt
9ec6cc19ba
refactor scanned page filtering WIP
2023-02-01 14:53:26 +01:00
Julius Unverfehrt
2d385b0a73
refactor scanned page filtering WIP
2023-02-01 14:38:55 +01:00
Julius Unverfehrt
5bd5e0cf2b
refactor
...
- reduce code duplication by adapting functions of the module
- use the modules enums for image metadata
- improve readabilty of the scanned page detection heuristic
2023-02-01 12:43:59 +01:00
Julius Unverfehrt
876260f403
improve the readability of variable names and docstrings
2023-02-01 10:08:36 +01:00
Julius Unverfehrt
368c54a8be
clean-up filter logic
...
- Logic adapted so that it can potentially be
easily removed again from the extraction logic
2023-02-01 08:49:30 +01:00
Julius Unverfehrt
1490d27308
introduce adhoc filter for scanned pages
2023-01-31 17:18:28 +01:00
