239 Commits

Author SHA1 Message Date
francisco.schulz
335da13cb5 copy cv_analysis folder, not only files 2023-06-19 11:25:07 +02:00
Francisco Schulz
441814f201 Merge branch 'RES-142-migrate-red-cv-analysis-service' into 'master'
Resolve RES-142 "Migrate red cv analysis service"

Closes RES-142

See merge request redactmanager/cv-analysis-service!2
1.20.0
2023-06-07 16:46:58 +02:00
francisco.schulz
f9a9a86bc7 use patched CI 2023-06-07 16:45:28 +02:00
francisco.schulz
d98f38607f increase patch version 2023-06-07 15:56:02 +02:00
francisco.schulz
63d2f891e4 correct version number 1.19.0 1.19.0-dev 2023-06-07 15:41:28 +02:00
francisco.schulz
cb974b19b6 use CI template ref:0.2.0 2023-06-07 15:36:26 +02:00
Francisco Schulz
019f0da11a Update .gitlab-ci.yml file 2023-06-07 15:18:40 +02:00
Francisco Schulz
9adc0e2ced echo DVC vars 2023-06-07 15:09:59 +02:00
Francisco Schulz
11515f6f71 Merge branch 'RES-142-migrate-red-cv-analysis-service-patch-0d3b' into 'RES-142-migrate-red-cv-analysis-service'
add config without connection_string

See merge request redactmanager/cv-analysis-service!1
2023-06-07 13:08:30 +02:00
Francisco Schulz
ee5f960a3f add config without connection_string 2023-06-07 13:07:43 +02:00
francisco.schulz
5b991d3a69 remove DVC config from git 2023-06-07 12:55:50 +02:00
francisco.schulz
6033fec952 remove git submodules 2023-06-07 12:53:37 +02:00
francisco.schulz
c64f02696d add CI 2023-06-07 12:53:05 +02:00
francisco.schulz
79163c33cf update dockerfile to work with poetry 2023-06-07 12:52:52 +02:00
francisco.schulz
44dd613715 add dev setup script 2023-06-07 12:52:27 +02:00
francisco.schulz
3654ab3c8d update 2023-06-07 12:52:11 +02:00
francisco.schulz
bb6ba8e0e9 update dependencies 2023-06-07 12:51:59 +02:00
francisco.schulz
6323884683 remove old CI files 2023-06-07 12:51:45 +02:00
Julius Unverfehrt
def2d2d108 Pull request #41: RED-6273 multi tenant storage
Merge in RR/cv-analysis from RED-6273-multi-tenant-storage to master

Squashed commit of the following:

commit ed07dc26b0323bf1f0a5b336e4075c8cc3d20d29
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 28 18:03:16 2023 +0200

    update pyinfra version with removed falsy dependencies from pyinfra

commit 202ce84419465ddcbe3e263e58917cc92b2639a6
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 28 17:27:44 2023 +0200

    update pyinfra for bugfix

commit 87122ffb965c016383bfd49e2eaaa6ab3b5d7101
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 28 15:50:29 2023 +0200

    Update pyinfra for multi-tenancy support

    Update serve script with PayloadProcessor from pyinfra
1.19.0
2023-03-28 18:12:01 +02:00
Julius Unverfehrt
cfbd2e287a update pyinfra with fixed prometheus port 1.18.0 2023-03-21 16:07:58 +01:00
Julius Unverfehrt
436824c926 Pull request #40: add table processing time monitoring
Merge in RR/cv-analysis from RED-6205-add-prometheus-monitoring to master

* commit '1a4ae6735d4ad3112fc1c48496e216f6d69ff675':
  add table processing time monitoring
1.17.0
2023-03-17 07:45:10 +01:00
Julius Unverfehrt
1a4ae6735d add table processing time monitoring RED-6205-add-prometheus-monitoring_2 2023-03-16 17:33:49 +01:00
Julius Unverfehrt
08c0096c07 Pull request #38: upgrade references
Merge in RR/cv-analysis from RED-6118-multi-tenancy-patch to master

* commit '233c6facfd75771885ae87c79b57bcb53c71d6e7':
  upgrade references
1.16.0
2023-02-16 16:47:40 +01:00
Julius Unverfehrt
233c6facfd upgrade references RED-6118-multi-tenancy-patch_3 2023-02-16 16:45:19 +01:00
Francisco Schulz
4ce6c9bdc9 Pull request #37: RED-5277 fix heartbeat issue
Merge in RR/cv-analysis from RED-5277-fix-heartbeat-issue to master

* commit '5bb9282da6aa1d75182c2172c601bed534099b0f':
  use python 3.8 in build
  update serve.py to work with new pyinfra version
  update reference to pyinfra
1.15.0 RED-6118-multi-tenancy-patch_2
2023-02-16 11:06:06 +01:00
Francisco Schulz
5bb9282da6 use python 3.8 in build RED-5277-fix-heartbeat-issue_3 2023-02-16 11:00:06 +01:00
Francisco Schulz
eef371e2a8 update serve.py to work with new pyinfra version 2023-02-16 10:47:13 +01:00
Francisco Schulz
ad45e2c1da update reference to pyinfra 2023-02-16 10:46:55 +01:00
Matthias Bisping
6909e48b60 Pull request #36: Poetrify
Merge in RR/cv-analysis from poetrify to master

* commit '35d046c454cc199515fee87ec3463a5fe106e986':
  Rollback
  Copy paste and adjust build code from rule-engine repo
  Poetrify Dockerfile
  Rollback
  Update requirements file
  Add dvc-data-pull fixture
  Adjust pdf2img dependency branch
  Adjust type hints for new lower python version
  Initialize poetry and add dependencies
1.14.0
2023-01-03 15:22:35 +01:00
Matthias Bisping
35d046c454 Rollback
Porting build logic to poetry not economical right now.
poetrify_9
2023-01-03 11:38:33 +01:00
Matthias Bisping
f0bba5bbdb Copy paste and adjust build code from rule-engine repo
That build code is more recent and the current build code fails.
2023-01-03 10:51:26 +01:00
Matthias Bisping
aee7ee9b97 Poetrify Dockerfile 2023-01-03 10:41:09 +01:00
Matthias Bisping
64639bce6d Rollback poetrify_6 2023-01-03 10:15:13 +01:00
Matthias Bisping
16698428f3 Update requirements file 2023-01-03 10:11:01 +01:00
Matthias Bisping
04f100386d Add dvc-data-pull fixture
This allows the tests that depend on input files to run without the need
to manuallt dvc-pull them beforehand.
poetrify_4
2023-01-03 10:01:03 +01:00
Matthias Bisping
fcb2786697 Adjust pdf2img dependency branch poetrify_3 2023-01-02 15:57:06 +01:00
Matthias Bisping
7bbe459208 Adjust type hints for new lower python version poetrify_2 2023-01-02 15:46:35 +01:00
Matthias Bisping
d52b2bfe22 Initialize poetry and add dependencies 2023-01-02 15:45:47 +01:00
Julius Unverfehrt
506ed789f7 add explorative script for hierarichal layout parsing 1.13.0 2022-12-13 11:16:15 +01:00
Julius Unverfehrt
d14960da08 Pull request #35: RED-5527 update pdf2img with skip_pages_without_images flag, add ENV for this setting for table parsing
Merge in RR/cv-analysis from RED-5527 to master

Squashed commit of the following:

commit 1748095ce45f4a76e9d3d8547d9fc70f7deae2fb
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Nov 8 15:15:16 2022 +0100

    RED-5527 update pdf2img with skip_pages_without_images flag, add ENV for this setting for table parsing
1.12.0
2022-11-08 15:16:53 +01:00
Francisco Schulz
8c5a979cc8 Pull request #34: update pyinfra
Merge in RR/cv-analysis from fschulz/update-to-new-pyinfra-version to master

* commit '555d1973b7a80a38e0893412ba0e0c0e2af4a520':
  update pyinfra
1.11.0
2022-10-13 15:33:31 +02:00
Francisco Schulz
555d1973b7 update pyinfra fschulz/update-to-new-pyinfra-version_4 2022-10-13 15:29:57 +02:00
Julius Unverfehrt
b26253120c Pull request #33: Fix response coords
Merge in RR/cv-analysis from fix-response-coords to master

Squashed commit of the following:

commit 0c6178a564b48abc43f129f81d93091a277fc64a
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Oct 6 14:53:02 2022 +0200

    update tests

commit 46ad8737593df976555e4f60db8dc7947784d46d
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Oct 6 14:40:25 2022 +0200

    rename script

commit f541311d0aae22d5b76ba3c2580aada662812557
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Oct 6 14:40:11 2022 +0200

    response now returns natural page index, update pdf2image to correct response coordinates
1.10.0 fschulz/update-to-new-pyinfra-version_2
2022-10-06 14:56:28 +02:00
Viktor Seifert
559a86e7a3 Pull request #32: RED-5324: Update pyinfra to include storage-region fix
Merge in RR/cv-analysis from RED-5324 to master

* commit 'dcffacbb4568e2d8eebe20e0dd90efa8a9731f84':
  RED-5324: Update pyinfra to include storage-region fix
1.9.0
2022-09-30 16:12:46 +02:00
Viktor Seifert
dcffacbb45 RED-5324: Update pyinfra to include storage-region fix RED-5324_2 2022-09-30 16:07:46 +02:00
Christoph Schabert
7706cfe973 Pull request #31: hotfix: fix key prepare
Merge in RR/cv-analysis from hotfix/keyPrep to master

Squashed commit of the following:

commit 58961a319b985cb5d658d867459340eafc0e7c04
Author: cschabert <christoph.schabert@iqser.com>
Date:   Tue Sep 20 11:25:15 2022 +0200

    hotfix: fix key prepare

commit d937ff7c7d5824e8a75956102bfe7cf24fb27305
Author: Julius Unverfehrt <Julius.Unverfehrt@iqser.com>
Date:   Wed Aug 24 15:22:10 2022 +0200

    Pull request #30: RED-5009 update pyinfra to support message rejection on unobtainable files

    Merge in RR/cv-analysis from RED-5009-update-pyinfra to master

    Squashed commit of the following:

    commit fe46f92494b7f00db2884e0f11cd1f4cc29d1675
    Merge: 35d1675 95cab33
    Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
    Date:   Wed Aug 24 15:20:16 2022 +0200

        Merge branch 'master' of ssh://git.iqser.com:2222/rr/cv-analysis into RED-5009-update-pyinfra

    commit 35d16759eb747467ce8deb88f8d953da0d4dc630
    Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
    Date:   Wed Aug 24 15:19:41 2022 +0200

        RED-5009 update pyinfra to support message rejection on unobtainable files
1.8.0
2022-09-20 11:56:35 +02:00
Julius Unverfehrt
09ba101ce7 Pull request #30: RED-5009 update pyinfra to support message rejection on unobtainable files
Merge in RR/cv-analysis from RED-5009-update-pyinfra to master

Squashed commit of the following:

commit fe46f92494b7f00db2884e0f11cd1f4cc29d1675
Merge: 35d1675 95cab33
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Aug 24 15:20:16 2022 +0200

    Merge branch 'master' of ssh://git.iqser.com:2222/rr/cv-analysis into RED-5009-update-pyinfra

commit 35d16759eb747467ce8deb88f8d953da0d4dc630
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Aug 24 15:19:41 2022 +0200

    RED-5009 update pyinfra to support message rejection on unobtainable files
1.7.0
2022-08-24 15:22:10 +02:00
lillian locarnini
95cab33f19 Pull request #29: Evaluate layout detection
Merge in RR/cv-analysis from evaluate_layout_detection to master

Squashed commit of the following:

commit 8ec2f69fc61d1e15bd502b0a2c1f720cbec2b34e
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Tue Aug 23 15:07:21 2022 +0200

    repaired is_not_included() logic (did drop the outer rectangle, not the included)

commit 97be081d1e60989313924ceac0bfb3062229411e
Merge: 2c28fa2 2b5c4f1
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Tue Aug 23 14:28:14 2022 +0200

    Merge branch 'master' of ssh://git.iqser.com:2222/rr/cv-analysis into evaluate_layout_detection

commit 2c28fa280b7eff922c715245fffe69702c7e6742
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Tue Aug 23 13:50:17 2022 +0200

    del print statements

commit c60121fc4faebc5de556ec0ab7a3af4f815f7ce1
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Mon Aug 22 10:51:52 2022 +0200

    few changes to connect_rects.py

commit a99719905d58cbe856fa020177abd7e317c1d072
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Thu Aug 18 08:37:12 2022 +0200

    layout parsing improved with connect_rects.py

commit d693688a0f0d63395cfd36645de7b3417f64de30
Author: llocarnini <lillian.locarnini@iqser.com>
Date:   Tue Aug 2 09:31:19 2022 +0200

    removed vizlogger instances
1.6.0
2022-08-23 15:09:51 +02:00
Julius Unverfehrt
2b5c4f1e45 Pull request #28: queue callback: add storage lookup for input file, add should_publish flag to signal processing success to queue manager
Merge in RR/cv-analysis from RED-5009-extend-callback to master

Squashed commit of the following:

commit aa9871e11ca56c721024d702351a3b2d51d4c69d
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Aug 23 10:31:03 2022 +0200

    queue callback: add storage lookup for input file, add should_publish flag to signal processing success to queue manager
1.5.0
2022-08-23 10:43:34 +02:00
Julius Unverfehrt
ce3b460217 add executible rights 1.4.0 RED-5009-extend-callback_2 2022-08-18 09:10:03 +02:00