154 Commits

Author SHA1 Message Date
Julius Unverfehrt
6d1ca4d6a3 Pull request #11: Integrate new pyinfra
Merge in RR/cv-analysis from integrate-new-pyinfra to master

Squashed commit of the following:

commit f27b7eb342838b7a235a062a04363dc417f859ad
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 14:24:03 2022 +0200

    refactor table test

commit 9f57cc7d72bffc106c852041666b2f11eb6eacc3
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 14:07:37 2022 +0200

    debug bamboo

commit 30911cc5a34559a8b622634ddf974a9860481d17
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 13:22:04 2022 +0200

    track test data with dvc

commit 501460c3c99482879ae585872bd67fd67693c47a
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 13:19:39 2022 +0200

    untrack test data

commit f65ade167802901a6f402618c062df0120279df3
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 12:02:43 2022 +0200

    refactor&extend tests

commit 8c9dc41ddeda5b0f630a267e328d1c09f69bdb04
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 09:36:26 2022 +0200

    debug bamboo

commit f0b38130502475cf9bfa8632d3b0eb3a84b32b7d
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 09:27:42 2022 +0200

    debug bamboo

commit 0f188b4eb5293cf2bc4024fb397f161ad3b867bd
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 09:23:38 2022 +0200

    update build script

commit 281e13d822790deefa3d1a4f2519d300d84cded3
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 09:21:31 2022 +0200

    refactor tests

commit e90e84cb3b13b2903611985cc9eb3b5b7bf0262e
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 08:54:29 2022 +0200

    parametrize analysis_fn for server logic, refactor tests

commit 20734bcd14fec489e80ea6900dba64de4b190398
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Jun 23 08:53:16 2022 +0200

    oursource tests from module

commit cd2c41762df1a231f2ed1d43c3b71d2443530ffa
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 14:26:36 2022 +0200

    add tests for analyse server logic

commit 16497ac4ec8b0d7064f6d8dd887c189f0d955a1d
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 11:36:34 2022 +0200

    debug build script

commit 45688c1c6d9b738cce519edcdc044aae3b800cd1
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 11:33:13 2022 +0200

    debug build script

commit 0576140916c0cd9d290dd02225621e5360665d71
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 10:51:51 2022 +0200

    update tests

commit fcbecdde95cef46bce46545af65d040cc918447b
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 10:04:30 2022 +0200

    rename operations, update requirements

commit 7b40f6d643bb332fd7dd0867d64f17db16ede5bb
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Wed Jun 22 10:03:48 2022 +0200

    adjust deployment scripts

commit b66f937d2e0abc79e68bce6ee058bc0bd5cb86e5
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Jun 21 13:32:44 2022 +0200

    refactor server logic, use operation2function logic for pyinfra server

commit 5e7247f85cacaa6c0643796a98f13642db3e59e1
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Mon Jun 20 17:23:11 2022 +0200

    add server logic for pyinfra 2

commit eecb985fed76af9404bd99f0104508efe7d75e35
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Mon Jun 20 16:24:05 2022 +0200

    add server logic for pyinfra 2.0.0

... and 3 more commits
2022-06-23 14:45:08 +02:00
Julius Unverfehrt
0858a69364 update planspec in order to add pyinfra as subrepo to bamboo, since it cant't be updated on other branches 2022-06-22 12:43:58 +02:00
Isaac Riley
268329a57f add pyinfra_compat.py 2022-06-20 13:48:16 +02:00
Isaac Riley
b66a7f15e1 added pyinfra_compat file, usage: from cv_analysis.pyinfra_compat import analyze_byteslist; page_results = analyze_byteslist(img_bytes_list) 2022-06-14 09:09:00 +02:00
Isaac Riley
0d9d577187 reformat 2022-06-13 13:04:15 +02:00
Isaac Riley
c62ab08b98 ready for integration with pyinfra 2022-06-13 12:59:00 +02:00
Isaac Riley
01803d452a Merge branch 'fig-detection-scanned-pdfs' master_8 2022-05-24 17:07:09 +02:00
llocarnini
f5a75f3949 changes in export_example_pages.py as well as removing unused imports in table_parsing.py 2022-05-24 16:20:52 +02:00
llocarnini
e6a173053b Merge remote-tracking branch 'origin/fig-detection-scanned-pdfs' into fig-detection-scanned-pdfs 2022-05-24 09:33:18 +02:00
llocarnini
90dfacab21 deleted function for processing testfiles 2022-05-24 09:32:48 +02:00
llocarnini
c4c85ace6d added locations and changed names for test_files 2022-05-24 09:31:29 +02:00
Isaac Riley
a4626e635a removed problematic dvc file 2022-05-24 08:19:25 +02:00
Isaac Riley
3f33ab4f3d resolve a DVC conflict 2022-05-24 08:01:42 +02:00
llocarnini
179ad20165 minor changes, refactoring and testfiles added 2022-05-17 09:17:24 +02:00
llocarnini
0e30e97f80 Merge branch 'master' of ssh://git.iqser.com:2222/rr/cv-analysis into fig-detection-scanned-pdfs
 Conflicts:
	cv_analysis/figure_detection.py
	cv_analysis/layout_parsing.py
	cv_analysis/table_parsing.py
	scripts/annotate.py
2022-05-04 09:33:14 +02:00
Isaac Riley
21d1f087c8 fixed show parameter, for development only master_7 2022-04-27 11:27:38 +02:00
llocarnini
98ed9a4220 Merge remote-tracking branch 'origin/fig-detection-scanned-pdfs' into fig-detection-scanned-pdfs 2022-04-27 11:12:43 +02:00
llocarnini
2c39ffbcdd changed kernel and iteration for better text removal 2022-04-27 11:12:23 +02:00
Isaac Riley
81fe5139c2 fixed tests, passed (still need to extend tests) 2022-04-27 10:52:35 +02:00
Isaac Riley
41e5f55ea7 got changes to table parsing from other branch 2022-04-27 09:18:57 +02:00
Isaac Riley
b806c3c13d fix for table parsing when no outer line is present 2022-04-27 09:15:15 +02:00
Isaac Riley
4ac1cce0e8 reformatting 2022-04-26 16:01:57 +02:00
llocarnini
19fe6965fb added line in display so the visual logger doesn't open too many plots
changes to fig_detection_with_layout.py so tables are getting parsed as well

reusage of adding external contour in table_parsing.py
2022-04-26 11:19:27 +02:00
Isaac Riley
9327fb7231 fixed json format and refactored service functions 2022-04-22 11:22:16 +02:00
llocarnini
17f5b22443 Merge branch 'master' of ssh://git.iqser.com:2222/rr/cv-analysis into fig-detection-scanned-pdfs
 Conflicts:
	cv_analysis/figure_detection.py
	cv_analysis/layout_parsing.py
	cv_analysis/table_parsing.py
	scripts/annotate.py
2022-04-22 10:24:09 +02:00
llocarnini
11a2465789 few corrections for including smaller figures 2022-04-22 10:12:28 +02:00
Isaac Riley
88bb8dbddf added visual logger for development 2022-04-21 15:10:35 +02:00
Isaac Riley
0ea556a7e0 slightly refactored table parsing and deleted unneeded file 2022-04-21 09:17:12 +02:00
llocarnini
3669b6b341 fig_detection_with_layout.py: approach to label the content of a page through layout detection, table parsing for detected tables needs to be added and overall codes needs to be reviewed
layout_parsing.py added condition so fig_detection_with_layout.py works
table_parsing.py uncommented line for better table parsing
text.py changed kernel sizes
2022-04-20 09:43:30 +02:00
llocarnini
420e484896 the thresholds deciding weather a countour is likely a primary text structure can be set better, as text structures are not always removed. this leads to over detection of figures 2022-04-12 16:48:29 +02:00
Isaac Riley
0b96980cc5 keyword 'show' to fix annotation script without causing problems for non-script usage 2022-04-11 09:44:47 +02:00
Isaac Riley
64258ed6e1 fixed hyphen/underscore confusion in cv_analysis master_5 2022-03-23 14:42:39 +01:00
Isaac Riley
80b0ca4ec5 tiny change to test build server 2022-03-23 14:35:00 +01:00
Isaac Riley
af898a37ac fixed naming errors 2022-03-23 13:55:30 +01:00
Isaac Riley
395456f196 Merge branch 'master' of ssh://git.iqser.com:2222/rr/vidocp 2022-03-23 13:51:26 +01:00
Isaac Riley
8730b34018 change name from vidocp to cv-analysis 2022-03-23 13:46:57 +01:00
Christoph  Schabert
604e9aa1b8 PlanSpec.java edited online with Bitbucket master_2 2022-03-23 13:45:28 +01:00
Isaac Riley
addacf9ed6 modify tests to not use poppler-utils, in order to pass sonar scan master_20 2022-03-23 09:48:47 +01:00
Isaac Riley
ad302aba79 try without test master_19 2022-03-22 14:14:47 +01:00
Isaac Riley
2726b85ef2 fixed build config minutia 2022-03-22 14:06:15 +01:00
Isaac Riley
d37fa6eaf7 remove option to ignore tests in sonar scan 2022-03-22 13:20:52 +01:00
Isaac Riley
dac6d47dc2 uncomment testing code in sonar script 2022-03-22 13:04:11 +01:00
Isaac Riley
7d22db92cf added table tests for use with sonar master_14 2022-03-22 12:54:10 +01:00
Isaac Riley
635fb84811 post-monitoring debug, especially of deskewing and skew check master_13 2022-03-17 21:51:15 +01:00
Isaac Riley
fa479adfb0 manually added tests from test branch to avoid major conflicts master_12 2022-03-15 12:17:09 +01:00
Isaac Riley
a089fa5e42 first working version with new API master_11 2022-03-14 21:26:49 +01:00
Isaac Riley
8cd8c1b1f0 try yet another time because sonar hates me master_10 master_9 2022-03-09 16:03:27 +01:00
Isaac Riley
468c3353f4 fix again for sonar 2022-03-09 15:57:41 +01:00
Isaac Riley
1eb13f8d53 fix requirements for sonar 2022-03-09 15:55:03 +01:00
Isaac Riley
64a42b5be3 fix build problem involving build_venv/ 2022-03-09 15:47:20 +01:00