379 Commits

Author SHA1 Message Date
Timo
ab3b30b282 prepared redaction service for queue handling redaction-system-queue-prep_2 2021-04-21 14:11:22 +03:00
Timo
0d63f9372f added reanalyse if possible flag to analyse request 2.5.0 master_289 2021-04-21 09:16:36 +03:00
Timo Bejan
07b05b2d89 Pull request #142: Improved redaction performance
Merge in RED/redaction-service from improved-redaction-performance to master

* commit 'b34fc673c4d5a4440d6e5f2391db4420c4d2acf9':
  bamboo-specs/src/main/java/buildjob/PlanSpec.java edited online with Bitbucket
  fixed some test issues
  fixed pmd
  updated planspec
  updated redrect
  set mvn opts
  run tests with real life jvm args to detect oom issues early
  code format, dependecy and test update, logging for reanalysis
  reworked reanalysis and text storage
  Serialization of text
2.4.9 master_287
2021-04-20 10:30:15 +02:00
Timo Bejan
b34fc673c4 bamboo-specs/src/main/java/buildjob/PlanSpec.java edited online with Bitbucket improved-redaction-performance_28 2021-04-20 09:57:25 +02:00
Timo
5b24c3a52c fixed some test issues 2021-04-20 10:56:19 +03:00
Timo
385dff63ce fixed pmd 2021-04-20 10:37:53 +03:00
Timo
f1ce52a19a updated planspec 2021-04-20 10:33:30 +03:00
Timo
e48e4e1797 updated redrect 2021-04-20 10:32:54 +03:00
Timo
7af51f992a set mvn opts 2021-04-20 10:32:11 +03:00
Timo
15f911ee73 run tests with real life jvm args to detect oom issues early 2021-04-20 10:28:40 +03:00
Timo
ba28a3e0d3 code format, dependecy and test update, logging for reanalysis 2021-04-20 10:26:27 +03:00
Timo
1d4708ad13 reworked reanalysis and text storage 2021-04-20 09:51:50 +03:00
Timo
5c2596e268 Serialization of text 2021-04-19 13:08:32 +03:00
Timo Bejan
674ebf8eb7 Pull request #140: Improved redaction performance
Merge in RED/redaction-service from improved-redaction-performance to master

* commit '42fcea85d30f914fe02e304e69a551da409c6c3b':
  set image type on error
  proper error handling for image clasification
2.4.8 master_284
2021-04-18 11:39:27 +02:00
Timo
42fcea85d3 set image type on error improved-redaction-performance_13 2021-04-18 11:31:33 +03:00
Timo
a34d2fb675 proper error handling for image clasification 2021-04-18 11:30:53 +03:00
Timo Bejan
e38aed22de Pull request #139: attempted fix for image clasification
Merge in RED/redaction-service from improved-redaction-performance to master

* commit 'ed5686dc51f57c9e772ccc3c0ef2a8955e7f3e73':
  Re-worked cache issues
  close final PDDocument
  fixed in-memory storage issues
  "fixed" memory issues by calling GC manually, removing soft reference cache and disposing images properly
  attempted fix for image clasification
2.4.7 master_282
2021-04-17 09:13:12 +02:00
Timo
ed5686dc51 Re-worked cache issues improved-redaction-performance_10 2021-04-17 09:55:46 +03:00
Timo
8112f2035a close final PDDocument 2021-04-17 09:18:01 +03:00
Timo
169ab20351 fixed in-memory storage issues 2021-04-17 09:10:40 +03:00
Timo
8060e3a29f "fixed" memory issues by calling GC manually, removing soft reference cache and disposing images properly 2021-04-16 23:13:12 +03:00
Timo
4749858e80 attempted fix for image clasification 2021-04-16 20:53:09 +03:00
Timo Bejan
8429e262ea Pull request #138: added versions to analyze result
Merge in RED/redaction-service from improved-redaction-performance to master

* commit '93d75e2f1c9f692989b69d2c20df7073f6db45c7':
  added versions to analyze result
2.4.6 master_280
2021-04-16 15:12:39 +02:00
Timo
93d75e2f1c added versions to analyze result improved-redaction-performance_4 2021-04-16 15:52:17 +03:00
Timo Bejan
0ac55afbb0 Pull request #137: Reworked re-analysis and analysis to use memory model / directly read/store files, and dumped pd doc wherever possible
Merge in RED/redaction-service from improved-redaction-performance to master

* commit '5cb4ea287cfecc61efbe959f182e9e7f4e2ba78c':
  Reworked re-analysis and analysis to use memory model / directly read/store files, and dumped pd doc wherever possible
2.4.5 master_278
2021-04-16 14:25:33 +02:00
Timo
5cb4ea287c Reworked re-analysis and analysis to use memory model / directly read/store files, and dumped pd doc wherever possible improved-redaction-performance_2 2021-04-16 14:50:04 +03:00
Dominique Eiflaender
ed59f36220 Pull request #136: Fixed endless loop on documents that contains no text
Merge in RED/redaction-service from EndlessLoopFix to master

* commit 'c157a80630323aa0d654559636b7246e1901b598':
  Fixed endless loop on documents that contains no text
2.4.4
2021-04-16 10:12:55 +02:00
Dominique Eifländer
c157a80630 Fixed endless loop on documents that contains no text EndlessLoopFix_3 2021-04-16 09:42:29 +02:00
Dominique Eiflaender
a7aa3a723a Pull request #135: RED-1260: Enabled to add rules and manuel redaction actions for images
Merge in RED/redaction-service from RED-1260 to master

* commit '55ba351362785de41090fb4252c9ee7c4c486991':
  RED-1260: Enabled to add rules and manuel redaction actions for images
2.4.3
2021-04-15 13:08:24 +02:00
Dominique Eifländer
55ba351362 RED-1260: Enabled to add rules and manuel redaction actions for images RED-1260_4 2021-04-15 12:51:29 +02:00
Dominique Eiflaender
9696a421fc Pull request #134: RED-1260
Merge in RED/redaction-service from RED-1260 to master

* commit 'ae28555bf4c740d9872e26fb27615fbf7402f002':
  RED-1260: First steps for image classification
  Integrate image classification
2.4.2
2021-04-09 15:11:49 +02:00
Dominique Eifländer
ae28555bf4 RED-1260: First steps for image classification RED-1260_2 2021-04-09 13:37:00 +02:00
Dominique Eifländer
2558b3cab8 Integrate image classification 2021-04-09 11:44:12 +02:00
Dominique Eiflaender
2c92f03f2a Pull request #133: Do not remove images on reanalysis
Merge in RED/redaction-service from DoNotRemoveImages2 to master

* commit 'fc70f972da887370f011ad1998e209ba676d90db':
  Do not remove images on reanalysis
2.4.1
2021-04-08 16:02:05 +02:00
Dominique Eifländer
fc70f972da Do not remove images on reanalysis DoNotRemoveImages2_2 2021-04-08 15:47:11 +02:00
Dominique Eiflaender
0e8c28f8fd Pull request #132: Do not remove images at reanalysis
Merge in RED/redaction-service from ImageReanalysisFix to master

* commit 'e7c24487c755ab84c0f1efe5a0c6e9d4794d4c0f':
  Do not remove images at reanalysis
2021-04-08 15:37:13 +02:00
Dominique Eifländer
e7c24487c7 Do not remove images at reanalysis ImageReanalysisFix_2 2021-04-08 15:22:25 +02:00
Dominique Eiflaender
fc10152145 Pull request #131: RED-1276: Fixed annotation position problem for 270° rotated pages
Merge in RED/redaction-service from RED-1276 to master

* commit '8375c04829347f43c2151e80dd4f4571b0c2757d':
  RED-1276: Fixed annotation position problem for 270° rotated pages
2.3.9
2021-04-08 10:49:40 +02:00
Dominique Eifländer
8375c04829 RED-1276: Fixed annotation position problem for 270° rotated pages RED-1276_2 2021-04-08 10:30:51 +02:00
Dominique Eiflaender
57a79719d4 Pull request #130: RED-1061: Upgraded to newest spring boot/cloud and reenabled actuator metrics
Merge in RED/redaction-service from RED-1061 to master

* commit '0638877d0afb3b577f7be5467cde1d1b34044772':
  RED-1061: Upgraded to newest spring boot/cloud and reenabled actuator metrics
2.3.8
2021-03-15 13:37:30 +01:00
Dominique Eifländer
0638877d0a RED-1061: Upgraded to newest spring boot/cloud and reenabled actuator metrics RED-1061_4 2021-03-15 13:22:14 +01:00
Dominique Eiflaender
6c33b7e2ae Pull request #129: RED-1170: Do not use non dictionay hints vor local analysis
Merge in RED/redaction-service from RED-1170 to master

* commit 'aac4d0437e2f9e81f5f4a814dbc86e47b07f57d7':
  RED-1170: Do not use non dictionay hints vor local analysis
2.3.7
2021-03-15 11:56:38 +01:00
Dominique Eifländer
aac4d0437e RED-1170: Do not use non dictionay hints vor local analysis RED-1170_2 2021-03-15 11:35:40 +01:00
Dominique Eiflaender
93dcd6b9f7 Pull request #128: Fixed importing caseinsensitive dictionaties
Merge in RED/redaction-service from caseInSensFix to master

* commit 'bd56364cc3bfa25084069c79bef107869bdc5574':
  Fixed importing caseinsensitive dictionaties
2.3.6
2021-03-12 15:25:43 +01:00
Dominique Eifländer
bd56364cc3 Fixed importing caseinsensitive dictionaties caseInSensFix_2 2021-03-12 15:08:34 +01:00
Dominique Eiflaender
91942730e8 Pull request #127: Fixed renalysis for caseinsensitive dictionary entries
Merge in RED/redaction-service from caseinsensitiveValues to master

* commit 'f4ea236fc587df34eda20ead5762737bca447f3d':
  Fixed renalysis for caseinsensitive dictionary entries
2.3.5
2021-03-11 14:15:17 +01:00
Dominique Eifländer
f4ea236fc5 Fixed renalysis for caseinsensitive dictionary entries caseinsensitiveValues_3 2021-03-11 13:57:15 +01:00
Dominique Eiflaender
9db74628a4 Pull request #126: First steps for incremental analysis
Merge in RED/redaction-service from incrementAnalysis to master

* commit '511092b9e76d58af33dfff90c1133b92e850d47c':
  First steps for incremental analysis
2.3.4
2021-03-09 09:12:13 +01:00
Dominique Eifländer
511092b9e7 First steps for incremental analysis incrementAnalysis_4 2021-03-08 16:31:37 +01:00
Dominique Eiflaender
dd4f1b34e1 Pull request #125: RED-1090: Return text with areas and sectionNumber
Merge in RED/redaction-service from RED-1090 to master

* commit '0dd47111c5294d9a9a0a10e174c2832436983205':
  RED-1090: Return text with areas and sectionNumber
2.3.3
2021-02-25 15:10:58 +01:00