701 Commits

Author SHA1 Message Date
Kilian Schuettler
59827eab81 RED-6369: Rules Refactor
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
2023-05-05 14:31:01 +02:00
Kilian Schuettler
ea0181d50f RED-6369: Rules Refactor
*added betweenStrings to entityCreationService
2023-05-05 14:31:01 +02:00
Kilian Schuettler
6402151311 RED-6369: Rules Refactor
*some refactors
*some comment cleanup
2023-05-05 14:31:01 +02:00
Kilian Schuettler
d804f0d0a2 RED-6369: Rules Refactor
*fixed DocumentData Mapping
2023-05-05 14:31:01 +02:00
Kilian Schuettler
b6307759fb RED-6369: Rules Refactor
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
2023-05-05 14:31:01 +02:00
Kilian Schuettler
253e544724 RED-6368: Include Tables and Images into Prototype Document Structure
*started Implementation of new rules
2023-05-05 14:31:01 +02:00
Kilian Schuettler
d04a576397 RED-6368: Include Tables and Images into Prototype Document Structure
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
2023-05-05 14:31:01 +02:00
Kilian Schuettler
33d47e5202 RED-6368: Include Tables and Images into Prototype Document Structure
*added some starting rules
2023-05-05 14:31:01 +02:00
Kilian Schuettler
dc76e581c4 RED-6368: Include Tables and Images into Prototype Document Structure
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
2023-05-05 14:31:01 +02:00
Kilian Schuettler
f3bfe95ea7 RED-6093: Prototype document structure
*refactored File Structure
*started refactor of original rules
2023-05-05 14:31:01 +02:00
Kilian Schuettler
53fa4f2851 RED-6093: Prototype document structure
*refactored Nodes
*added some tests
*wip
2023-05-05 14:31:01 +02:00
deiflaender
64c54e73fb RED-6093: Prototype document structurewip dependency upgrade 2023-05-05 14:31:01 +02:00
Kilian Schuettler
7c024a579c RED-6093: Prototype document structure
wip
2023-05-05 14:31:01 +02:00
Kilian Schuettler
3aa2f84f08 RED-6093: Prototype find entities in rules
*added improved string to text position mapping
2023-05-05 14:31:01 +02:00
Kilian Schuettler
18dc68714b RED-6093: Prototype find entities in rules
*added a prototype paragraph rule
2023-05-05 14:31:01 +02:00
deiflaender
c4017e8e5e RED-6093: Prototype find entities in rules 2023-05-05 14:31:01 +02:00
Thomas Beyer
aff7074b40 RED-6619 - renamed variables 2023-04-28 16:54:16 +02:00
Thomas Beyer
2e37cd5669 RED-6619 - reformat code 2023-04-28 12:32:11 +02:00
Thomas Beyer
794a160115 RED-6619 - delete unnecessary import 2023-04-28 12:22:11 +02:00
Thomas Beyer
e2d3972e16 RED-6619 - moved not the logic to a boolean, but the 1 into a constant 2023-04-28 12:19:14 +02:00
Thomas Beyer
4a76e89ab8 RED-6619 - fix integration-tests by adding versions and move the hasMinimumSize-logic into own boolea 2023-04-28 12:13:54 +02:00
Thomas Beyer
fcc4085321 RED-6619 - added missing ' (typo) 2023-04-27 17:52:03 +02:00
Thomas Beyer
8490690001 RED-6619 - add logic to ignore found table-cells with height or width < 1.
Also: Fix the tests and add new segmentation-tests and 1 redaction-integration-test. Renamed the latter to fit maven regexp
2023-04-27 17:49:36 +02:00
Thomas Beyer
6f783a9f00 RED-6619 - add tests for table-extraction 2023-04-27 14:04:22 +02:00
devplant
9a933e9563 RED-5694 - Upgrade spring-boot to 3.0
- import storageAutoConfiguration to Application
2023-04-20 13:03:39 +03:00
devplant
7d4b3f40d3 RED-5694 - Upgrade spring-boot to 3.0
- exclude storageAutoConfiguration with @ComponentScan
2023-04-05 14:09:02 +03:00
devplant
d366d9207a RED-5694 - Upgrade spring-boot to 3.0
- remove comment code
2023-04-05 13:48:28 +03:00
devplant
e22e16aef1 RED-5694 - Upgrade spring-boot to 3.0
- remove comment code
2023-04-05 13:43:45 +03:00
devplant
077677e02d RED-5694 - Upgrade spring-boot to 3.0
- update exclusion of StorageAutoConfiguration
2023-04-05 13:22:17 +03:00
devplant
09de0dc2c6 RED-5694 - Upgrade spring-boot to 3.0
- update after the merge of master
2023-04-05 12:06:12 +03:00
devplant
c3b29e4ebc Merge branch 'master' of https://git.iqser.com/scm/red/redaction-service into RED-5694
# Conflicts:
#	redaction-service-v1/redaction-service-server-v1/src/test/java/com/iqser/red/service/redaction/v1/server/RedactionIntegrationTest.java
2023-04-05 11:37:33 +03:00
devplant
adcf17c5f0 RED-5694 - Upgrade spring-boot to 3.0
- update platfrom-dependency and other dependencies with latest versions
- remove dslplatform dependency
2023-04-05 10:58:18 +03:00
Thomas Beyer
49860ab95d Pull request #528: RED-6411 4.5.0 1
Merge in RED/redaction-service from RED-6411_4.5.0_1 to master

* commit '2a56187294c125931d4b998ee1f812ea426e2b58':
  RED-6411 - optimize code
  RED-6411 - optimize method
  RED-6411 - rename testclass because of regexp
  RED-6411 - fix import of configuration
  RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest
  RED-6411 - extend logic when replacing entities with higher rank
  RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine()
2023-03-29 15:03:13 +02:00
Thomas Beyer
2a56187294 RED-6411 - optimize code 2023-03-29 09:35:55 +02:00
Thomas Beyer
710747d00b RED-6411 - optimize method 2023-03-28 11:28:43 +02:00
Thomas Beyer
4e76c007b8 RED-6411 - rename testclass because of regexp 2023-03-28 10:41:37 +02:00
Thomas Beyer
6e5b64ca94 RED-6411 - fix import of configuration 2023-03-28 10:35:27 +02:00
Thomas Beyer
157b20a1de RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest 2023-03-28 10:16:17 +02:00
Thomas Beyer
7644afc3aa RED-6411 - extend logic when replacing entities with higher rank 2023-03-27 12:49:33 +02:00
deiflaender
f03523ca8f RED-6224: Multitenancy for rules cache 2023-03-27 09:37:48 +02:00
Thomas Beyer
459af9e33b RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine() 2023-03-27 09:05:13 +02:00
Viktor Seifert
3626dbd0a9 RED-5694: Imported new version of platform-dependency and fixed a couple of issues.
* Updated imports for some javax.* packages.
* Added improved config for annotation processors (not dependent on implementation details).
* Updated SectionText class to not use wildcard imports, since the cause problems for lombok + dsl-json.
2023-03-20 18:06:32 +01:00
deiflaender
339833e2d6 RED-6224: Fixed pr findings 2023-03-17 16:07:20 +01:00
deiflaender
ec0de5b6a2 RED-6224: Made dictionary cache multitenancy ready 2023-03-17 13:54:22 +01:00
Viktor Seifert
fe5121b1ed RED-6250: Switched to new metrics-commons version to not have to instantiate a factory (reduces code duplication) 2023-03-15 18:16:53 +01:00
Viktor Seifert
519bb9cb52 RED-6250: Changed function-timer metric to use code from metric commons 2023-03-15 16:40:04 +01:00
Timo Bejan
6c0886e2c4 Pull request #522: RED-6162 - bumped version
Merge in RED/redaction-service from RED-6162 to master

* commit '9f396cccdf4b6762904c12923c6ba278398869ca':
  RED-6162 - bumped version
2023-03-10 21:44:17 +01:00
deiflaender
c13d148ae7 RED-4645: Multitenancy for storage 2023-03-10 16:21:54 +01:00
Timo Bejan
9f396cccdf RED-6162 - bumped version 2023-03-10 15:58:29 +02:00
Timo Bejan
56f98549e4 RED-6182 - version bump 2023-03-10 08:46:34 +02:00