1157 Commits

Author SHA1 Message Date
Kilian Schuettler
94e5203d8a RED-6009: Document Tree Structure
* wired ManualRedactionApplicationService to Drools Container
RED-6009-94e52 RED-6009_20
2023-04-27 15:51:26 +02:00
Kilian Schuettler
69c4006a87 RED-6009: Document Tree Structure
* changed redactionLog Rectangle mapping to match UI
RED-6009-69c40 RED-6009_18
2023-04-27 12:59:56 +02:00
Kilian Schuettler
30b4ec59ba RED-6009: Document Tree Structure
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
RED-6009-30b4e
2023-04-27 11:56:00 +02:00
Kilian Schuettler
560ac1080b RED-6009: Document Tree Structure
* optimized table access functions
RED-6009-560ac RED-6009_11
2023-04-26 20:06:58 +02:00
Kilian Schuettler
0caa6f571d RED-6009: Document Tree Structure
* pmd fixes
RED-6009-0caa6f RED-6009_9
2023-04-26 19:34:05 +02:00
Kilian Schuettler
f0d733c338 RED-6009: Document Tree Structure
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
2023-04-26 19:20:12 +02:00
Kilian Schuettler
0ee5aff9cf RED-6009: Document Tree Structure
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
2023-04-25 17:33:57 +02:00
Kilian Schuettler
135b43fe95 RED-6009: Document Tree Structure
* refactored package structure
2023-04-21 10:54:33 +02:00
Kilian Schuettler
45576c858b RED-6369: Rules Refactor
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
2023-04-21 09:55:47 +02:00
Kilian Schuettler
b193f90a59 RED-6369: Rules Refactor
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
2023-04-21 09:55:47 +02:00
Kilian Schuettler
c2fa9ece18 RED-6369: Rules Refactor
* fix pmd errors
2023-04-21 09:55:47 +02:00
Kilian Schuettler
1c660a7cc1 RED-6369: Rules Refactor
* fixed builkd by disabling failing tests
2023-04-21 09:55:45 +02:00
Kilian Schuettler
26cff4a9a3 RED-6369: Rules Refactor
*removed manualredaction handling for further analysis of how it actually works
2023-04-21 09:55:30 +02:00
Kilian Schuettler
7a52aaa1a1 RED-6369: Rules Refactor
* marked entities as resized if a resizeRedaction with same id exists
2023-04-21 09:55:29 +02:00
Kilian Schuettler
8f951ae3b9 RED-6369: Rules Refactor
* refactored documentGraph.tableOfContents to include document as root
2023-04-21 09:55:11 +02:00
Kilian Schuettler
91e50e495b RED-6369: Rules Refactor
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
2023-04-21 09:54:43 +02:00
Kilian Schuettler
b94fd25158 RED-6369: Rules Refactor
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
2023-04-21 09:52:54 +02:00
Kilian Schuettler
482368b651 RED-6369: Rules Refactor
*added betweenStrings to entityCreationService
2023-04-21 09:52:53 +02:00
Kilian Schuettler
b9d93e44bd RED-6369: Rules Refactor
*some refactors
*some comment cleanup
2023-04-21 09:50:33 +02:00
Kilian Schuettler
78e74fec11 RED-6369: Rules Refactor
*fixed DocumentData Mapping
2023-04-21 09:50:33 +02:00
Kilian Schuettler
7325bad5f7 RED-6369: Rules Refactor
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
2023-04-21 09:50:33 +02:00
Kilian Schuettler
3ac84e5135 RED-6368: Include Tables and Images into Prototype Document Structure
*started Implementation of new rules
2023-04-21 09:50:33 +02:00
Kilian Schuettler
7c2feddceb RED-6368: Include Tables and Images into Prototype Document Structure
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
2023-04-21 09:50:33 +02:00
Kilian Schuettler
340869b3c9 RED-6368: Include Tables and Images into Prototype Document Structure
*added some starting rules
2023-04-21 09:50:33 +02:00
Kilian Schuettler
7a529d5a88 RED-6368: Include Tables and Images into Prototype Document Structure
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
2023-04-21 09:50:33 +02:00
Kilian Schuettler
f8fe88dc3c RED-6093: Prototype document structure
*refactored File Structure
*started refactor of original rules
2023-04-21 09:50:33 +02:00
Kilian Schuettler
ba26cfb4ac RED-6093: Prototype document structure
*refactored Nodes
*added some tests
*wip
2023-04-21 09:50:33 +02:00
deiflaender
d0db04f3e9 RED-6093: Prototype document structurewip dependency upgrade 2023-04-21 09:50:33 +02:00
Kilian Schuettler
0afc77911d RED-6093: Prototype document structure
wip
2023-04-21 09:50:30 +02:00
Kilian Schuettler
55d82cd344 RED-6093: Prototype find entities in rules
*added improved string to text position mapping
2023-04-21 09:49:58 +02:00
Kilian Schuettler
212162b9f9 RED-6093: Prototype find entities in rules
*added a prototype paragraph rule
2023-04-21 09:45:30 +02:00
deiflaender
a1c5be1e3e RED-6093: Prototype find entities in rules 2023-04-21 09:43:40 +02:00
Corina Olariu
2646407805 Pull request #531: RED-5694 - Upgrade spring-boot to 3.0
Merge in RED/redaction-service from RED-5694-storage to master

* commit '9a933e9563769dbbc38756151ef7d33fde859194':
  RED-5694 - Upgrade spring-boot to 3.0 - import storageAutoConfiguration to Application
4.10.0 RED-6368_23 RED-6619_1_2
2023-04-21 07:21:48 +02:00
devplant
9a933e9563 RED-5694 - Upgrade spring-boot to 3.0
- import storageAutoConfiguration to Application
RED-5694-storage_3
2023-04-20 13:03:39 +03:00
Corina Olariu
999973a00f Pull request #530: RED-5694
Merge in RED/redaction-service from RED-5694 to master

* commit '7d4b3f40d3a09493459d6f71e53275fc1da7adad':
  RED-5694 - Upgrade spring-boot to 3.0 - exclude storageAutoConfiguration with @ComponentScan
  RED-5694 - Upgrade spring-boot to 3.0 - remove comment code
  RED-5694 - Upgrade spring-boot to 3.0 - remove comment code
  RED-5694 - Upgrade spring-boot to 3.0 - update exclusion of StorageAutoConfiguration
  RED-5694 - Upgrade spring-boot to 3.0 - update after the merge of master
  RED-5694 - Upgrade spring-boot to 3.0 - update platfrom-dependency and other dependencies with latest versions - remove dslplatform dependency
  RED-5694: Imported new version of platform-dependency and fixed a couple of issues.
4.9.0 RED-5694-storage_2
2023-04-05 13:48:04 +02:00
devplant
7d4b3f40d3 RED-5694 - Upgrade spring-boot to 3.0
- exclude storageAutoConfiguration with @ComponentScan
RED-5694_10
2023-04-05 14:09:02 +03:00
devplant
d366d9207a RED-5694 - Upgrade spring-boot to 3.0
- remove comment code
2023-04-05 13:48:28 +03:00
devplant
e22e16aef1 RED-5694 - Upgrade spring-boot to 3.0
- remove comment code
2023-04-05 13:43:45 +03:00
devplant
077677e02d RED-5694 - Upgrade spring-boot to 3.0
- update exclusion of StorageAutoConfiguration
2023-04-05 13:22:17 +03:00
devplant
09de0dc2c6 RED-5694 - Upgrade spring-boot to 3.0
- update after the merge of master
2023-04-05 12:06:12 +03:00
devplant
c3b29e4ebc Merge branch 'master' of https://git.iqser.com/scm/red/redaction-service into RED-5694
# Conflicts:
#	redaction-service-v1/redaction-service-server-v1/src/test/java/com/iqser/red/service/redaction/v1/server/RedactionIntegrationTest.java
2023-04-05 11:37:33 +03:00
devplant
adcf17c5f0 RED-5694 - Upgrade spring-boot to 3.0
- update platfrom-dependency and other dependencies with latest versions
- remove dslplatform dependency
RED-5694_1 RED-5694_3
2023-04-05 10:58:18 +03:00
Thomas Beyer
49860ab95d Pull request #528: RED-6411 4.5.0 1
Merge in RED/redaction-service from RED-6411_4.5.0_1 to master

* commit '2a56187294c125931d4b998ee1f812ea426e2b58':
  RED-6411 - optimize code
  RED-6411 - optimize method
  RED-6411 - rename testclass because of regexp
  RED-6411 - fix import of configuration
  RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest
  RED-6411 - extend logic when replacing entities with higher rank
  RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine()
4.8.0
2023-03-29 15:03:13 +02:00
Thomas Beyer
2a56187294 RED-6411 - optimize code RED-6411_4.5.0_1_12 2023-03-29 09:35:55 +02:00
Thomas Beyer
710747d00b RED-6411 - optimize method RED-6411_4.5.0_1_11 2023-03-28 11:28:43 +02:00
Thomas Beyer
4e76c007b8 RED-6411 - rename testclass because of regexp RED-6411_4.5.0_1_10 2023-03-28 10:41:37 +02:00
Thomas Beyer
6e5b64ca94 RED-6411 - fix import of configuration RED-6411_4.5.0_1_9 2023-03-28 10:35:27 +02:00
Thomas Beyer
157b20a1de RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest RED-6411_4.5.0_1_7 RED-6411_4.5.0_1_8 2023-03-28 10:16:17 +02:00
Thomas Beyer
7644afc3aa RED-6411 - extend logic when replacing entities with higher rank RED-6411_4.5.0_1_5 dev_red6411_7644a 2023-03-27 12:49:33 +02:00
Dominique Eiflaender
89e09f780d Pull request #525: RED-6224: Multitenancy for rules cache
Merge in RED/redaction-service from RED-6224 to master

* commit 'f03523ca8f49767b22d551023866dc9948c06e9f':
  RED-6224: Multitenancy for rules cache
4.6.0 4.7.0
2023-03-27 09:44:46 +02:00