Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,160 Commits 109 Branches 2,256 Tags
Commit Graph

711 Commits

Author SHA1 Message Date
Kilian Schuettler
6423e3595c RED-6009: Document Tree Structure 
* fixed build
* slight refactor of AnnotationService
 2023-04-28 13:53:02 +02:00
Kilian Schuettler
808e0f1e86 RED-6009: Document Tree Structure 
* added a test for removing entities by ManualResizeRedaction in ReAnalysis
* Fixed Set logic when removing and readding a resized entity
* Refactored RedactionLog change computation
 2023-04-28 12:38:24 +02:00
Kilian Schuettler
94e5203d8a RED-6009: Document Tree Structure 
* wired ManualRedactionApplicationService to Drools Container
 2023-04-27 15:51:26 +02:00
Kilian Schuettler
69c4006a87 RED-6009: Document Tree Structure 
* changed redactionLog Rectangle mapping to match UI
 2023-04-27 12:59:56 +02:00
Kilian Schuettler
30b4ec59ba RED-6009: Document Tree Structure 
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
 2023-04-27 11:56:00 +02:00
Kilian Schuettler
560ac1080b RED-6009: Document Tree Structure 
* optimized table access functions
 2023-04-26 20:06:58 +02:00
Kilian Schuettler
0caa6f571d RED-6009: Document Tree Structure 
* pmd fixes
 2023-04-26 19:34:05 +02:00
Kilian Schuettler
f0d733c338 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-04-26 19:20:12 +02:00
Kilian Schuettler
0ee5aff9cf RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-04-25 17:33:57 +02:00
Kilian Schuettler
135b43fe95 RED-6009: Document Tree Structure 
* refactored package structure
 2023-04-21 10:54:33 +02:00
Kilian Schuettler
45576c858b RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
b193f90a59 RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
c2fa9ece18 RED-6369: Rules Refactor 
* fix pmd errors
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
1c660a7cc1 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-04-21 09:55:45 +02:00
Kilian Schuettler
26cff4a9a3 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-04-21 09:55:30 +02:00
Kilian Schuettler
7a52aaa1a1 RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-04-21 09:55:29 +02:00
Kilian Schuettler
8f951ae3b9 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-04-21 09:55:11 +02:00
Kilian Schuettler
91e50e495b RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-04-21 09:54:43 +02:00
Kilian Schuettler
b94fd25158 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-04-21 09:52:54 +02:00
Kilian Schuettler
482368b651 RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-04-21 09:52:53 +02:00
Kilian Schuettler
b9d93e44bd RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
78e74fec11 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7325bad5f7 RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
3ac84e5135 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7c2feddceb RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
340869b3c9 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7a529d5a88 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
f8fe88dc3c RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
ba26cfb4ac RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-04-21 09:50:33 +02:00
deiflaender
d0db04f3e9 RED-6093: Prototype document structurewip dependency upgrade 2023-04-21 09:50:33 +02:00
Kilian Schuettler
0afc77911d RED-6093: Prototype document structure 
wip
 2023-04-21 09:50:30 +02:00
Kilian Schuettler
55d82cd344 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-04-21 09:49:58 +02:00
Kilian Schuettler
212162b9f9 RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-04-21 09:45:30 +02:00
deiflaender
a1c5be1e3e RED-6093: Prototype find entities in rules 2023-04-21 09:43:40 +02:00
devplant
9a933e9563 RED-5694 - Upgrade spring-boot to 3.0 
- import storageAutoConfiguration to Application
 2023-04-20 13:03:39 +03:00
devplant
7d4b3f40d3 RED-5694 - Upgrade spring-boot to 3.0 
- exclude storageAutoConfiguration with @ComponentScan
 2023-04-05 14:09:02 +03:00
devplant
d366d9207a RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:48:28 +03:00
devplant
e22e16aef1 RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:43:45 +03:00
devplant
077677e02d RED-5694 - Upgrade spring-boot to 3.0 
- update exclusion of StorageAutoConfiguration
 2023-04-05 13:22:17 +03:00
devplant
09de0dc2c6 RED-5694 - Upgrade spring-boot to 3.0 
- update after the merge of master
 2023-04-05 12:06:12 +03:00
devplant
c3b29e4ebc Merge branch 'master' of https://git.iqser.com/scm/red/redaction-service into RED-5694 
# Conflicts:
#	redaction-service-v1/redaction-service-server-v1/src/test/java/com/iqser/red/service/redaction/v1/server/RedactionIntegrationTest.java
 2023-04-05 11:37:33 +03:00
devplant
adcf17c5f0 RED-5694 - Upgrade spring-boot to 3.0 
- update platfrom-dependency and other dependencies with latest versions
- remove dslplatform dependency
 2023-04-05 10:58:18 +03:00
Thomas Beyer
49860ab95d Pull request #528: RED-6411 4.5.0 1 
Merge in RED/redaction-service from RED-6411_4.5.0_1 to master

* commit '2a56187294c125931d4b998ee1f812ea426e2b58':
  RED-6411 - optimize code
  RED-6411 - optimize method
  RED-6411 - rename testclass because of regexp
  RED-6411 - fix import of configuration
  RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest
  RED-6411 - extend logic when replacing entities with higher rank
  RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine()
 2023-03-29 15:03:13 +02:00
Thomas Beyer
2a56187294 RED-6411 - optimize code 2023-03-29 09:35:55 +02:00
Thomas Beyer
710747d00b RED-6411 - optimize method 2023-03-28 11:28:43 +02:00
Thomas Beyer
4e76c007b8 RED-6411 - rename testclass because of regexp 2023-03-28 10:41:37 +02:00
Thomas Beyer
6e5b64ca94 RED-6411 - fix import of configuration 2023-03-28 10:35:27 +02:00
Thomas Beyer
157b20a1de RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest 2023-03-28 10:16:17 +02:00
Thomas Beyer
7644afc3aa RED-6411 - extend logic when replacing entities with higher rank 2023-03-27 12:49:33 +02:00
deiflaender
f03523ca8f RED-6224: Multitenancy for rules cache 2023-03-27 09:37:48 +02:00