Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,181 Commits 109 Branches 2,256 Tags
Commit Graph

1181 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kilian Schuettler
746f789be1 RED-6009 - Document Tree Structure 
* implement ManualRedactionEntry Handling
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
3f5e6dae66 RED-6009 - Document Tree Structure 
* fix parse imageType
* fix getMatchedRule
* remove trailing separator from Ai Entities
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
fdfb4c4071 RED-6009 - Document Tree Structure 
* fix rebased tests
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
cdab1d6945 RED-6009 - Document Tree Structure 
* fix nullpointer, if empty entity falls on end of TextBlock
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
0d5ef87d3e RED-6009 - Document Tree Structure 
* image Type to lower case
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
37a3ee8d54 RED-6009 - Document Tree Structure 
* fix NerEntities CBI_address combination
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
f891e02935 RED-6009 - Document Tree Structure 
* minor rule fix
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
6d4326fb04 RED-6009 - Document Tree Structure 
* fix build
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
06163e1003 RED-6009: Document Tree Structure 
* fixed build
* slight refactor of AnnotationService
 2023-05-05 14:31:46 +02:00
Kilian Schuettler
5c4c8218f5 RED-6009: Document Tree Structure 
* added a test for removing entities by ManualResizeRedaction in ReAnalysis
* Fixed Set logic when removing and readding a resized entity
* Refactored RedactionLog change computation
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
22de0605d2 RED-6009: Document Tree Structure 
* wired ManualRedactionApplicationService to Drools Container
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3ce08a34a6 RED-6009: Document Tree Structure 
* changed redactionLog Rectangle mapping to match UI
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
2f9b023bb4 RED-6009: Document Tree Structure 
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c7b08410e1 RED-6009: Document Tree Structure 
* optimized table access functions
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
57799c5f46 RED-6009: Document Tree Structure 
* pmd fixes
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8b7365c947 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c0aac985c1 RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
1c0f7e308b RED-6009: Document Tree Structure 
* refactored package structure
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9c48d36b05 RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8bbaa4c140 RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3e7081a87a RED-6369: Rules Refactor 
* fix pmd errors
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c009790336 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
09525f9b35 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
282ee7652d RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
aa86e94f70 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9d8e544d0c RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
59827eab81 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
ea0181d50f RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
6402151311 RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
d804f0d0a2 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
b6307759fb RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
253e544724 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
d04a576397 RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
33d47e5202 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
dc76e581c4 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
f3bfe95ea7 RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
53fa4f2851 RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-05-05 14:31:01 +02:00
deiflaender
64c54e73fb RED-6093: Prototype document structurewip dependency upgrade 2023-05-05 14:31:01 +02:00
Kilian Schuettler
7c024a579c RED-6093: Prototype document structure 
wip
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3aa2f84f08 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
18dc68714b RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-05-05 14:31:01 +02:00
deiflaender
c4017e8e5e RED-6093: Prototype find entities in rules 2023-05-05 14:31:01 +02:00
Thomas Beyer
a6be7c9cfd Pull request #534: RED-6619 5 
Merge in RED/redaction-service from RED-6619_5 to master

* commit 'f574b414c471cb6f349a5fd44a1ad337c77521ac':
  RED-6619 - change pom to fforesight again
  RED-6619 - revert changes in pom
  RED-6619 - change from iqser to knecon
  RED-6619 - change nexus-url from iqser to knecon
4.11.0 RED-6744_2 		2023-05-03 09:43:35 +02:00
Thomas Beyer
f574b414c4 RED-6619 - change pom to fforesight again RED-6619_5_13 dev_tmptest11 2023-05-03 08:55:42 +02:00
Thomas Beyer
a427e676f7 RED-6619 - revert changes in pom RED-6619_5_10 2023-05-02 16:41:55 +02:00
Thomas Beyer
a8dd0ccd47 RED-6619 - change from iqser to knecon RED-6619_5_8 2023-05-02 15:51:28 +02:00
Thomas Beyer
fca35c97ca RED-6619 - change nexus-url from iqser to knecon RED-6619_5_5 2023-05-02 15:10:09 +02:00
Thomas Beyer
4bf686a432 Pull request #532: RED-6619 1 
Merge in RED/redaction-service from RED-6619_1 to master

* commit 'aff7074b4012627a4e8b64b2f4a779b18feed50a':
  RED-6619 - renamed variables
  RED-6619 - reformat code
  RED-6619 - delete unnecessary import
  RED-6619 - moved not the logic to a boolean, but the 1 into a constant
  RED-6619 - fix integration-tests by adding versions and move the hasMinimumSize-logic into own boolea
  RED-6619 - added missing ' (typo)
  RED-6619 - add logic to ignore found table-cells with height or width < 1. Also: Fix the tests and add new segmentation-tests and 1 redaction-integration-test. Renamed the latter to fit maven regexp
  RED-6619 - add tests for table-extraction
RED-6619_5_2 RED-6619_5_3 		2023-05-02 10:54:30 +02:00
Thomas Beyer
aff7074b40 RED-6619 - renamed variables RED-6619_1_10 2023-04-28 16:54:16 +02:00
Thomas Beyer
2e37cd5669 RED-6619 - reformat code RED-6619_1_9 2023-04-28 12:32:11 +02:00