Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,180 Commits 109 Branches 2,256 Tags
Commit Graph

1180 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kilian Schuettler
a78a18fe6d RED-6009 - Document Tree Structure 
* moved NER Entity combination to drools
RED-6009-a78a1 		2023-05-03 16:01:46 +02:00
Kilian Schuettler
dce1f3b386 RED-6009 - Document Tree Structure 
* improved logging for performance monitoring
RED-6009_70 		2023-05-03 13:36:25 +02:00
Kilian Schuettler
d934aa9800 RED-6009 - Document Tree Structure 
* remove Add ManualRedactions handling
RED-6009-d934a 		2023-05-03 11:25:15 +02:00
Kilian Schuettler
1bcb43e50e RED-6009 - Document Tree Structure 
* fix Ner Adapter
RED-6009-1bcb4 		2023-05-03 02:33:23 +02:00
Kilian Schuettler
06c4162018 RED-6009 - Document Tree Structure 
* implement ManualRedactionEntry Handling
RED-6009-06c41 		2023-05-03 02:15:43 +02:00
Kilian Schuettler
8ec3c32a85 RED-6009 - Document Tree Structure 
* fix parse imageType
* fix getMatchedRule
* remove trailing separator from Ai Entities
RED-6009-8ec3c 		2023-05-02 20:15:16 +02:00
Kilian Schuettler
fe818b65d0 RED-6009 - Document Tree Structure 
* fix rebased tests
RED-6009-fe818b 		2023-05-02 19:20:52 +02:00
Kilian Schuettler
3ee3ba7e98 RED-6009 - Document Tree Structure 
* fix nullpointer, if empty entity falls on end of TextBlock
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
00bc0e98f8 RED-6009 - Document Tree Structure 
* image Type to lower case
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
9859eee503 RED-6009 - Document Tree Structure 
* fix NerEntities CBI_address combination
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
7f0699e3bf RED-6009 - Document Tree Structure 
* minor rule fix
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
2f3c941500 RED-6009 - Document Tree Structure 
* fix build
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
e0f911734f RED-6009: Document Tree Structure 
* fixed build
* slight refactor of AnnotationService
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
fe29e0ab3a RED-6009: Document Tree Structure 
* added a test for removing entities by ManualResizeRedaction in ReAnalysis
* Fixed Set logic when removing and readding a resized entity
* Refactored RedactionLog change computation
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
dad63f6276 RED-6009: Document Tree Structure 
* wired ManualRedactionApplicationService to Drools Container
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
61896cf898 RED-6009: Document Tree Structure 
* changed redactionLog Rectangle mapping to match UI
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
8e9700fca0 RED-6009: Document Tree Structure 
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
7ed5ba759e RED-6009: Document Tree Structure 
* optimized table access functions
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
4e5dc6aede RED-6009: Document Tree Structure 
* pmd fixes
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
8682b01861 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-05-02 17:46:46 +02:00
Kilian Schuettler
1f7caeebf6 RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-05-02 17:45:45 +02:00
Kilian Schuettler
86fe535460 RED-6009: Document Tree Structure 
* refactored package structure
 2023-05-02 17:45:44 +02:00
Kilian Schuettler
bda1cc4372 RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5603f3265e RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d978b2fb4a RED-6369: Rules Refactor 
* fix pmd errors
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
3e5c7dafc0 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5628db7a36 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
86b5059d77 RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
2278195318 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
f2dbc4447b RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
dcc2319a00 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
74a7e43367 RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
6f8242a55e RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d9c27d70d1 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
1fd483a6d4 RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
198fca16f6 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
72dc692685 RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d36ea08573 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5dd1b52873 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
6d31868f5d RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
416b6d403a RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-05-02 17:44:47 +02:00
deiflaender
3af26d3f0d RED-6093: Prototype document structurewip dependency upgrade 2023-05-02 17:44:47 +02:00
Kilian Schuettler
383bf8278e RED-6093: Prototype document structure 
wip
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
632a1646e3 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
56d7fa950c RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-05-02 17:44:47 +02:00
deiflaender
525b8d6434 RED-6093: Prototype find entities in rules 2023-05-02 17:44:44 +02:00
Thomas Beyer
4bf686a432 Pull request #532: RED-6619 1 
Merge in RED/redaction-service from RED-6619_1 to master

* commit 'aff7074b4012627a4e8b64b2f4a779b18feed50a':
  RED-6619 - renamed variables
  RED-6619 - reformat code
  RED-6619 - delete unnecessary import
  RED-6619 - moved not the logic to a boolean, but the 1 into a constant
  RED-6619 - fix integration-tests by adding versions and move the hasMinimumSize-logic into own boolea
  RED-6619 - added missing ' (typo)
  RED-6619 - add logic to ignore found table-cells with height or width < 1. Also: Fix the tests and add new segmentation-tests and 1 redaction-integration-test. Renamed the latter to fit maven regexp
  RED-6619 - add tests for table-extraction
RED-6619_5_2 RED-6619_5_3 		2023-05-02 10:54:30 +02:00
Thomas Beyer
aff7074b40 RED-6619 - renamed variables RED-6619_1_10 2023-04-28 16:54:16 +02:00
Thomas Beyer
2e37cd5669 RED-6619 - reformat code RED-6619_1_9 2023-04-28 12:32:11 +02:00
Thomas Beyer
794a160115 RED-6619 - delete unnecessary import RED-6619_1_8 2023-04-28 12:22:11 +02:00