Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,190 Commits 109 Branches 2,256 Tags
Commit Graph

1190 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kilian Schuettler
088a5cde1a RED-6009 - Document Tree Structure 
* fixed javadoc and delombok plugins
* removed unused classes
* refactored names
RED-6009-088a5 RED-6009_93 		2023-05-09 11:02:31 +02:00
Kilian Schuettler
c68c6f9ba9 RED-6009 - Document Tree Structure 
* updated rules to production syngenta rules
RED-6009-c68c6 RED-6009_89 		2023-05-05 14:40:37 +02:00
Kilian Schuettler
bdd0692df9 RED-6009 - Document Tree Structure 
* implemented table merging when no headers present
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
06df8bd47f RED-6009 - Document Tree Structure 
* removed ner entity validation due to poor performance
* filtered ner entities during reanalysis to improve performance
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
e193cc67d5 RED-6009 - Document Tree Structure 
* added logging for performance
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
826fce455f RED-6009 - Document Tree Structure 
* moved NER Entity combination to drools
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
2f63627b60 RED-6009 - Document Tree Structure 
* improved logging for performance monitoring
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
1a6e678b00 RED-6009 - Document Tree Structure 
* remove Add ManualRedactions handling
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
cd471a1547 RED-6009 - Document Tree Structure 
* fix Ner Adapter
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
746f789be1 RED-6009 - Document Tree Structure 
* implement ManualRedactionEntry Handling
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
3f5e6dae66 RED-6009 - Document Tree Structure 
* fix parse imageType
* fix getMatchedRule
* remove trailing separator from Ai Entities
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
fdfb4c4071 RED-6009 - Document Tree Structure 
* fix rebased tests
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
cdab1d6945 RED-6009 - Document Tree Structure 
* fix nullpointer, if empty entity falls on end of TextBlock
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
0d5ef87d3e RED-6009 - Document Tree Structure 
* image Type to lower case
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
37a3ee8d54 RED-6009 - Document Tree Structure 
* fix NerEntities CBI_address combination
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
f891e02935 RED-6009 - Document Tree Structure 
* minor rule fix
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
6d4326fb04 RED-6009 - Document Tree Structure 
* fix build
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
06163e1003 RED-6009: Document Tree Structure 
* fixed build
* slight refactor of AnnotationService
 2023-05-05 14:31:46 +02:00
Kilian Schuettler
5c4c8218f5 RED-6009: Document Tree Structure 
* added a test for removing entities by ManualResizeRedaction in ReAnalysis
* Fixed Set logic when removing and readding a resized entity
* Refactored RedactionLog change computation
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
22de0605d2 RED-6009: Document Tree Structure 
* wired ManualRedactionApplicationService to Drools Container
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3ce08a34a6 RED-6009: Document Tree Structure 
* changed redactionLog Rectangle mapping to match UI
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
2f9b023bb4 RED-6009: Document Tree Structure 
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c7b08410e1 RED-6009: Document Tree Structure 
* optimized table access functions
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
57799c5f46 RED-6009: Document Tree Structure 
* pmd fixes
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8b7365c947 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c0aac985c1 RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
1c0f7e308b RED-6009: Document Tree Structure 
* refactored package structure
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9c48d36b05 RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8bbaa4c140 RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3e7081a87a RED-6369: Rules Refactor 
* fix pmd errors
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c009790336 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
09525f9b35 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
282ee7652d RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
aa86e94f70 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9d8e544d0c RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
59827eab81 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
ea0181d50f RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
6402151311 RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
d804f0d0a2 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
b6307759fb RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
253e544724 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
d04a576397 RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
33d47e5202 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
dc76e581c4 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
f3bfe95ea7 RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
53fa4f2851 RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-05-05 14:31:01 +02:00
deiflaender
64c54e73fb RED-6093: Prototype document structurewip dependency upgrade 2023-05-05 14:31:01 +02:00
Kilian Schuettler
7c024a579c RED-6093: Prototype document structure 
wip
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3aa2f84f08 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
18dc68714b RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-05-05 14:31:01 +02:00