Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,203 Commits 109 Branches 2,256 Tags
Commit Graph

1203 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kilian Schuettler
c8ee4444c2 RED-6009: Document Tree Structure 
* extracted classification to enum
* extracted approxLineCount as constant
* removed NodeType from Entry in DocumentTree
* renamed a variable
RED-6009_125 		2023-05-22 11:32:03 +02:00
Kilian Schuettler
1dd55d9af6 RED-6009: Document Tree Structure 
* added method getNodeType() to SemanticNodes
* moved DocumentDataMapper to constructors
* moved a few other methods to named constructors
* other minor refactors
RED-6009_122 		2023-05-17 13:12:43 +02:00
Kilian Schuettler
4ff73100af RED-6009: Document Tree Structure 
* fixed boundary intersect
 2023-05-16 16:10:29 +02:00
Kilian Schuettler
a7896148df RED-6009: Document Tree Structure 
* remove instanceof as much as possible
* refactor access levels
RED-6009-a7896 		2023-05-16 14:51:05 +02:00
Kilian Schuettler
926d507583 RED-6009: Document Tree Structure 
* ignore wrong pmd vioaltions
 2023-05-16 14:18:32 +02:00
Kilian Schuettler
0dc17d86bd RED-6009: Document Tree Structure 
* refactored data mapper classes
* refactored graph construction to remove the possibility of adding anythingbut table cells underneath a table node
 2023-05-16 14:07:49 +02:00
Kilian Schuettler
8ec88869e2 RED-6009 - Document Tree Structure 
* remove unused code
RED-6009_112 		2023-05-12 14:27:10 +02:00
Kilian Schuettler
643e2e81d4 RED-6009 - Document Tree Structure 
* added gaps in Redaction Positions, if they are farther than five character widths apart
RED-6009_111 		2023-05-10 16:45:23 +02:00
Kilian Schuettler
ce0a65c06a RED-6009 - Document Tree Structure 
* refactored Visualization Class
RED-6009_107 		2023-05-10 10:41:59 +02:00
Kilian Schuettler
f0144799c5 RED-6009 - Document Tree Structure 
* fixed rules to include vertebrate study flags
RED-6009_106 		2023-05-09 17:20:33 +02:00
Kilian Schuettler
0443e21858 RED-6009 - Document Tree Structure 
* added more javadoc
* fixed build
RED-6009-0443e 		2023-05-09 16:50:52 +02:00
Kilian Schuettler
c151b4a94b RED-6009 - Document Tree Structure 
* renamed terminal to leaf
RED-6009-c151b RED-6009_101 		2023-05-09 14:32:53 +02:00
Kilian Schuettler
e31a7b1a2f RED-6009 - Document Tree Structure 
* added more javadoc
RED-6009_100 		2023-05-09 14:12:12 +02:00
Kilian Schuettler
088a5cde1a RED-6009 - Document Tree Structure 
* fixed javadoc and delombok plugins
* removed unused classes
* refactored names
RED-6009-088a5 RED-6009_93 		2023-05-09 11:02:31 +02:00
Kilian Schuettler
c68c6f9ba9 RED-6009 - Document Tree Structure 
* updated rules to production syngenta rules
RED-6009-c68c6 RED-6009_89 		2023-05-05 14:40:37 +02:00
Kilian Schuettler
bdd0692df9 RED-6009 - Document Tree Structure 
* implemented table merging when no headers present
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
06df8bd47f RED-6009 - Document Tree Structure 
* removed ner entity validation due to poor performance
* filtered ner entities during reanalysis to improve performance
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
e193cc67d5 RED-6009 - Document Tree Structure 
* added logging for performance
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
826fce455f RED-6009 - Document Tree Structure 
* moved NER Entity combination to drools
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
2f63627b60 RED-6009 - Document Tree Structure 
* improved logging for performance monitoring
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
1a6e678b00 RED-6009 - Document Tree Structure 
* remove Add ManualRedactions handling
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
cd471a1547 RED-6009 - Document Tree Structure 
* fix Ner Adapter
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
746f789be1 RED-6009 - Document Tree Structure 
* implement ManualRedactionEntry Handling
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
3f5e6dae66 RED-6009 - Document Tree Structure 
* fix parse imageType
* fix getMatchedRule
* remove trailing separator from Ai Entities
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
fdfb4c4071 RED-6009 - Document Tree Structure 
* fix rebased tests
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
cdab1d6945 RED-6009 - Document Tree Structure 
* fix nullpointer, if empty entity falls on end of TextBlock
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
0d5ef87d3e RED-6009 - Document Tree Structure 
* image Type to lower case
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
37a3ee8d54 RED-6009 - Document Tree Structure 
* fix NerEntities CBI_address combination
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
f891e02935 RED-6009 - Document Tree Structure 
* minor rule fix
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
6d4326fb04 RED-6009 - Document Tree Structure 
* fix build
 2023-05-05 14:31:48 +02:00
Kilian Schuettler
06163e1003 RED-6009: Document Tree Structure 
* fixed build
* slight refactor of AnnotationService
 2023-05-05 14:31:46 +02:00
Kilian Schuettler
5c4c8218f5 RED-6009: Document Tree Structure 
* added a test for removing entities by ManualResizeRedaction in ReAnalysis
* Fixed Set logic when removing and readding a resized entity
* Refactored RedactionLog change computation
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
22de0605d2 RED-6009: Document Tree Structure 
* wired ManualRedactionApplicationService to Drools Container
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3ce08a34a6 RED-6009: Document Tree Structure 
* changed redactionLog Rectangle mapping to match UI
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
2f9b023bb4 RED-6009: Document Tree Structure 
* mapped pages back into ImageNodes in the graphMapper
* fixed path in the noExceptionShouldBeThrownForAnyFilesTest
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c7b08410e1 RED-6009: Document Tree Structure 
* optimized table access functions
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
57799c5f46 RED-6009: Document Tree Structure 
* pmd fixes
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8b7365c947 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c0aac985c1 RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
1c0f7e308b RED-6009: Document Tree Structure 
* refactored package structure
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9c48d36b05 RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
8bbaa4c140 RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
3e7081a87a RED-6369: Rules Refactor 
* fix pmd errors
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
c009790336 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
09525f9b35 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
282ee7652d RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
aa86e94f70 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
9d8e544d0c RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
59827eab81 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-05-05 14:31:01 +02:00
Kilian Schuettler
ea0181d50f RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-05-05 14:31:01 +02:00