Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,163 Commits 109 Branches 2,256 Tags
Commit Graph

714 Commits

Author SHA1 Message Date
Kilian Schuettler
7ed5ba759e RED-6009: Document Tree Structure 
* optimized table access functions
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
4e5dc6aede RED-6009: Document Tree Structure 
* pmd fixes
 2023-05-02 17:46:48 +02:00
Kilian Schuettler
8682b01861 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-05-02 17:46:46 +02:00
Kilian Schuettler
1f7caeebf6 RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-05-02 17:45:45 +02:00
Kilian Schuettler
86fe535460 RED-6009: Document Tree Structure 
* refactored package structure
 2023-05-02 17:45:44 +02:00
Kilian Schuettler
bda1cc4372 RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5603f3265e RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d978b2fb4a RED-6369: Rules Refactor 
* fix pmd errors
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
3e5c7dafc0 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5628db7a36 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
86b5059d77 RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
2278195318 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
f2dbc4447b RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
dcc2319a00 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
74a7e43367 RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
6f8242a55e RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d9c27d70d1 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
1fd483a6d4 RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
198fca16f6 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
72dc692685 RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
d36ea08573 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
5dd1b52873 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
6d31868f5d RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
416b6d403a RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-05-02 17:44:47 +02:00
deiflaender
3af26d3f0d RED-6093: Prototype document structurewip dependency upgrade 2023-05-02 17:44:47 +02:00
Kilian Schuettler
383bf8278e RED-6093: Prototype document structure 
wip
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
632a1646e3 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-05-02 17:44:47 +02:00
Kilian Schuettler
56d7fa950c RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-05-02 17:44:47 +02:00
deiflaender
525b8d6434 RED-6093: Prototype find entities in rules 2023-05-02 17:44:44 +02:00
Thomas Beyer
aff7074b40 RED-6619 - renamed variables 2023-04-28 16:54:16 +02:00
Thomas Beyer
2e37cd5669 RED-6619 - reformat code 2023-04-28 12:32:11 +02:00
Thomas Beyer
794a160115 RED-6619 - delete unnecessary import 2023-04-28 12:22:11 +02:00
Thomas Beyer
e2d3972e16 RED-6619 - moved not the logic to a boolean, but the 1 into a constant 2023-04-28 12:19:14 +02:00
Thomas Beyer
4a76e89ab8 RED-6619 - fix integration-tests by adding versions and move the hasMinimumSize-logic into own boolea 2023-04-28 12:13:54 +02:00
Thomas Beyer
fcc4085321 RED-6619 - added missing ' (typo) 2023-04-27 17:52:03 +02:00
Thomas Beyer
8490690001 RED-6619 - add logic to ignore found table-cells with height or width < 1. 
Also: Fix the tests and add new segmentation-tests and 1 redaction-integration-test. Renamed the latter to fit maven regexp
 2023-04-27 17:49:36 +02:00
Thomas Beyer
6f783a9f00 RED-6619 - add tests for table-extraction 2023-04-27 14:04:22 +02:00
devplant
9a933e9563 RED-5694 - Upgrade spring-boot to 3.0 
- import storageAutoConfiguration to Application
 2023-04-20 13:03:39 +03:00
devplant
7d4b3f40d3 RED-5694 - Upgrade spring-boot to 3.0 
- exclude storageAutoConfiguration with @ComponentScan
 2023-04-05 14:09:02 +03:00
devplant
d366d9207a RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:48:28 +03:00
devplant
e22e16aef1 RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:43:45 +03:00
devplant
077677e02d RED-5694 - Upgrade spring-boot to 3.0 
- update exclusion of StorageAutoConfiguration
 2023-04-05 13:22:17 +03:00
devplant
09de0dc2c6 RED-5694 - Upgrade spring-boot to 3.0 
- update after the merge of master
 2023-04-05 12:06:12 +03:00
devplant
c3b29e4ebc Merge branch 'master' of https://git.iqser.com/scm/red/redaction-service into RED-5694 
# Conflicts:
#	redaction-service-v1/redaction-service-server-v1/src/test/java/com/iqser/red/service/redaction/v1/server/RedactionIntegrationTest.java
 2023-04-05 11:37:33 +03:00
devplant
adcf17c5f0 RED-5694 - Upgrade spring-boot to 3.0 
- update platfrom-dependency and other dependencies with latest versions
- remove dslplatform dependency
 2023-04-05 10:58:18 +03:00
Thomas Beyer
49860ab95d Pull request #528: RED-6411 4.5.0 1 
Merge in RED/redaction-service from RED-6411_4.5.0_1 to master

* commit '2a56187294c125931d4b998ee1f812ea426e2b58':
  RED-6411 - optimize code
  RED-6411 - optimize method
  RED-6411 - rename testclass because of regexp
  RED-6411 - fix import of configuration
  RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest
  RED-6411 - extend logic when replacing entities with higher rank
  RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine()
 2023-03-29 15:03:13 +02:00
Thomas Beyer
2a56187294 RED-6411 - optimize code 2023-03-29 09:35:55 +02:00
Thomas Beyer
710747d00b RED-6411 - optimize method 2023-03-28 11:28:43 +02:00
Thomas Beyer
4e76c007b8 RED-6411 - rename testclass because of regexp 2023-03-28 10:41:37 +02:00
Thomas Beyer
6e5b64ca94 RED-6411 - fix import of configuration 2023-03-28 10:35:27 +02:00