Marmelator/redaction-service
1
0
Fork 0
Code Issues Pull Requests 14 Actions Packages Projects Releases 622 Wiki Activity
1,153 Commits 109 Branches 2,256 Tags
Commit Graph

705 Commits

Author SHA1 Message Date
Kilian Schuettler
0caa6f571d RED-6009: Document Tree Structure 
* pmd fixes
 2023-04-26 19:34:05 +02:00
Kilian Schuettler
f0d733c338 RED-6009: Document Tree Structure 
* added a TableFactory to refactor DocumentGraphFactory
* updated all enabled tests to run with new structure
* moved PdfTableCells to classification package
 2023-04-26 19:20:12 +02:00
Kilian Schuettler
0ee5aff9cf RED-6009: Document Tree Structure 
*renamed old TextBlock and Table Classes
*added subsections to enable separate rules for tables and text-only sections
*added ManualRedaction Tests
*finished default rules
 2023-04-25 17:33:57 +02:00
Kilian Schuettler
135b43fe95 RED-6009: Document Tree Structure 
* refactored package structure
 2023-04-21 10:54:33 +02:00
Kilian Schuettler
45576c858b RED-6369: Rules Refactor 
* minor renaming
* added NerEntityAdapter to include the Ner Entities
* moved combine logic outside of rules
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
b193f90a59 RED-6369: Rules Refactor 
* added id to ImageNode
* added Manual Redaction Handling to Rules
* minor rename
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
c2fa9ece18 RED-6369: Rules Refactor 
* fix pmd errors
 2023-04-21 09:55:47 +02:00
Kilian Schuettler
1c660a7cc1 RED-6369: Rules Refactor 
* fixed builkd by disabling failing tests
 2023-04-21 09:55:45 +02:00
Kilian Schuettler
26cff4a9a3 RED-6369: Rules Refactor 
*removed manualredaction handling for further analysis of how it actually works
 2023-04-21 09:55:30 +02:00
Kilian Schuettler
7a52aaa1a1 RED-6369: Rules Refactor 
* marked entities as resized if a resizeRedaction with same id exists
 2023-04-21 09:55:29 +02:00
Kilian Schuettler
8f951ae3b9 RED-6369: Rules Refactor 
* refactored documentGraph.tableOfContents to include document as root
 2023-04-21 09:55:11 +02:00
Kilian Schuettler
91e50e495b RED-6369: Rules Refactor 
* fixed AnnotationService with new Coordinates
* fixed bug in split boundary function
 2023-04-21 09:54:43 +02:00
Kilian Schuettler
b94fd25158 RED-6369: Rules Refactor 
* refactored DocumentData to 4 different jsons to make reading only text possible
* wip integration of new rules into workflow
 2023-04-21 09:52:54 +02:00
Kilian Schuettler
482368b651 RED-6369: Rules Refactor 
*added betweenStrings to entityCreationService
 2023-04-21 09:52:53 +02:00
Kilian Schuettler
b9d93e44bd RED-6369: Rules Refactor 
*some refactors
*some comment cleanup
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
78e74fec11 RED-6369: Rules Refactor 
*fixed DocumentData Mapping
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7325bad5f7 RED-6369: Rules Refactor 
*added some new Rules and Methods to support them
*integrated local dictionary searches into ruleflow using agenda-groups
*Generalized methods to be able to execute on any SemanticNode
*made Documentgraph implement SemanticNode
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
3ac84e5135 RED-6368: Include Tables and Images into Prototype Document Structure 
*started Implementation of new rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7c2feddceb RED-6368: Include Tables and Images into Prototype Document Structure 
*rebased to master and included tenant capabilities
*added separator validation to entity search
*added EntityPosition class to bridge the gap to the redactionLogEntry
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
340869b3c9 RED-6368: Include Tables and Images into Prototype Document Structure 
*added some starting rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
7a529d5a88 RED-6368: Include Tables and Images into Prototype Document Structure 
*added Tables And TableCell
*added BoundingBox calculation function
*added images to structure without restructuring them, some images are still added twice
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
f8fe88dc3c RED-6093: Prototype document structure 
*refactored File Structure
*started refactor of original rules
 2023-04-21 09:50:33 +02:00
Kilian Schuettler
ba26cfb4ac RED-6093: Prototype document structure 
*refactored Nodes
*added some tests
*wip
 2023-04-21 09:50:33 +02:00
deiflaender
d0db04f3e9 RED-6093: Prototype document structurewip dependency upgrade 2023-04-21 09:50:33 +02:00
Kilian Schuettler
0afc77911d RED-6093: Prototype document structure 
wip
 2023-04-21 09:50:30 +02:00
Kilian Schuettler
55d82cd344 RED-6093: Prototype find entities in rules 
*added improved string to text position mapping
 2023-04-21 09:49:58 +02:00
Kilian Schuettler
212162b9f9 RED-6093: Prototype find entities in rules 
*added a prototype paragraph rule
 2023-04-21 09:45:30 +02:00
deiflaender
a1c5be1e3e RED-6093: Prototype find entities in rules 2023-04-21 09:43:40 +02:00
devplant
9a933e9563 RED-5694 - Upgrade spring-boot to 3.0 
- import storageAutoConfiguration to Application
 2023-04-20 13:03:39 +03:00
devplant
7d4b3f40d3 RED-5694 - Upgrade spring-boot to 3.0 
- exclude storageAutoConfiguration with @ComponentScan
 2023-04-05 14:09:02 +03:00
devplant
d366d9207a RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:48:28 +03:00
devplant
e22e16aef1 RED-5694 - Upgrade spring-boot to 3.0 
- remove comment code
 2023-04-05 13:43:45 +03:00
devplant
077677e02d RED-5694 - Upgrade spring-boot to 3.0 
- update exclusion of StorageAutoConfiguration
 2023-04-05 13:22:17 +03:00
devplant
09de0dc2c6 RED-5694 - Upgrade spring-boot to 3.0 
- update after the merge of master
 2023-04-05 12:06:12 +03:00
devplant
c3b29e4ebc Merge branch 'master' of https://git.iqser.com/scm/red/redaction-service into RED-5694 
# Conflicts:
#	redaction-service-v1/redaction-service-server-v1/src/test/java/com/iqser/red/service/redaction/v1/server/RedactionIntegrationTest.java
 2023-04-05 11:37:33 +03:00
devplant
adcf17c5f0 RED-5694 - Upgrade spring-boot to 3.0 
- update platfrom-dependency and other dependencies with latest versions
- remove dslplatform dependency
 2023-04-05 10:58:18 +03:00
Thomas Beyer
49860ab95d Pull request #528: RED-6411 4.5.0 1 
Merge in RED/redaction-service from RED-6411_4.5.0_1 to master

* commit '2a56187294c125931d4b998ee1f812ea426e2b58':
  RED-6411 - optimize code
  RED-6411 - optimize method
  RED-6411 - rename testclass because of regexp
  RED-6411 - fix import of configuration
  RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest
  RED-6411 - extend logic when replacing entities with higher rank
  RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine()
 2023-03-29 15:03:13 +02:00
Thomas Beyer
2a56187294 RED-6411 - optimize code 2023-03-29 09:35:55 +02:00
Thomas Beyer
710747d00b RED-6411 - optimize method 2023-03-28 11:28:43 +02:00
Thomas Beyer
4e76c007b8 RED-6411 - rename testclass because of regexp 2023-03-28 10:41:37 +02:00
Thomas Beyer
6e5b64ca94 RED-6411 - fix import of configuration 2023-03-28 10:35:27 +02:00
Thomas Beyer
157b20a1de RED-6411 - add test for this case (with the current rules-file) and move/abstract logic from the RedactionIntegrationTest into AbstractRedactionIntegrationTest 2023-03-28 10:16:17 +02:00
Thomas Beyer
7644afc3aa RED-6411 - extend logic when replacing entities with higher rank 2023-03-27 12:49:33 +02:00
deiflaender
f03523ca8f RED-6224: Multitenancy for rules cache 2023-03-27 09:37:48 +02:00
Thomas Beyer
459af9e33b RED-6411 - remove false positives before calling EntitySearchUtils.addOrAddEngine() 2023-03-27 09:05:13 +02:00
Viktor Seifert
3626dbd0a9 RED-5694: Imported new version of platform-dependency and fixed a couple of issues. 
* Updated imports for some javax.* packages.
* Added improved config for annotation processors (not dependent on implementation details).
* Updated SectionText class to not use wildcard imports, since the cause problems for lombok + dsl-json.
 2023-03-20 18:06:32 +01:00
deiflaender
339833e2d6 RED-6224: Fixed pr findings 2023-03-17 16:07:20 +01:00
deiflaender
ec0de5b6a2 RED-6224: Made dictionary cache multitenancy ready 2023-03-17 13:54:22 +01:00
Viktor Seifert
fe5121b1ed RED-6250: Switched to new metrics-commons version to not have to instantiate a factory (reduces code duplication) 2023-03-15 18:16:53 +01:00
Viktor Seifert
519bb9cb52 RED-6250: Changed function-timer metric to use code from metric commons 2023-03-15 16:40:04 +01:00