355 Commits

Author SHA1 Message Date
deiflaender
638c4f9c65 RED-413: Added user to manual redactions, approved flag to Status.APPROVED 2020-10-12 12:21:18 +02:00
deiflaender
a01651b827 RED-240: Use HexColors instead of float[], RED-380: Load all system colors from dictionary-service 2020-10-08 11:51:35 +02:00
deiflaender
365158a008 RED-391: Support comments and approval of manual redactions, RED-385: Improve annotation IDs in PDFs 2020-10-05 15:14:23 +02:00
Thierry Göckel
fa29f56d98 Test line break fix 2020-10-02 18:11:58 +02:00
Thierry Göckel
9a965dd68a Make sure section and table char indices match 2020-10-02 17:54:31 +02:00
Thierry Göckel
6a8f366519 Remove entries from must_redact dict, add test and refactor rules 2020-09-30 16:08:56 +02:00
Thierry Göckel
cec5fd3d5e Add rule redacting sponsor companies if preceded by prefix 2020-09-30 14:13:17 +02:00
deiflaender
ecc303e79e RED-277: Upgraded to pdfbox 2.0.21 2020-09-29 15:18:58 +02:00
deiflaender
e1adcfb02c Added missing unittest 2020-09-29 14:54:35 +02:00
deiflaender
11164219c5 RED-264: Avoid phantom cells, by merging line till rounded value of biggest char height/width 2020-09-29 14:21:42 +02:00
deiflaender
664b9b4206 RED-299: Redact complete Author(s) Field in Vertebrate study tables 2020-09-23 15:20:52 +02:00
Thierry Göckel
cfb7554c61 Test modified rules 8 and 9 2020-09-22 21:36:05 +02:00
deiflaender
de310e8a65 RED-293: Add unkown Textblocks to paragraphs 2020-09-14 13:52:16 +02:00
deiflaender
65a29fb3a5 Added new files and missing dictionary entries 2020-09-07 16:06:25 +02:00
Thierry Göckel
3d5455d729 Fix redaction in single cell tables 2020-09-02 14:31:38 +02:00
deiflaender
b5fa771c28 RED-267: Return dictionary and rules version in redactionLog 2020-09-02 08:47:05 +02:00
Thierry Göckel
3c590dcf1d Adjust test to added rule and fix vertical header propagation for row >
2
2020-08-25 15:41:44 +02:00
Thierry Göckel
848c506c3f Fix entity span in table rows and detection of headers in rotated tables 2020-08-25 13:50:34 +02:00
deiflaender
559c421542 Made rules for table more stabil and flexible 2020-08-24 14:45:30 +02:00
Thierry Göckel
38ddb1d9c8 Fix test and logic of same page table merge for one row tables 2020-08-24 14:06:34 +02:00
Thierry Goeckel
92f0af9d21 Pull request #28: Highlight N in vertebrate study tables and fixed rule order
Merge in RED/redaction-service from tableRules to master

* commit 'afa26895c8e78f261ec3700c515f412d8cf605ce':
  Fixed test problem
  Fixed pmd
  Highlight N in vertebrate study tables and fixed rule order
2020-08-24 13:15:11 +02:00
deiflaender
afa26895c8 Fixed test problem 2020-08-24 13:05:23 +02:00
Thierry Göckel
baa703928f Fix multi-page table merge 2020-08-24 13:03:03 +02:00
deiflaender
8a471d0771 Highlight N in vertebrate study tables and fixed rule order 2020-08-24 12:24:48 +02:00
Thierry Göckel
00a960ee23 Fix merging of tables with single header row table 2020-08-24 11:43:19 +02:00
Thierry Göckel
76369f13f8 Remove redundant comment 2020-08-18 20:53:41 +02:00
Thierry Göckel
1fff4f7eb0 RED-101: Add features as requested in PR
- Add rule for non-vertebrate studies
- Don't highlight ambiguous cell values
- Rewrite rules in more human-readable fashion
2020-08-18 20:35:40 +02:00
Thierry Göckel
c7f5b4a280 Add unit test for table structure requirements 2020-08-18 20:35:17 +02:00
Thierry Göckel
4236fa05cc Make table structure detection more robust 2020-08-13 17:48:37 +02:00
deiflaender
2b93ae57d5 RED-88: Enabled manual redaction 2020-08-13 15:34:09 +02:00
Thierry Göckel
17aabcd09c Fix index out of bounds exception 2020-08-13 11:13:01 +02:00
Thierry Göckel
a151a13b4c Fix NPE for empty cells 2020-08-13 11:02:09 +02:00
Thierry Göckel
5542a97a38 Add test redacting all files and expecting no exception 2020-08-13 10:14:49 +02:00
Thierry Göckel
c93ca745fc Normalize header information 2020-08-11 10:24:33 +02:00
Thierry Göckel
00c96c6f57 RED-101: Detect vertebrate study row value 2020-08-10 19:04:49 +02:00
Thierry Göckel
06630b09d2 RED-101: Implement table cell and row redaction 2020-08-10 19:04:49 +02:00
deiflaender
b5412dc959 Cleaned up dictionaries 2020-08-10 15:16:05 +02:00
deiflaender
7d0b0ed3d0 Avoid duplicate redaction if type have same entries, made Applicant and Producer rules more specific 2020-08-07 12:09:37 +02:00
deiflaender
1f8d371a82 RED-149: Added must_redact dictionary and Rule, Adjusted rules for applicant and producer to work on all documents. Fixed endless loop in rules. Detect multiple occurences in rules 2020-08-05 13:10:31 +02:00
Thierry Göckel
81723ce402 Use void method type 2020-08-04 10:34:54 +02:00
deiflaender
d2d7f8c50c Fixed duplicated redaction/RedactionLog entries 2020-07-31 16:25:10 +02:00
deiflaender
e2895a1c7a RED-211, RED-215 Added dictionaries and rules for testing. 2020-07-31 16:22:47 +02:00
deiflaender
872c384dc6 Use default color from configuration-service on unknown type 2020-07-28 12:38:59 +02:00
deiflaender
f0e48087ff RED-207: Match caseInsensitive dictionaries caseInSensitive 2020-07-27 13:20:00 +02:00
deiflaender
b57a4a2db3 Use Hint in IntegrationTest 2020-07-24 10:45:04 +02:00
Thierry Göckel
7dbe03483b RED-183: Fix catching validation errors 2020-07-23 13:36:02 +02:00
deiflaender
6a9df397eb Do not return redacted=true for vertebrates in RedactionLog, return isHint=true and redacted=false 2020-07-22 14:06:45 +02:00
deiflaender
49fe418a60 DEV: Fixed Nullpointer on undefined color for type, adapted rule to Type naming. 2020-07-21 16:17:52 +02:00
cheng
d607ac567d RED-106: integrationTest fixed. 2020-07-21 13:15:58 +02:00
cheng
1b40931c87 RED-106: integrationTest fixed. 2020-07-21 13:14:17 +02:00