chore: try to fix custom build by pushing again
This commit is contained in:
parent
e20a5623e6
commit
528ae3fafe
@ -79,6 +79,12 @@ class Pipeline:
|
||||
def filter_duplicates(metadata: Iterable[dict[str, Any]]) -> Iterable[dict[str, Any]]:
|
||||
"""Filter out duplicate images from the `position` (image coordinates), `page` and `representation` (perceptual hash).
|
||||
See RED-10765 (RM-241): Removed redactions reappear for why this is necessary.
|
||||
|
||||
Args:
|
||||
metadata: Iterable of image metadata dicts.
|
||||
|
||||
Returns:
|
||||
Iterable of image metadata dicts with duplicates removed.
|
||||
"""
|
||||
seen = set()
|
||||
for item in metadata:
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user