Marmelator/image-classification-service
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 29 Wiki Activity

chore: try to fix custom build by pushing again

Browse Source
This commit is contained in:
Julius Unverfehrt 2025-01-30 14:26:51 +01:00
parent e20a5623e6
commit 528ae3fafe
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
src/image_prediction/pipeline.py
View File

@ -79,6 +79,12 @@ class Pipeline:
def filter_duplicates(metadata: Iterable[dict[str, Any]]) -> Iterable[dict[str, Any]]: def filter_duplicates(metadata: Iterable[dict[str, Any]]) -> Iterable[dict[str, Any]]:
"""Filter out duplicate images from the `position` (image coordinates), `page` and `representation` (perceptual hash). """Filter out duplicate images from the `position` (image coordinates), `page` and `representation` (perceptual hash).
See RED-10765 (RM-241): Removed redactions reappear for why this is necessary. See RED-10765 (RM-241): Removed redactions reappear for why this is necessary.
Args:
metadata: Iterable of image metadata dicts.
Returns:
Iterable of image metadata dicts with duplicates removed.
""" """
seen = set() seen = set()
for item in metadata: for item in metadata: