Deduplicating media on Context creation

[jamesbraza]

I realized we were passing the same images for Context creation. This PR:

1. Adds an info_hash to ParsedMedia to allow for loosened deduplication without affecting stored info
   • Now: can store high-resolution bbox, but have low-resolution bbox with deduplication
2. Uses ordered set-based deduplication for the Context creation prompt

This PR also makes a custom PDF for testing deduplication capabilities within multimodal PaperQA.

[Copilot]

Pull Request Overview

This PR implements media deduplication for Context creation to avoid passing duplicate images to the LLM. It introduces an info_hash field in ParsedMedia to enable deduplication based on rounded bounding boxes while preserving high-resolution metadata, and applies ordered set-based deduplication when creating context prompts.

Key changes:

• Added info_hash to ParsedMedia for flexible deduplication without affecting stored metadata
• Applied deduplication to media lists during context creation in _map_fxn_summary
• Created test PDF with duplicate media to validate deduplication behavior

Reviewed Changes

Copilot reviewed 8 out of 9 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
src/paperqa/types.py	Added _get_info_hash() method to support deduplication via optional info_hash key
src/paperqa/core.py	Implemented ordered set deduplication for media during context creation
packages/paper-qa-docling/src/paperqa_docling/reader.py	Added info_hash generation with rounded bounding boxes for pictures and tables
tests/test_paperqa.py	Added test to verify media deduplication during context creation
packages/paper-qa-docling/tests/test_paperqa_docling.py	Added test to verify ParsedMedia deduplication behavior
tests/duplicate_media_template.md	Template for generating test PDF with duplicate images
src/paperqa/prompts.py	Removed redundant separator between text and tables
tests/test_agents.py	Updated expected file counts to include new test PDF

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[dosubot]

Documentation Updates

1 document(s) were updated by changes in this PR

• Multimodal Support in PaperQA (View Changes)

^{How did I do? Any feedback?}