Add file hash generation and metadata handling in Document Intelligence service #159
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
YashG-28
commented
Nov 17, 2025
YashG-28
commented
- added file hash generation logic in document intelligence
- only ingest file if the file hash is not present in qdrant
- component to get file hash of a file
- filter on metadata in qdrant(tool)
jagveer-autonomize
approved these changes
Nov 17, 2025
adhupar-autonomize
pushed a commit
that referenced
this pull request
Nov 19, 2025
jagveer-autonomize
added a commit
that referenced
this pull request
Nov 19, 2025
* fixed file path issue in split to images component * added agent tracing * on reload fetch latest logo (#128) * on reload fetch latest logo * button changed to Save --------- Co-authored-by: Rishi <[email protected]> * Feature/autpe 6327 (#130) * minor changes in the published flow * minor changes * updated the market place to show the tags title * added chunks metadata in ocr component and modified qdrant db to filter based on the documnet uuid provided and added new input for document uuid in qdrant * Fix/update charts repo name (#131) * Fix migration chain: correct parent reference for flow_icon migration - Change down_revision from missing '20251027120000' to '5b431a7ef7c1' - Fixes broken migration chain causing deployment failures - Now properly follows: 99999999999 → 5b431a7ef7c1 → 20251027130000 * Fix: Update repository references from platform-charts to ai-studio-charts Updated Azure DevOps pipeline configurations to use the new repository name after the repository was renamed from autonomize-ai/platform-charts to autonomize-ai/ai-studio-charts. Changes: - Updated repository names in backend-cicd.yaml and frontend-cicd.yaml - Updated repository aliases from platform-charts to ai-studio-charts - Updated checkout references in release-template.yml - Updated variable names and paths in common.yml - Updated comments for consistency * reverted bff changes done for mcp server (#132) * Fix/mcp server api (#133) * reverted bff changes done for mcp server * updated basic templates * updated starter project helper * changes done for the playground (#135) * added end-event handler (#137) * minor fix for the tags (#138) * agent versioning implemented (#134) * agent versioning implemented * agent version added * agent version bug fixes * date field changed to utc * bug fixes * bug fixes * title name issue fixes * app logo fixes --------- Co-authored-by: Rishi <[email protected]> * added filter persist (#139) * added filter persist * live icon change * Feature/playground changes (#140) * updated playground * added default env * added language model * added google api support (#141) * Feature/component fix (#142) * added google api support * added minor changes * feat(marketplace): persist tab selection and hide flow name in visualization (#143) add session storage persistence for marketplace detail tabs hide flow name in header when viewing flow visualization tab simplify marketplace flow name label Co-authored-by: joexavier1997 <[email protected]> * fixed ehr connector (#144) * Feature/specification to flow v2 with create flow (#145) * validation added * feat(spec_flow_builder): add config and provides validators with tests - Implement ConfigValidator to validate component config keys and types against catalog templates - Add ProvidesConnectionValidator to validate 'provides' connections in YAML specs - Extend ComponentResolver with get_cached_components method - Enhance ComponentSchemaInspector with additional cache and connection validation logic - Add comprehensive unit tests for both validators * test(config_validator): update test cases with code value for resolver Add explicit code values in test cases to help the resolver map class names correctly. Include additional known keys to avoid validation flags. * node and config implemented * edge fixes * toolset issue fixes * changes added for config * config fixes --------- Co-authored-by: Rishi <[email protected]> Co-authored-by: joexavier1997 <[email protected]> * changes done for the playground * minor change for the upload (#148) * Feature/autpe 6385 flow to yaml creation (#147) * validation added * feat(spec_flow_builder): add config and provides validators with tests - Implement ConfigValidator to validate component config keys and types against catalog templates - Add ProvidesConnectionValidator to validate 'provides' connections in YAML specs - Extend ComponentResolver with get_cached_components method - Enhance ComponentSchemaInspector with additional cache and connection validation logic - Add comprehensive unit tests for both validators * test(config_validator): update test cases with code value for resolver Add explicit code values in test cases to help the resolver map class names correctly. Include additional known keys to avoid validation flags. * node and config implemented * edge fixes * toolset issue fixes * changes added for config * config fixes * flow to yaml conversion * flow to yaml conversion * yaml type fixes * config issue fixes * yaml generation and flow generation fixes --------- Co-authored-by: Rishi <[email protected]> Co-authored-by: joexavier1997 <[email protected]> * changed knowledge hub embedding model * added filters field in khub search * docker file update and added tool mode in khub filter (#151) * fix filter tool mode * docker file updated to use tar * knowledge hub selected hubs refresh button not showing fix * added bug fix * Feature/autpe 6409 store yaml in vector (#154) * vector db service created * vector store and get from vector * storing the published flow yaml in the vector db * changed build agent --------- Co-authored-by: Rishi <[email protected]> Co-authored-by: Amith <[email protected]> * chat input area auto size increment for large text context (#155) * added playground thread and observabilty (#158) * Add file hash generation and metadata handling in Document Intelligence service (#159) * fix(api-request): curl mode url issue (#160) Co-authored-by: Abhay Dhupar <[email protected]> * added base 64 generation for images * added markdown and playground persists (#162) * fix(qdrant): include document hash in cleaned filters for search * added thread logs * fix(split-to-img): update the split multi-page PDFs into individual single-page PDFs instead of images --------- Co-authored-by: ygoel <[email protected]> Co-authored-by: sourabhEx2 <[email protected]> Co-authored-by: rishikant05-autonomize <[email protected]> Co-authored-by: Rishi <[email protected]> Co-authored-by: Jagveer Singh <[email protected]> Co-authored-by: joexavier1997 <[email protected]> Co-authored-by: joexavier1997 <[email protected]> Co-authored-by: Amith <[email protected]> Co-authored-by: Abhay Dhupar <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.