feat: more proper lang in multi-modal parser#733
Merged
CaralHsi merged 83 commits intoMemTensor:devfrom Dec 18, 2025
Merged
Conversation
## Description <!-- Please include a summary of the changes below; Fill in the issue number that this PR addresses (if applicable); Fill in the related MemOS-Docs repository issue or PR link (if applicable); Mention the person who will review this PR (if you know who it is); Replace (summary), (issue), (docs-issue-or-pr-link), and (reviewer) with the appropriate information. 请在下方填写更改的摘要； 填写此 PR 解决的问题编号（如果适用）； 填写相关的 MemOS-Docs 仓库 issue 或 PR 链接（如果适用）； 提及将审查此 PR 的人（如果您知道是谁）； 替换 (summary)、(issue)、(docs-issue-or-pr-link) 和 (reviewer) 为适当的信息。 --> Summary: (summary) Fix: #(issue) Docs Issue/PR: (docs-issue-or-pr-link) Reviewer: @(reviewer) ## Checklist: - [ ] I have performed a self-review of my own code | 我已自行检查了自己的代码 - [ ] I have commented my code in hard-to-understand areas | 我已在难以理解的地方对代码进行了注释 - [ ] I have added tests that prove my fix is effective or that my feature works | 我已添加测试以证明我的修复有效或功能正常 - [ ] I have created related documentation issue/PR in [MemOS-Docs](https://github.com/MemTensor/MemOS-Docs) (if applicable) | 我已在 [MemOS-Docs](https://github.com/MemTensor/MemOS-Docs) 中创建了相关的文档 issue/PR（如果适用） - [ ] I have linked the issue to this PR (if applicable) | 我已将 issue 链接到此 PR（如果适用） - [ ] I have mentioned the person who will review this PR | 我已提及将审查此 PR 的人
## Description <!-- Please include a summary of the changes below; Fill in the issue number that this PR addresses (if applicable); Fill in the related MemOS-Docs repository issue or PR link (if applicable); Mention the person who will review this PR (if you know who it is); Replace (summary), (issue), (docs-issue-or-pr-link), and (reviewer) with the appropriate information. 请在下方填写更改的摘要； 填写此 PR 解决的问题编号（如果适用）； 填写相关的 MemOS-Docs 仓库 issue 或 PR 链接（如果适用）； 提及将审查此 PR 的人（如果您知道是谁）； 替换 (summary)、(issue)、(docs-issue-or-pr-link) 和 (reviewer) 为适当的信息。 --> Summary: (summary) Fix: #(issue) Docs Issue/PR: (docs-issue-or-pr-link) Reviewer: @(reviewer) ## Checklist: - [ ] I have performed a self-review of my own code | 我已自行检查了自己的代码 - [ ] I have commented my code in hard-to-understand areas | 我已在难以理解的地方对代码进行了注释 - [ ] I have added tests that prove my fix is effective or that my feature works | 我已添加测试以证明我的修复有效或功能正常 - [ ] I have created related documentation issue/PR in [MemOS-Docs](https://github.com/MemTensor/MemOS-Docs) (if applicable) | 我已在 [MemOS-Docs](https://github.com/MemTensor/MemOS-Docs) 中创建了相关的文档 issue/PR（如果适用） - [ ] I have linked the issue to this PR (if applicable) | 我已将 issue 链接到此 PR（如果适用） - [ ] I have mentioned the person who will review this PR | 我已提及将审查此 PR 的人
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
…lPublic into feat/evaluation_doc_qa
CaralHsi
changed the title
fridayL
approved these changes
Dec 18, 2025
tianxing02
pushed a commit
to tianxing02/MemOS
that referenced
this pull request
Feb 24, 2026
* hotfix:hotfix * test: add routers api * fix: doc fine mode bug * fix: doc fine mode bug * feat: init longbench_v2 * feat: more strict embedder trucation * feat: parallel processing fine mode in multi-modal-fine * feat: update parsers; add chunk info into source; remove origin_part * feat: modify chunk_content in file-fine-parser * fix: token counter bug * feat: enlarge polardb * feat: derease parallrl * feat: add image parser in file * feat: update file_content_parser * feat: modify long_bench_v2 * feat: modify long_bench_v2 * fix: image bug * feat: increase playground depth * feat: set parsed_text None in file parser * fix: file_ids bug in file-mode * feat: update evaluation * feat: update evaluation * feat: add general string prompt * fix: test server router * feat: update evluation * feat: decrease graph-db batch size to 5 * fix: default name in long_bench-v2/longbench_v2_search * fix: test bug * Update test_server_router.py * Update test_product_router.py * feat: comment * feat: add lang detection in multi_modal_struct and user-parser-modal * feat: add lang detection in image parser * feat: add assistant parser lang detection * feat: update base (lang added to source) * feat: lang added to source in string parser * feat: lang added to source in system parser * feat: lang added to source in text_content_parser * feat: lang added to source in user parser * feat: lang added to source in user parser * feat: lang added to source in tool parser * feat: modify lang detection for fine-string parser * fix: context_items * fix: json ensure ascii --------- Co-authored-by: HarveyXiang <harvey_xiang@163.com> Co-authored-by: fridayL <lcy081099@gmail.com> Co-authored-by: chunyu li <78344051+fridayL@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Summary: (summary)
Fix: #(issue)
Docs Issue/PR: (docs-issue-or-pr-link)
Reviewer: @(reviewer)
Checklist: