Search results

[BUG] 由于数据拷贝，导致的推理时索越界问题

Status: Open.

#411 In InfiniTensor/InfiniLM;

· pengcheng888 opened on Jun 4, 2026

[DEV] 释放GIL锁后，优化推理过程中显存占用

Status: Open.

#407 In InfiniTensor/InfiniLM;

· pengcheng888 opened on Jun 3, 2026

[DEV] InfiniLM 支持 GPT2

Status: Open.

#406 In InfiniTensor/InfiniLM;

· spike-zhu opened on Jun 1, 2026

[Refactor] Decouple RoPE Scaling via Factory Pattern and Introduce TP-Safe RoPE Cache

Status: Open.

#401 In InfiniTensor/InfiniLM;

· rubik-hua opened on May 28, 2026

[BUG] Missing spaces between English words during streaming inference with Mistral/internlm3 models

Status: Open.

#398 In InfiniTensor/InfiniLM;

· rubik-hua opened on May 25, 2026

[DEV] InfiniLM 接入摩尔 flash-attn

Status: Open.

#394 In InfiniTensor/InfiniLM;

· spike-zhu opened on May 21, 2026

[Feature]Implement Llama 3.1 Frequency-Aware RoPE Scaling

Status: Open.

#392 In InfiniTensor/InfiniLM;

· rubik-hua opened on May 20, 2026

[DEV] build with cmake

Status: Open.

#390 In InfiniTensor/InfiniLM;

· wooway777 opened on May 20, 2026

[DEV] MiniCPM-V服务支持连续批次

Status: Open.

#369 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on May 12, 2026

refactor: use processor in infer backup

Status: Open.

#367 In InfiniTensor/InfiniLM;

· wooway777 opened on May 12, 2026

[DEV] 多模态模型前缀匹配基建

Status: Open.

#344 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on May 6, 2026

[DEV] MiniCPM-V模型推理服务

Status: Open.

#343 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on May 6, 2026