Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

InfiniTensor / InfiniLM Public

Notifications You must be signed in to change notification settings
Fork 60
Star 39

Code
Issues 34
Pull requests 25
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Security
Insights

Support Quantization #209

Open

qinyiqun wants to merge 16 commits intoInfiniTensor:demo131InfiniTensor/InfiniLM:demo131from

qinyiqun:demo131_quantqinyiqun/InfiniLM:demo131_quantCopy head branch name to clipboard

Conversation Commits16 (16)Checks Files changed

Open

Support Quantization #209
qinyiqun wants to merge 16 commits intoInfiniTensor:demo131from
qinyiqun:demo131_quant

Commits

Commits on Feb 5, 2026

支持nv w8 1batch 1tp
qinyiqun
committed
增加json支持
 qinyiqun
committed
InfiniLM 增加量化层和global config
qinyiqun
committed
以一种比较优雅的方式增加了quant config的支持
 qinyiqun
committed
修改部分代码结构，删除无用代码
 qinyiqun
committed
跟随inifnicore修改
 qinyiqun
committed
删除所有的model_config，统一使用global_config
qinyiqun
committed
跟随InfiniLM最新代码修改
 qinyiqun
committed
修改函数参数顺序
 qinyiqun
committed
改名global config 为model config
qinyiqun
committed
Refactor: add new API alongside legacy interfaces with deprecation warnings
qinyiqun
committed
添加w4 inifnicore相关内容，以及将Quantization config划入InfiniCore
qinyiqun
committed
添加w4 inifnicore相关内容，以及将Quantization config划入InfiniCore

qinyiqun
authored and
xgqdut2016
committed
qy_page_131: add qy device
xgqdut2016
committed
success qy inference_server.py
xgqdut2016
committed
Merge pull request #3 from xgqdut2016/qy_page_131
qinyiqun
authored

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.