-
Notifications
You must be signed in to change notification settings - Fork 237
chg: passing through trust_remote_code #778
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Chenhan Yu <chenhany@nvidia.com>
|
Important Review skippedAuto incremental reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the 📝 WalkthroughWalkthroughThe changes modify the Changes
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes 🚥 Pre-merge checks | ✅ 3✅ Passed checks (3 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #778 +/- ##
=======================================
Coverage 74.22% 74.22%
=======================================
Files 192 192
Lines 19027 19027
=======================================
Hits 14123 14123
Misses 4904 4904 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Signed-off-by: Chenhan Yu <chenhany@nvidia.com>
| dtype=torch.bfloat16, | ||
| dequantize: bool = True, | ||
| trust_remote_code: bool = False, | ||
| trust_remote_code: bool = True, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why do we set default to True?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have the same question here. Is this an intended change?
What does this PR do?
Type of change: ? Bug fix
Overview:
Passing
trust_remote_codeall the way through during export and import. This is needed sinceDeepSeekwill error out iftrust_remote_code=TruebutNemotron-Hwill error out iftrust_remote_code=FalseUsage
# Add a code snippet demonstrating how to use thisTesting
Before your PR is "Ready for review"
Additional Information
Summary by CodeRabbit
trust_remote_codeparameter fromTruetoFalsein GPT model export and import functionality.✏️ Tip: You can customize this high-level summary in your review settings.