Update dependency versions#277

Closed

justheuristic wants to merge 2 commits intomainfrom

Collaborator

justheuristic commented Feb 28, 2023 •

edited

Loading

Why:

support new GPUs (ada, hopper)
dependency for Support saving and loading 8-bit block weights #273
better bf16 communication (phase 1/2)

Tests:

check local tests
check exact match (running a server)
check running a server with new BF16 flag
check running a server with TP=2

justheuristic added 2 commits

February 28, 2023 17:47


          Update dependency versions

5819c1a


          Update block.py

8bb8e86

Collaborator

borzunov commented Mar 28, 2023

Superseded by #290.

borzunov closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet