Skip to content

Add an API to retrieve the amount of free memory in a GPU #59

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
CascadingRadium wants to merge 2 commits into
base: bleve
Choose a base branch
from
Open

Add an API to retrieve the amount of free memory in a GPU #59

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
580987d
Expose API to get in-use GPU memory
CascadingRadium Nov 6, 2025
23f11d6
add newline
CascadingRadium Nov 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions c_api/gpu/DeviceUtils_c.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,3 +44,12 @@ int faiss_gpu_sync_all_devices() {
}
CATCH_AND_HANDLE
}

/// Returns the free memory (in bytes) on the specified device
int faiss_get_free_memory(int device, size_t* p_free_bytes) {
try {
size_t freeBytes = faiss::gpu::getFreeMemory(device);
*p_free_bytes = freeBytes;
}
CATCH_AND_HANDLE
}
3 changes: 3 additions & 0 deletions c_api/gpu/DeviceUtils_c.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,9 @@ int faiss_gpu_profiler_stop();
/// cudaDeviceSynchronize for each device)
int faiss_gpu_sync_all_devices();

/// Returns the free memory (in bytes) on the specified device
int faiss_get_free_memory(int device, size_t* p_free_bytes);

#ifdef __cplusplus
}
#endif
Expand Down