TritonService_cff Namespace Reference

Functions
def	_gpu_available ()

Variables
	_gpu_available_cached

Function Documentation

_gpu_available()

def TritonService_cff._gpu_available ( )

private

Definition at line 7 of file TritonService_cff.py.

def _gpu_available():
    global _gpu_available_cached
    if _gpu_available_cached is None:
        import os
        _gpu_available_cached = (os.system("nvidia-smi -L") == 0)
    return _gpu_available_cached
 
enableSonicTriton.toModify(TritonService,
    fallback = dict(
        enable = True,
        useGPU = _gpu_available(),
    ),
)

Variable Documentation

_gpu_available_cached

TritonService_cff._gpu_available_cached

private

Definition at line 5 of file TritonService_cff.py.