[BUG] Multi-GPU DBSCAN is broken

[vikcost]

Below is a minimal version of a test script for multi-gpu DBSCAN.
I have 6 RTX 4090 on my machine that I want to utilize.

I observe memory allocations and de-allocations on my GPUs. But DBSCAN fails to return any result.

Any idea where the issue might be coming from?

import numpy as np
from cuml.dask.cluster import DBSCAN
from dask.distributed import Client
from dask_cuda import LocalCUDACluster

if __name__ == "__main__":
    cluster = LocalCUDACluster()
    client = Client(cluster)
    embs = np.random.randn(100_000, 256)
    dbscan = DBSCAN(
        client=client,
        eps=0.25,
        min_samples=5,
        metric="cosine",
    ).fit(embs)

Environment details:

• Environment location: Bare-metal
• Linux Distro/Architecture: Ubuntu 22.04
• GPU Model/Driver: RTX4090 driver 550.107
• CUDA: 12.4
• Method of cuDF & cuML install: pip

[divyegala]

@vikcost can you explain what you mean by DBSCAN failing to return any result? Does that mean there is a crash or something else going on?