TensorFold is an LLM inference engine that supports running on Apple Silicon and NVIDIA GPUs, without requiring Python or MLX installation.
View details
TensorFold is an LLM inference engine that supports running on Apple Silicon and NVIDIA GPUs, without requiring Python or MLX installation.