Tensor parallelism #21
Description
I want to use tensor parallel with REST, but I do not find the config to start the tensor parallel, can you give me an example?
{{ message }}
I want to use tensor parallel with REST, but I do not find the config to start the tensor parallel, can you give me an example?