fauxpilot/Dockerfile
Parth 7ea388fe19 Fix segfault issue
I'd been using dlpack for copying triton tensors to torch tensors,
which I did because it was advertised to perform zero copy transfers.
Turns out that only worked on my laptop, and didn't work on other machines.
IDK why. But for now, I'm just copying the tensors as triton<->numpy<->torch.
That works on the VM on which earlier code was segfaulting

Signed-off-by: Parth <thakkarparth007@gmail.com>
2022-11-19 18:32:50 +00:00

6 lines
279 B
Docker

FROM moyix/triton_with_ft:22.09
# Install dependencies: torch
RUN python3 -m pip install --disable-pip-version-check -U torch --extra-index-url https://download.pytorch.org/whl/cu116
RUN python3 -m pip install --disable-pip-version-check -U transformers bitsandbytes accelerate