- Add validation rule to ensure is set to fastertransformer or python-backend
- Add warning if model is unavailable, likely the user has not set correctly
Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
This commit is to improve PR template (e.g., summary, goal, description,
reproduction, and so on) that can be submitted by contributers
to evolve the FauxPilot software.
**Changelog**
* Version 2
- Applied comments of reviewer(s)
- Updated the sections of a PR writing guide for readability.
* Version 1
- Added Pull Request template
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
* Fixed a small mistake that prevented the -h option from working.
* Corrected some capitalization / grammar issues in the help text.
* Removed a debug print that was left in.
* Basic action that runs pytest
* fix indentation
* debugging actions :(
* pull the images in a separate step so it doesn't take so long to build
* Split out the container build
* Another try, fixing missing env vars
I'd been using dlpack for copying triton tensors to torch tensors,
which I did because it was advertised to perform zero copy transfers.
Turns out that only worked on my laptop, and didn't work on other machines.
IDK why. But for now, I'm just copying the tensors as triton<->numpy<->torch.
That works on the VM on which earlier code was segfaulting
Signed-off-by: Parth <thakkarparth007@gmail.com>
This commit is to append the manual of the Python script files.
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
This commit is to append an GitHub Action to welcome new contributors
into the FauxPilot community. This action is to post automatically a welcome
message whenever a new contributor opens a first issue or PR in this
repository.
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
This commit is to enable the ISSUE_TEMPLATE to maintain issues of FauxPilot
by adding the ISSUE_TEMPLATE files into the FauxPilot repository.
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
This PR is to add an option function for the user to selectively use
foreground mode and background mode (i.e., daemon mode).
Also, depending on the version of docker composer, the -d (daemon mode) option
may or may not be present. Therefore, this is to deal effectively with these
situations.
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
