4 Commits

Author	SHA1	Message	Date
Parth Thakkar	c6be12979e	Fix setup issues and add test script ... Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-10-21 13:23:10 -05:00
Fred de Gier	2a91018792	Resolve merge conflicts and fix issues with setup.sh	2022-10-20 16:09:12 +02:00
Fred de Gier	4f936c3049	Pep8 formatting	2022-10-20 15:37:17 +02:00
Parth Thakkar	01f1cbb629	Add python backend support ... - Modify dockerfile to include bitsandbytes, transformers and latest version of pytorch - Minor modifications in utils/codegen.py so that same client works with FT and Py-backend - Minor modifications in launch.sh (no need to name models by GPU) - Add installation script for adding a new python model (with super simple config_template) - Modify setup.sh so that it aworks with both FT and Python backend models Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-10-16 22:05:09 -05:00