Deploy serverless GPU applications on your AWS account
3.7
to 3.11
. Make sure that your virtual environment is set up with one of these versions.admin
access so that tensorkube can provision resources./readiness
endpoint configured in your FastAPI app.
Tensorkube uses this endpoint to check the health of your deployments. Given below is a simple FastAPI app that you can deploy:
env
directories inside the project folder which then interferes with the build process.
If you have other things in the folder, make sure that you make a .dockerignore
file and put the irrelevant stuff in that file.--gpu-type
arguement supports all the GPU types that are available on AWS. You can find the list of supported GPU types here.