storageUri: pvc://<pvc name>/<model path> I think I figured it out. In the InferenceService, the storageUri should be this: pvc://granite-8b-code-base-pvc/granite-8b-code-base rather than pvc://granite-8b-code-base-pvc/hf/8b_instruction_tuned. It assumes /mnt/models. Not sure why hf/8b_instruction_tuned is there Dont use /mnt/model
Welcome to WordPress. This is your first post. Edit or delete it, then start writing!