InferenceService / ServingRuntime compatibility

[vrutkovs]

Thanks for a great example of diffusers demo! If I understood correctly this uses a standalone kserve deployment. Any pointers on how to use that with ServingRuntime / InferenceService objects?

[mcaimi]

Hello Vadim,
yes you understood correctly, this is an example custom serving engine built with KServe. It is only an example though, it is not at all ready for anything else that demos 👍🏻

Sure thing, here is the ServingRuntime I use to deploy the custom image.
As fot the InferenceService... I currently create one using RHOAI web portal, I do not have any yaml example ready to share.