Can ipex support general llm like defog/sqlcoder

[RenyanDiao]

Describe the issue

model = ipex._optimize_transformers(model.eval(), dtype=torch.bfloat16, inplace=True)

[jingxu10]

No, currently only models mentioned in the screenshot are optimized.

[RenyanDiao]

No, currently only models mentioned in the screenshot are optimized.

Do you have plans to support more models recently?

[jingxu10]

Is there any reproducer that we can use to investigate this crash issue?
Models outside the list should be able to run, but will not be optimized.

[RenyanDiao]

Is there any reproducer that we can use to investigate this crash issue? Models outside the list should be able to run, but will not be optimized.

https://github.com/defog-ai/sqlcoder/tree/main
yes, it can run while just performs as the same as using official torch. The latency is too long for us.