Skip to content

[Bug] The language changes after BootstrapFewShot. #8068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mhhz opened this issue Apr 14, 2025 · 1 comment
Open

[Bug] The language changes after BootstrapFewShot. #8068

mhhz opened this issue Apr 14, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@mhhz
Copy link

mhhz commented Apr 14, 2025

What happened?

When I normally use "signature" to define my input and output and use COT for prediction, the output is correct and in Chinese. However, after I optimize it using BootstrapFewShot and obtain a JSON model file, why does it output in English when I load this model file and make predictions again, even though the training examples I provided are in Chinese?

Steps to reproduce

COT的结果 Prediction(
reasoning="The current weather is sunny with an outside temperature of 25°C and an inside temperature of 23.5°C. The AC is currently set to heat at 23°C, which is not ideal for a sunny day. The user prefers a temperature of 23°C and a fan speed of 3. The inside air quality is poor (80).
Given the sunny weather and the user's preference, I should switch the AC to cooling mode, increase the fan speed, and potentially enable recirculation to improve air quality. Since the AC is already on and set to 23, I will only adjust the fan speed and switch to cooling.",

reason='The weather is sunny and the current AC setting is heating. Switching to cooling mode and increasing the fan speed will provide a more comfortable environment. Enabling recirculation will help improve the inside air quality.'

)

DSPy version

2.6.14

@mhhz mhhz added the bug Something isn't working label Apr 14, 2025
@okhat
Copy link
Collaborator

okhat commented Apr 15, 2025

Can you share the program and the LLM used?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants