-
Notifications
You must be signed in to change notification settings - Fork 222
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Finding a Bug #302
Comments
Hi, this file has been updated recently, we will check the code assp. |
Hello, thank you very much for your attention to EasyEdit.
Therefore, I don't think there is a bug with this part. |
Last night, I borrowed the evaluation code of EasyEdit in my method. However, if the code in the editing process is also concatenated by a space, there will be no mistakes since the editing and evaluation are consistent. But again, Is it better if |
Hi Songlin, No worries at all. EasyEdit thrives on open sharing and discussion, and your contributions are greatly appreciated. Regarding your concerns, let's see if we can reach the following consensus:
|
If you don't have any further questions, please help close this issue. |
#There probably be Fatal Error in evaluate_utils.py (see Line-106).
Explanation:
Taking GPT2Tokenizer (GPT2 1.5B) and the following case as the example.
Prompts: On which continent is Abrit Nunatak located?
Answer:
Your code (connecting by space):
-> On which continent is Abrit Nunatak located? South America
-> input_ids: [ 2202, 543, 15549, 318, 2275, 799, 39342, 265, 461, 5140, 30, 2520, 2253]
-> tokens: ['On', 'Ġwhich', 'Ġcontinent', 'Ġis', 'ĠAb', 'rit', 'ĠNun', 'at', 'ak', 'Ġlocated', '?', 'ĠSouth', 'ĠAmerica']
Note these tokens please:
-> 'South' VS 'ĠSouth'
-> 14942 VS 2520
Solution (connecting as tuple):
-> (On which continent is Abrit Nunatak located?, South America)
-> input_ids: [ 2202, 543, 15549, 318, 2275, 799, 39342, 265, 461, 5140, 30, 14942, 2253]
-> tokens: ['On', 'Ġwhich', 'Ġcontinent', 'Ġis', 'ĠAb', 'rit', 'ĠNun', 'at', 'ak', 'Ġlocated', '?', 'South', 'ĠAmerica']
The text was updated successfully, but these errors were encountered: