Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TransitionMiniBatch object is NOT writable #242

Closed
XiudingCai opened this issue Nov 30, 2022 · 2 comments
Closed

TransitionMiniBatch object is NOT writable #242

XiudingCai opened this issue Nov 30, 2022 · 2 comments
Labels
enhancement New feature or request

Comments

@XiudingCai
Copy link

For validating an idea, I want to modify rewards in a TransitionMiniBatch dynamically. However, it threw an exception TransitionMiniBatch object is NOT writable. I checked the source code, and found that TransitionMiniBatch was implemented by C. I wonder there is a method to modify TransitionMiniBatch object. Thanks!
@XiudingCai XiudingCai added the enhancement New feature or request label Nov 30, 2022
@takuseno
Copy link
Owner

@XiudingCai Currently, it's difficult to overwrite the contents in TransitionMiniBatch. I'm currently working on the next major update in nightly branch. In this version, you can easily modify the values in the batch. Please stay tuned for the update.

@takuseno
Copy link
Owner

With the latest d3rlpy package, this should be fairly easy since it's fully written in Python.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@takuseno @XiudingCai