Commit c713f63
committed
fix: ensure model.device is set in ModelPatcher.partially_load
Assign self.model.device = device_to during DisTorch V2 partially_load so the model's device reflects the target allocation after loading.
AssertionError: Input tensors must be on cuda.
Fixes #119
Possible issue when used with custom samplers
Fixes #1301 parent 35e81e9 commit c713f63
1 file changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
301 | 301 | | |
302 | 302 | | |
303 | 303 | | |
| 304 | + | |
| 305 | + | |
304 | 306 | | |
305 | 307 | | |
306 | 308 | | |
| |||
0 commit comments