Show HN: Keep your PyTorch model in VRAM by hot swapping code

77 pointsposted 4 days ago
by valine
(github.com)

7 Comments

NitpickLawyer

4 days ago

We use python notebooks for that functionality in the early stages of script testing. Load a cell up top with the model, then do your stuff below, and once things look good convert it to a normal python script.

pizza

4 days ago

Tensor visualizer app itself already looks pretty interesting

valine

4 days ago

Thanks, I will do a deep writeup on that at some point.

kombine

4 days ago

Are you running both DearImGui visualisation and training locally? If not, how can one use it in the client-server mode? I think this is the most common requirement for visualisation libraries in Deep Learning.

valine

4 days ago

The rendering is done with OpenGL, and for remote viewing I just render to an offscreen framebuffer and stream it back to the client with WebRTC. The code for that isn’t public yet, still needs some cleanup.

iaw

4 days ago

Yeah, sadly the link to their visualizations is gated behind X.com

CheeksTheGeek

4 days ago

you can use xcancel.com by adding cancel after the x url