Show HN: Keep your PyTorch model in VRAM by hot swapping code

77 pointsposted 10 months ago
by valine
(github.com)

10 Comments

NitpickLawyer

10 months ago

We use python notebooks for that functionality in the early stages of script testing. Load a cell up top with the model, then do your stuff below, and once things look good convert it to a normal python script.

pizza

10 months ago

Tensor visualizer app itself already looks pretty interesting

valine

10 months ago

Thanks, I will do a deep writeup on that at some point.

kombine

10 months ago

Are you running both DearImGui visualisation and training locally? If not, how can one use it in the client-server mode? I think this is the most common requirement for visualisation libraries in Deep Learning.

valine

10 months ago

The rendering is done with OpenGL, and for remote viewing I just render to an offscreen framebuffer and stream it back to the client with WebRTC. The code for that isn’t public yet, still needs some cleanup.

iaw

10 months ago

Yeah, sadly the link to their visualizations is gated behind X.com

CheeksTheGeek

10 months ago

you can use xcancel.com by adding cancel after the x url

user

10 months ago

[deleted]