abhi-3
8 hours ago
How does it handle large outputs? If I pipe a big config file through, does the full content travel back to local for LLM processing, or is there any streaming/chunking?
smudgy3746
8 hours ago
It does travel back to local entirely. It's streamed, although buffered at local before making the completion. I also imagine on the fly compression at remote and decompression at local should be possible