This discusses tradeoffs, optimizations, evaluations, proxying, etc.

I also appreciate a comment from Eric Drummond, which lists out what this type of embedding search might support: "There are 16 kinds of search-y things in Quora (web UI)..."