Great job, very interesting! However I wonder: since you are targetting iOS, why only restrict yourself to generalist frameworks such as llama.cpp and LiteRT-LM? MLX Swift looks like a better fit, and the model catalog on HF's MLX community is pretty huge and diverse.

[dead]