i would love to see how to build one that uses open source models instead of anthropic or openai

There is an mcp server named Reticle to verify agent's coding work. You should take a look at that too, will be helpful to make your architecture even more better.