Heterogeneity in AI: Pathways from Inference to Compound Systems (Dissertation)