Together introduces the Together Compiler, continual compilation for AI inference

Simran Arora of Together's research team introduced the Together Compiler, which she describes as continual compilation for AI inference. Her argument is that today's inference is "polymorphic", shifting shape rather than sitting still, and she notes that 80% of traffic on OpenRouter goes to recently released models.

SemiAnalysis says it validated an InferenceX/AgentX result tied to the work.