Loading…
The Structured LLM project develops frameworks to enforce syntactic and semantic constraints on large language models, producing outputs that follow specific format rules and grammars for JSON, SQL, Python, and Java. It introduces SynCode, IterGen, and CRANE—tools for grammar-based, iterative, and reasoning-augmented constrained decoding—to retain valid tokens, enable backtracking, and balance correctness with reasoning. These techniques improve structured outputs for code generation, data serialization, and symbolic reasoning, with demonstrated reductions in syntax errors and accuracy gains in JSON, Python, and Go.
AI named structuredllm / IterGen in January 2026.