How AI describes Jais

G42 released Jais-30B and Jais-30B-chat, open-source Arabic-centric large language models that are bilingual and competitive with English-language models of similar size. The models are decoder-only transformers (48 blocks, 56 attention heads, 7168 embedding) that incorporate enhancements such as Swiglu, ALiBi, and a custom Jais tokenizer trained on equal Arabic-English data to enable cross-lingual transfer and an extended effective context window. G42 also released the model weights and inference code to the community, underscoring its commitment to advancing Arabic NLP and making high-performance Arabic AI accessible.