GPT-4 introduced mixture-of-experts architectures that activate only specialised portions of a network for a given task. This resembles the brain’s selective recruitment of different regions
AI and the brain: similar in scale, different in design
GPT-4 introduced mixture-of-experts architectures that activate only specialised portions of a network for a given task. This resembles the brain’s selective recruitment of different regions
