While Autism Spectrum Disorders (ASDs) are developmental in origin little is known about how they affect the early development of behavior and sensory coding, or how this is modulated by the sensory environment. The most common inherited form of autism is Fragile X syndrome, caused by a mutation in fmr1. Here we show that zebrafish fmr1-/- mutant larvae raised in a naturalistic visual environment display early deficits in hunting behavior, tectal map development, tectal network properties and decoding of spatial stimuli. However when given a choice they preferred an environment with reduced visual stimulation, and rearing them in this environment improved these metrics. Older fmr1-/- fish showed differences in social behavior, spending more time observing a conspecific, but responding more slowly to social cues. Together these results help reveal how fmr1-/- changes the early development of vertebrate brain function, and how manipulating the environment could potentially help reduce these changes.