Cloud Computing and Internet of Things (IoT) are popularly intertwined to create a network of smart systems, especially in the field of Agriculture. As agricultural industries rise, augmented use of heterogeneous communication and sensing on the field would be needed. For all this data to be transferred and processed on the cloud efficiently, low latency rates, consistently high bandwidths, minimal congestion, etc. would be needed, which, is still a complication with the current cloud computing models. This paper proposes a multi-layered fog architecture that detects outliers in the data received from the sensing environment based on three categories: Classification, Isolation, and Clustering and then aggregates it before sending it to the cloud. The architecture works closely in a user-centered design approach that connects the farmers and analysts to the fog allowing them to create an automated agricultural system. With the help of Fog, processing abilities are brought closer to the data source which reduces the load on cloud resources, thereby making the overall system a lot more efficient and secured. This paper also presents a prototype of the interface that can be used to monitor and control IoT devices on the field as well as define fuzzy rules for the agricultural system.