Early wildfire smoke detection faces challenges such as limited datasets, small target sizes, and interference from smoke-like objects. To address these issues, we propose a novel approach leveraging Efficient Channel and Dilated Convolution Spatial Attention (EDA). Specifically, we develop an experimental dataset, Smoke-Exp, consisting of 6016 images, including real-world and Cycle-GAN-generated synthetic wildfire smoke images. Additionally, we introduce M-YOLO, an enhanced YOLOv5-based model with a 4× downsampling detection head, and MEDA-YOLO, which incorporates the EDA mechanism to filter irrelevant information and suppress interference. Experimental results on Smoke-Exp demonstrate that M-YOLO achieves a mean Average Precision (mAP) of 96.74%, outperforming YOLOv5 and Faster R-CNN by 1.32% and 3.26%, respectively. MEDA-YOLO further improves performance, achieving an mAP of 97.58%, a 2.16% increase over YOLOv5. These results highlight the potential of the proposed models for precise and real-time early wildfire smoke detection.