Objective: Atrial fibrillation (AF) is one of the most common serious abnormal heart rhythm conditions, and the number of deaths related to atrial fibrillation has increased by an order of magnitude in the past decades. We aim to create a system, which can provide help for cardiologist, classifying and highlighting important segments in recordings. Approach: In this paper, we propose a novel approach for AF detection using only a deep neural architecture without any traditional feature extractor for real-time automated suggestions of possible cardiac failures that can detect class invariant anomalies in signals recorded by a single channel portable ECG device. Results: Detecting the four categories: Normal, AF, Other and Noisy in terms of the official, F1 metric of hidden dataset maintained by the organizers of PhysioNet Computing in Cardiology Challenge 2017, our proposed algorithm has scored 0.88, 0.80, 0.69, 0.64 points respectively, and 0.79 on average.