In the modern railway superstructure construction and maintenance, particularly where higher speeds are required, the rail sections may be welded together to form Continuous Welded Rail (CWR). There are various methods for welding the rails, such as thermite welding, flash-butt welding, gas-pressure welding, enclosed-arc welding, etc. Narrow Gap Welding is another way of welding the rail joints and because of the lower implementation costs, easier, quicker process and acceptable performance, it is usually used over other methods in maintenance operations. Since this method is newer than others, there is lack of knowledge concerning the standard process of narrow gap welding and the factors that affect the final quality. In the narrow gap welding, two different welding electrodes are used for the welding process. One electrode, with higher stiffness, is used for the rail head and the other electrode, with lower stiffness, is used for the rail web and foot. In this research, the relationship between these different welding electrodes and the amount of stress in rail joint was investigated via experiments and modeling, by a finite element method. The results indicate that the number of stresses, in the junction of rail head and web, was reduced by 37%, when the electrode with higher stiffness was used for the whole rail head, plus 1 cm of rail web. Field investigations demonstrated that the performance of rail welds was acceptable.