Motivated by the fiscal imbalances in the EU countries in the recent period, this paper analyzes the effect of national fiscal rules on fiscal discipline. Using a careful definition of national fiscal rules combined with a novel measure of fiscal discipline (the Global Financial Performance Index-GFPI), propensity score matching estimations that account for potential endogeneity reveal that fiscal rules significantly improve the GFPI. However, this favorable effect dramatically depends upon the type of fiscal rule and different structural factors. These two features, together with alternative measures of fiscal discipline, are found to be key ingredients that should be taken into account when assessing the effects of fiscal rules on fiscal discipline.