In this paper, we focus on whether the urban infrastructure, such as road, education, telecom, etc, has a positive firm productivity improving effect by using quantile regression. This research bases on China’s industry micro-level data set from 2002 to 2007 and urban cities infrastructure data. It shows that road and telecom have a negative effect on firm productivity. Secondary education infrastructure has positive effect on all firms. However, the higher education infrastructure only positively affects medium efficient firm. The medical infrastructures will only affect high efficient firms. The robust test with different ownership type sample shows that ownership will significantly affects firm’s productivity. This paper shows that the optimization of infrastructure structure improves its marginal promotion effect on firm productivity.