In this paper, we consider a two-point boundary value problem with Caputo fractional derivative, where the second order derivative of the exact solution is unbounded. Based on the equivalent form of the main equation, a finite difference scheme is derived. The L convergence of the difference system is discussed rigorously. The convergence rate in general improves previous results. Numerical examples are provided to demonstrate the theoretical results.