Aveiro method is a sparse representation method in reproducing kernel Hilbert spaces, which gives orthogonal projections in linear combinations of reproducing kernels over uniqueness sets. It, however, suffers from determination of uniqueness sets in the underlying reproducing kernel Hilbert space. In fact, in general spaces, uniqueness sets are not easy to be identified, let alone the convergence speed aspect with Aveiro method. To avoid those difficulties, we propose an new Aveiro method based on a dictionary and the matching pursuit idea. What we do, in fact, are more: The new Aveiro method will be in relation to the recently proposed, the so-called pre-orthogonal greedy algorithm involving completion of a given dictionary. The new method is called Aveiro method under complete dictionary. The complete dictionary consists of all directional derivatives of the underlying reproducing kernels. We show that, under the boundary vanishing condition bring available for the classical Hardy and Paley-Wiener spaces, the complete dictionary enables an efficient expansion of any given element in the Hilbert space. The proposed method reveals new and advanced aspects in both the Aveiro method and the greedy algorithm.