Taking even a single penny from a grave stone is one of the most disrespectful things you can ever do!
There's actually a very special reason why those coins were placed on that particular grave site.
According to many sources, a coin left on a headstone lets the deceased soldiers family know that somebody stopped by to pay their respect.