Hi Ignis, I do round headed rivets in fine silver, sterling and copper (edit: Oh yeah! Gold too, lol!). I use two things to support the ball as I'm riveting- a hockey puck or a piece of pine. Either will support the rivet head without leaving marks on it. The little hole in your anvil might mash up the head.
Hope this helps.