If you're realllly worried about it, you can get an aftermarket cooler for pretty cheap. I got my Xigmatek Gaia for $5 after rebate, slapped a couple $8 120mm fans on it, and my overclocked AMD A8 (not exactly a cool-running processor even at stock speeds) under load runs about 25-27C, idles at 22C. With the stock cooler at stock speeds it idled at about 35C and got up to around 50C under load, as far as I remember. Might be a decent option for you if you want to go that route, but as everyone else said, you're perfectly fine as-is.
ASRock A55 Pro3, AMD A8 x4 3850 @ 4.7 + Xigmatek Gaia, Thermaltake V3 Black Edition, 8GB DDR3/1600, HIS 6870 1GB, 620W PSU, 500GB HDD, 250GB HDD, 3TB HDD, Logitech x530 5.1