http://www.ifixit.com/cart/catalog/product_2283_iPod_Mini_Replacement_Battery.html
You can buy the battery from anyone you want and follow their guide. They have good guides for most portable Apple devices.
You could also buy a new screen from them for the 5G, but if more than the screen...