You're not putting it in the mp3 player though so what's the point. Be better off just buying a phone to play music. You'd look some sight carrying around a ten quid mp3 player around with a mobile phone battery hanging out of it.
The battery is still connected to the device's mobo. It just extenal to the unit's casing so the charging mechanism is still the same through the normal charging port