I'll let the pros give you helpful advice but I just wanted to welcome you to the forum. I hope you're able to make the bike more stable so you can enjoy it.
Hello and welcome! You may have better luck looking for batteries by posting in the Parts and Accessories forum but maybe others can chime in regarding the pedal gear and chain.