When installing Wordpress via the installer, it complains that only alphanumeric characters may be used for the database name. It won't let you continue with an underscore in the DB name.
It should allow underscores since my_database is a perfectly common and acceptable mysql db naming convention.