The process to install a custom script is same as installing a default script like WordPress.
But as you said that your custom script is not listed by the "list_installed_scripts()" function it means that you have not added the custom script to Softaculous. You may refer to the following guide on how to add a custom script :
http://www.softaculous.com/docs/Adding_Custom_Scripts