Yes, you can make a video with no musical background. Just select the 'Remove Music' option available just below the 'Change Music' button, in the page to add media content. Or, change the music preference to (No Music) Mute from the Picovico audio library.
