Just install your theme, place desired widget on the sidebar and the default widgets will go away. If you don't need the sidebar you can remove it under Sidebar Tab>> Layout.
Sidebar menu won't appear until you configure it under Appearance>> Menu from your Wordpreses admin panel.