Yes go to Customizer > Front Page Content Settings and set it to “Hide Content”.
There will be a minor update to fix an issue where the sidebar shows up even when you have the content turned off on certain sites. That should be ready soon.
Let me know if that helps.