Yep, let’s use the Text Widget as an example.
If you leave the Text widget, but only delete the text inside of it, then the widget area will still show up on the homepage. If you remove the entire Text widget from that widget location then it won’t show up on the homepage.
