Accessed in Appearance → Customize → Custom Sidebars.
Here you can create custom sidebars. Later you can set them to be displayed in pages. If you wish, each page can have own sidebar!
To add sidebar simply add its name and click Save Changes. After you add new sidebar you can manage it in Appearance → Widgets.
