In Firefox 3 you can access the two new views by opening the Library. To get there go to Bookmarks>Organize Bookmarks. From there you can toggle the view with the 3 buttons to the left of the search box or from the View menu.
This extension will take previews of your pages whenever you visit or add a bookmarked page. When you first start you will be able to have the extension create previews for you in the background. You can also perform this task later by Choosing 'File>Create Previews' in the Library/Bookmarks Organizer.
By default bookmark previews for https are disabled. You can enable those and toggle previews in the tooltips of the sidebar from the options window.
See the homepage for more info http://bookmarkpreviews.mozdev.org
Note: I hope to add support for Firefox 4 once it reaches the RC stage and I am able to find more time to work on this project. Sorry it did not work with Firefox 3.6.