Rated 4 out of 5 stars

ChmFox is a modification of CHM Reader and it supports Firefox 4:
https://addons.mozilla.org/zh-CN/firefox/addon/chmfox/