Once you have done this you need to change extension B config.xml file commenting out the conflicting <rewrite> blocks that are now inheriting from A.

You will also need to identify any conflicting phtml files and merge the files into one phtml file incorporating all of the functionality of the multiple files. This means you will also have to edit any related layout xml files to point to the new merged phtml file.