You can start the provider whenever you want. It should be able to add and remove devices on the fly.

In the future, the DM interface will allow you to exclude devices from being seen by users of the DM. It will also allow you to retype some devices ie a light to an appliance etc.