Pat,
I would use Universe 1 for all the LOR and DMX channels. Since you have the DMX already set (channels 1-183), then add an LOR entry with Universe 1 starting at 184 until the last channel for controller #5 (16 x 5 = 90). So you should have 274 total channels. Now some just use the full universe of 510 or 512 channels for the non-RGB controllers. That way you can 'reserve' additional channels should you need them later.
If you think you will add more DMX channels, then keep it simple with DMX - Universe 1 and LOR - Universe 2 and then start with Universe 3 with the RGB controllers. It all depends on the flexibility you want to have for growth.