The article at http://support.microsoft.com/kb/2664150/en-gb provides a script for cleaning up the principalobjectaccess (POA) table in CRM 2011.
It seems that prior to CRM 2011 UR6 when records were deleted related records in the POA table were not removed.