Verify that only one of the WorkerRoles has "Microsoft.WindowsAzure.Plugins.RemoteForwarder.Enabled" setting in the service configuration. If both of them have this setting I believe the plug in will attempt set up the endpoint for both of them. You only need one of the roles to serve as a remote forwarder. From there it tunnels the remote access to any of the other roles that have the Microsoft.WindowsAzure.Plugins.RemoteAccess.Enabled set to true.
If this is the case it should be giving you an error if you attempt to package or publish.