If you're using bp-default then you can edit bp-default/activity/entry.php
to display the comments only on the full activity item page - I do believe this page is referred to as the activity 'permalink' or the 'single activity' page.
Wrap the comment output in a conditional check like this:
if ( bp_is_single_activity() ) {
// comment output
}