I just put the folders of client side javascript libs into my app/scripts/vendor folder and reference them to load in the index.html
Make sure you put the script tag inside these comment blocks
<!-- build:js scripts/scripts.js -->
and
<!-- endbuild -->
in order to have them minified and merged into one script file on build.