Best way to import users, post and categories from an external database

Question

I need to migrate an existing website to WordPress. This website already has a basic database containing users and posts (with a category), but it also has a high number of records so it's not possible to do it manually.

What is the best way to import them into my WordPress database? Should I try to export the old one into a CVS file or something similar?