I would take a blind guess and say that moving attachments out of the database will definitely make things go faster, yeah. Filesystem access is definitely going to be faster than a database query, but how many orders of magnitude faster, I couldn't say.
