Indeed, that's a rather simple approach, but your experiment shows it's worth the minor effort. Since all matrix decompositions follows the same API, this can probably be implemented only once for all in Solve.h with compile-time checks on the number of columns to completely remove omp code for vectors. Patch welcome! You can see a usage of omp in Eigen there:
Here, we have to be a bit more careful because Eigen might attempt to parallelize nested matrix-matrix operations, so we need to make sure that it does not. This currently happens there:
I'm not omp-expert enough to provide good advice on this matter, but as this must be a classical omp issue, there must be classical solutions too!
gael