Have you considered punting on the LM library entirely?
Ceres is almost uniformly better than what's there now, is heavily battle tested in production both large (Street View) and small (Android, in every Nexus 4), is BSD licensed, uses Eigen internally, has extensive sparse support.
It's not clear that Eigen dev's time is best spent working on LM when Ceres exists.