IMO the Modular toolkit for Data Processing (MDP) has a fairly good
and straightforward PCA implementation, among other good tools:
mdp-toolkit.sourceforge.net/

I have no idea what apt-get is, though, so I don't know if this will
be helpful or not!

-Rob