The battery should be checked with a load tester, not a voltmeter.
If you can, bring the alternator to a starter/alternator rebuild shop that would be best. The problem with the alternator (if there is one) is probably either brushes or a diode. There are 6 diodes in the full wave bridge...