It already held a record as the first book printed in English in North America. Now it holds two: It is also the most expensive book ever sold at auction.

The little volume of psalms, one of only 11 known to exist out of roughly 1,700 printed by 17th-century Puritans in Massachusetts, went for $14,165,000 at auction on Tuesday.

The buyer of the Bay Psalm Book, as it is known, was David M. Rubenstein of the Carlyle Group, an investment firm in Washington. Mr. Rubenstein has bought a number of historical documents in recent years, including a copy of Magna Carta for $21 million in 2007 (or $23.7 million today, adjusted for inflation)....