The U.S. government publishes a range of finance data sets (see, e.g., www.Treasury.gov/financedata). What additional data sets that the government already collects would be valuable if released in open, machine readable formats?
Edit: Disclaimer: I work at Treasury, which publishes www.treasury.gov/financedata and is involved in open data in the finance sector.