The US census bureau published annual volumes in its series "Vital Statistics of the United States" between 1890 and 1930.
Each report is available as a pdf here: https://www.cdc.gov/nchs/products/vsus/vsus_1890_1938.htm
Has anyone digitized these records?