The file contains 10 million user names and passwords. I want to analyze the data, but it seems a unwieldy. I tried to use Excel 2003 but it maxed out at 65k rows. LibreOffice Calc maxes out at 1 million rows.
I wanted to create a Pivot Table after the data is loaded, but not having much success.
Some results I want to see:
- Count of most common passwords
- How many passwords are all lower, upper, numeric, or special characters only
- What is the password structure in terms of containing upper, lower, numeric, special and their placement in the password.
It seems if I want to perform analysis, I need to get the data into some sort of database and be able to run functions and queries against the data.
How do you analyze 2 columns with 10 million rows?