Timeline for Method to download whole data directory from UCI ML repository
Current License: CC BY-SA 3.0
8 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Oct 25, 2017 at 1:01 | comment | added | Frames Catherine White |
I'm using Julia, and in julia we have a bunch of great HTML parsers. But I am trying for minimal dependencies. Sure generally parsing HTML is bad because HTML is non-regular. But any finite set of documents is regular. And the format of the UCI pages is consistent (it is generated by apache) and don't do anything like include href=".*?" in the body or in comments. I'm not super happy about it though. So maybe just downloading wget.exe from somewhere is best
|
|
| Oct 24, 2017 at 7:24 | history | edited | philshem | CC BY-SA 3.0 |
added python wget library
|
| Oct 24, 2017 at 7:22 | comment | added | philshem | see here for getting standalone wget.exe with no libraries or dlls -- superuser.com/a/245567/442118 | |
| Oct 24, 2017 at 7:15 | comment | added | philshem | what programming language are you using? using regex to parse html is usually not advised (joke: blog.codinghorror.com/parsing-html-the-cthulhu-way) | |
| Oct 24, 2017 at 2:11 | comment | added | Frames Catherine White |
I'm not keen to use wget (or curl), because they don't tend to come with windows and adding it as a dependancy would be too heavy weight. Looking at wget, it included a 1200 line HTML parser for this purpose.I could do something evil by invoking powershell shenanigans in windows to do a --recursive but then it would break on all kinds of different windows setups. Or I could use a Html parse of my own (but that is a dependency). This might be a time when parsing HTML with regex is good enough...
|
|
| Oct 23, 2017 at 12:36 | comment | added | user4293 | Indeed, it looks like vacuuming archive.ics.uci.edu/ml/machine-learning-databases gives all datasets. | |
| Oct 23, 2017 at 12:24 | history | edited | philshem | CC BY-SA 3.0 |
merged answers
|
| Oct 23, 2017 at 12:15 | history | answered | philshem | CC BY-SA 3.0 |