I'm looking for complex datasets for performing a comparison on machine learning in the cloud solutions such as Amazon Machine Learning, Microsoft Azure, IBM Watson, Google Prediction API, Rapid Miner and some others.
In particular I will try the blackbox prediction (and/or classification) capabilities offered by some of these systems, and compare it with state of the art results. SaaS such as Google Prediction API say they can pick the best algorithm for our problem; I'm analyzing how well do they perform in order to compare them with the closeness to state of the art results and some other further analysis.
It's hard to define complexity for this case, however I'm looking for datasets that have available results for at least 3 different algorithms, and where at least 1 has shown considerably bad performance (e.g. accuracy or error) in comparison with the best one. Size of the dataset will not be an issue. Following this idea complex would mean that there exists bad performing typical approaches that are considerably worst performing than the best solution.
Where should I look for that can have multiple algorithm results both well and bad performing? Any datasets recommendations?
PS: Naturally I would need datasets for supervised learning.
