I have a question and Googling doesn't really give me a concrete answer so I'm hoping someone on here could explain this to me. I have an idea for an app/website and it needs access to a large database. If we use plants as an example, my app would need access to plant names, color, where it is found, how to treat it, etc. etc...

My question is, when developing an app such as this, how would you get all the data about the plants into a database that you have access to (or better, my own database)? I read that there are companies that already have this information that others can use, but I also read that it is a security risk if a company was to let you have access to their data (which is obviously true). I'm just curious on how startup companies get all this data into their database without having to manually type all of the information about each plant because there are tons and tons of them.

If someone could please explain to me how this works I would greatly appreciate it. (I taught myself SQL/MySQL/Java/HTML/CSS/C#/C++ and I don't really have a mentor/instructor to ask this question). If I wasn't concrete enough in my question, please let me know and I'll try to change it.

Thank you!!

  • If you're asking how to get a large amount of data into a database, you should probably ask Stack Overflow. If your question is whether to use your own data or use a 3rd party provider of data, that's a more appropriate question for this group, although you'll probably have to be more specific. – RCA Jul 15 '15 at 19:19
  • @rcackerman My question is in regards to a 3rd party provider of the data since there is a lot of it. My thought was to use the data from another provider and put it into my own database, I'm not sure if I can access another database for this data. Either way, the actual data is not my own. – MB41 Jul 15 '15 at 19:22
  • Without more specific information about what you're doing, this isn't an answerable question. Can you re-word to make it clearer what you're trying to do and what you are struggling with? – RCA Jul 15 '15 at 19:25
  • @rcackerman I'm asking how do you get access to a large database, such as a database containing all of the plants information, or maybe even information about different books? How do start up companies come up with this information? – MB41 Jul 15 '15 at 19:43
  • In other words I guess, if you were to make an app about different kinds of plans and you need a database to store that information so that your app can access it, how would you get the information to put into your database? If you do it manually, it would take forever. – MB41 Jul 15 '15 at 20:22

There is not, as yet, a comprehensive and central resource for finding datasets. Many datasets are available for free (1); access to other datasets (or databases) may be purchased (2); and still more data can be collected by you (3).

  1. When I'm not doing something for my job, most of the data I use is free. A lot of large online services give API access to their data: Google maps and directions, Amazon, Twitter...many, many large companies and websites you use regularly. Many governments also provide data for free, e.g., the the US Government's Data.gov. Check out Project Gutenberg, too.
  2. Many of the previous type of data can also be upgraded for better services. There are a lot of private databases and data sources, too. Academic databases and private data in general are private data that you need permission to access or that you must pay to have access to.
  3. Companies also generate their own data, too. Netflix and Amazon base their recommendations on how people rate movies or what people buy on their websites. Maybe Netflix would have used something like IMDB (which could be accessed by API) or similar when first starting out. A free data source would be information on the music people have listened to, e.g., from Last.fm. But the data was collected by Last.fm originally.

In my experience, it is unlikely that you will be granted direct access to someone else's database. More likely is that they will use an API, where you can access specific pieces of data from your own program. If you need a lot of data, you can purchase it, but often starting a larger project can be done with creative uses of data that is available for free.

  • That you for all this wonderful information, you answered my question all in one post! I'll do some research because I need a database for all common flower plants for houses. – MB41 Jul 17 '15 at 20:28
  • 1
    try the plants database via usda plants.usda.gov/java – albert Jul 17 '15 at 21:51

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.