19
This question was previously answered for non-profits, and I think the same answer works here at least partially.
In addition, you can find all U.S. companies at the Securities and Exchange Commission's EDGAR site. Technical documentation is also available.
Information about Canadian companies is accessible through their open data site, but seems to be ...
12
Full disclosure: I am a GSA employee and the Tech Lead for FBOpen, a website and API for search and discovery of federal business opportunities.
There is indeed both bulk data and an fbo.gov API available, although I can only offer experience with the former. There are two different versions of the bulk FTP downloads, weekly files and nightly files. These ...
10
Dataset 1:
Wikipedia Releases Clickstream Data
Wikipedia has released a data set of clickstream data for January 2015. A clickstream is the path a user requests to get to a desired web page or article by using a referer—clicking on a link or performing a search. The dataset contains 22 million referer-article pairs from the English language, desktop ...
9
The Health and Retirement Study (HRS) is a longitudinal panel survey which includes job satisfaction questions in one of its modules. It primarily focuses on tracking US individuals 51 years and over.
The GSS also has a few questions on job satisfaction.
8
NOTE I'm not a lawyer and this is only a suggestion, please do consult a professional.
I've been in your shoes before, If you're willing to compromise precision for the sake of completeness in terms of the number of businesses, I would suggest scraping yellow pages and/or sites like yelp.
There has been a long debate over the legality of this type of data ...
8
This CSV dataset contains opening-closing hours for thousands of US hotels/restaurants/bars/museums/etc:
https://github.com/baturin/wikivoyage-listings/
Business type, name and location are included as well.
You will need to filter out:
Businesses that have no documented opening-closing hours
Businesses that are not in the USA (there are columns for city ...
7
NASDAQ provides a CSV dataset for all corporations traded on NASDAQ, AMEX and NYSE. You can get some basic information on these publicly traded companies from the datasets.
http://www.nasdaq.com/screening/company-list.aspx
Below is a link on our OpenGeoCode website where we've downloaded the datasets and converted them to our CUDE CSV format.
http://www....
7
The answers to the question on open data stories might also be useful to you. I've summarized some of those and added some more (courtesy of Anastasios Ventouris, pattern-recognition, Charles Worthington, Alisha Green, Taal, tobip, fgregg, Diabolus, Rebecca Williams)
The Open Data 500 is a collection of 500 companies that have built a business model on ...
6
I doubt that this exists. Lexis-Nexus provides access to US Federal Tax ID info (FEIN), but I imagine there are license restrictions. Public Companies are required to file much of this info and it should be available via the SEC Edgar interface. GuideStar provides access to nonprofit 990 data (which would include much of what you are looking for EIN data but ...
5
Can't comment so sharing advice in an answer: Can you be more specific about what type of location data?
If every type of category, you're probably best using APIs/licensed data from the likes of Infochimps, Google Places, Yelp, Foursquare, etc.
If you're doing something smaller scope like hospitals and clinics or maybe gas stations, you can probably find ...
5
I've only came across one dataset that contained the seating capacity. It is the restaurant inspections for Seattle and King County:
http://info.kingcounty.gov/health/ehs/foodsafety/inspections/search.aspx
5
indeed.com has a résumé site (but unfortunately no API like the main job site). You can build URLs with search terms:
http://www.indeed.com/resumes/data-science
With these HTML pages you can find individual CVs, i.e. link. You can search by country by using the same structure, just replace the .com domain with another (i.e. indeed.de/resumes)
The HTML for ...
5
The only thing that is available right now on Linkedin is the skills from a certain user and not the endorsements. And in order to download the skills, users have to log in with auth. Unfortunately, you will not find any complete list of skills from Linkedin.
If you want to download the skills from a certain user, here is the code for python using this ...
5
A popular answer comes from a 2010 question on Stackoverflow - Source Link
Northwind database - (documentation & data model)
NopCommerce sample dataset
E-commerce dataset from Amazon / Google Products / Abt Buy
Other ideas:
Tableau Superstore (Excel file) (although I think this is aggregated)
4
Also, be sure to check free database records usually compiled by each Secretary of State in each of our 50 states. All businesses who incorporate in each state can be found there.
I often use Georgia's Secretary of State incorporated business database. You just have to get creative with the keywords you enter.
4
One thing you can do is to download the open source datasets of every city (most large cities in north america offer such datasets on their websites), they usually have datasets of business licenses issued which has a lot of info associated with them. I hope this can be starting point.
4
I would look into Google Places API for this. You have to register for an API key and the quota is limited to 100,000 requests a day (plus some multipliers on some requests), but it's a rather verbose database.
Example:
Here is a request URL to get all "food" places within 500m of the specified latitude-longitude that has the word "harbour" in it:
https://...
4
This may be for only an old version (4.1), but...
ClickStream Example Database Wayback Archive
Example Database File Locations
The example databases are installed in:
/opt/vertica/examples/ClickStream_Schema
Update: Download instructions (link denied due to registration)
4
As an aside, all British Company data is available at Companies House via the web interface or via CSV files:
http://download.companieshouse.gov.uk/en_output.html
4
Foursquare provides a location layer, check it out.
https://developer.foursquare.com/overview/venues
4
....linkedin..pretty sure its one of their main reasons for being. you can play with their api and access users resumes.
i'm not sure if they offer full access or what, but you could just suck down as many as possible per setting, saving them...
not sure, but elance probably has one as well;
if there's not an open source one, find a huge slab of web data ...
4
Restricting to US businesses, this research is the most complete
http://www.opendata500.com/
It lists a lot of companies with the kind of data they use.
4
Just off the top of my head, not counting the various companies doing scientific research:
USGS maps : used by resource exploration (eg, oil) companies, travel expeditions (canoe / hiking trips)
National Weather Service data & forecasts : used by airlines, farmers, power companies, insurance companies, most companies that have people working outdoors
...
4
Probably the closest thing you'll find to this is OpenCorporates. They claim to have data on over 60,000,000 companies.
They don't have a download, but there is an API. It has a mixed usage license depending on whether you are contributing open data back to the community.
4
I think no such dataset exists. However, there might be some roundabout ways of approximating that information.
Here's a Yelp query for reviews that feature the phrase "self checkout" in the Boston area. You can see both mapping and also the metadata that the results are "1-10 of 97" and you can select specific establishments. You can mirror this query ...
4
Here are some more interesting ones:
The Ropes at Disney (1943)
Interestingly constructed with a rope going throughout the document; women at the time had 10 sick days and men only 5.
Steam (2012)
A fun read on the flat organization front and approach to employee development.
The Motley Fool
Website designed for easy policy information dispersal.
Big ...
4
You can use the SIRENE database, maintained by INSEE, part of the French government.
It is the official companies database, and has about 10 millions. It is updated everyday.
It used to cost money, but now it is free:
http://www.sirene.fr/sirene/public/accueil
The database can be downloaded, or browsed online.
For each company, you get:
Name
SIRENE and ...
3
Wikimapia has plenty of business locations datasets. And as I know, they have an API to use.
Here is the website of the Wikimapia API and here is an example of the output when you search by a specific area.
3
I doubt that it exists and, if it does, whether it should: after all CVs are personal data.
Perhaps you can contact the authors of this study:
Are Emily and Greg More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination
They might be willing to share their dataset of fictitious resumes.
3
Kaggle once conducted a competition with 22GB of real transaction data:
http://www.kaggle.com/c/acquire-valued-shoppers-challenge/data (registration required)
But look after the terms of use (only for the purposes of competition) and so on.
Only top voted, non community-wiki answers of a minimum length are eligible