5

The pdftotext library (man page) that comes standard with most linux distros and can be installed on Windows contains a -layout flag that preserves table structure. pdftotext -layout input.pdf output.txt After that, you can easily parse with any language into your desired JSON structure. There is a python wrapper for pdftotext, but as far as I know, it ...


4

Some tips for scrapers: log: don't stop at "sometimes I get data and sometimes I don't" -- when you get unexpected results in the response, log it so you can learn what happened. Specifically when you are being throttled for making too many requests, you will often get an explicit message saying so. cache: write your code to save files you retrieve and use ...


4

You may get better answers on CodeReview, but just glancing at your code I have one suggestion that is to split the codes into a scraping and parsing steps. This will help with reproducibility and also by decoupling the steps you can easier debug. Scraping - the goal should be to save HTML files saved on the disk with names describing what they are and when ...


4

Within the constraints of using the bot tools that Open Corporates provides, I'm not sure what to suggest. However, since people will no doubt get here based on more general searches, it's worth pointing out the excellent Tabula, which provides a GUI for defining regions to scrape, algorithmically recognizes columns in those regions, and which can also be ...


3

Aswath Damodaran, Professor at Stern School of Business at New York University, has been compiling information on major corporations since 1998. His EU dataset contains data on 6,000 EU public corporations, including those in Germany. http://pages.stern.nyu.edu/~adamodar/New_Home_Page/data.html Quandl has free datasets on current and historical stock ...


2

That's a great question. Seems like the data itself is under an open license but the company charges for API access to it, presumably for the effort they've gone to consolidate the data and for running the API service. See the legal info https://opencorporates.com/legal/licence and in particular the "The OpenCorporates database" section of the page. ...


1

OCBC - A NEW MODELING LANGUAGE Order to cash (OTC or O2C) business process which is a very typical business process that involves receiving and fulfilling customer requests for goods or services. You can download this case study dataset from the Direct Download Link


1

There is a Firmenbuch in Austria which officially registers all businesses. Unfortunately, retrieving data from that register is not for free. Take a look here, and you will see a price list after your search query. (If you know German, there are more information about the Firmenbuch here at the Republic of Austria's Unternehmensserviceportal.) If you are ...


1

the correct form of consulting data officers from API Open Corporates: https://api.opencorporates.com/v0.4/companies/us_fl/L08000108987?api_token=Your_API_Token URI: Base -> https://api.opencorporates.com/v0.4/companies/jurisdiction_code/company_number?api_token=Your_API_Token


1

https://offeneregister.de provides basic German company information (companies and their officers) collected by OpenCorporates mainly in the period from June 2017 to January 2019, mainly from the Handelsregisterbekanntmachungen and to a lesser extent the Handelsregister (search results listings) for over 5,000,000 companies.


Only top voted, non community-wiki answers of a minimum length are eligible