Questions tagged [ckan]

The Comprehensive Knowledge Archive Network is an open source product from the Open Knowledge Foundation that provides data catalog capabilities.

Filter by
Sorted by
Tagged with
0 votes
0 answers
10 views

Install plugin to ckan package installation

Given that I have successfully installed ckan by following the instructions here: https://docs.ckan.org/en/2.8/maintaining/installing/install-from-package.html How would I go about installing this ...
user avatar
1 vote
0 answers
32 views

Making CKAN Postgres DB permanent on Cloud

We're working on deploying CKAN on Cloud using this docker-compose network. We're not storing any datasets but only publish URLs to data resources. We would like to stand up a permanent Postgres ...
user avatar
1 vote
0 answers
66 views

(How) can I use CKAN when data needs to be kept in place and only its data dictionary should be published?

Context I am investigating how I can set-up a data management system for a department of 100+ colleagues. Many of our datasets are stored (scattered is a better word) on different network drives, ...
user avatar
1 vote
0 answers
84 views

datapusher log shows `403 Forbidden` error every-time, while `Updating` resource files in CKAN

I'm using ckan 2.7.2 (Docker), Whenever I try to update any resource file (via GUI), Ckan is throwing an error i.e. 403 forbidden and data could not successfully upload to the DataStore. Because of ...
user avatar
  • 21
1 vote
1 answer
68 views

Download CKAN Revisions

Is there anyway to download revisions of data from a CKAN database? I have been able to retrieve a revision list, but it seems as though there is no way to download individual revisions. Here is the ...
user avatar
  • 113
1 vote
0 answers
25 views

package_search query parameters includes both keywords and tags

When I queried a data catalog using GUI https://data.noaa.gov/dataset/?q=fish&tags=California&sort=score+desc%2C+metadata_modified+desc it fetched 42 records. I wanted to implement the ...
user avatar
  • 11
1 vote
0 answers
10 views

While running ckan container, memory is increasing rapidly mainly because of `ckan_default` process

While I'm running Ckan container, memory is increasing rapidly mainly because of ckan_default process. Is there any way to limit the memory for ckan_default process? If yes, where it should be ...
user avatar
  • 21
1 vote
0 answers
279 views

How to access data from catalog.data.gov using API's?

I am new to APIs and am having problems in accessing data from catalog.data.gov. I have successfully used the below code to search my dataset of interest, but can't figure out how I can fetch the data ...
user avatar
1 vote
0 answers
104 views

CKAN : ValueError: VDM only works with SQLAlchemy versions 0.4 through 0.9, not: 1.1.2

Do I need to upgrade the package vdm to make it compatible with sqlalchemy version greater then 0.9? This is a CKAN question.
user avatar
  • 31
1 vote
1 answer
212 views

CKAN Hierarchy extension breaks the home page

I've installed CKAN from package on Ubuntu 16.04.5, following the documentation https://docs.ckan.org/en/2.8/maintaining/installing/install-from-package.html I've installed the scheming extension ...
user avatar
  • 21
3 votes
1 answer
269 views

Not able to view private datasets in CKAN using Nginx

I have installed CKAN v2.7.2(served under HTTPs using Apache web server),Nginx using docker. The task I am doing requires me to mount ckan on /ckan mount point, thus have added ckan.root_path = /ckan/...
user avatar
  • 43
1 vote
1 answer
215 views

Solr not working while running CKAN over HTTPs using nginx and apache

I am running CKAN v2.7.2 over HTTPs using Apache and have configured Nginx-reverse proxy to access CKAN.Thus,I am accessing CKAN using Nginx only. All the three components (CKAN,Apache,Nginx are ...
user avatar
  • 43
2 votes
1 answer
40 views

Alternation ("OR") searching

This seems like a trivial thing, but I can't seem to get basic alternation when searching for databases, eg. crime OR court. I briefly looked at the API to see if there was a way to do it through that,...
user avatar
1 vote
1 answer
701 views

How can we install CKAN on Windows using IDE?

I wanted to install CKAN using IDE such as Eclipse+ Pydev on Windows. Is there any documentation/Steps for the same ? How will we connect Apache Solr and PostgreSQL when using Eclipse + Pydev IDE ? ...
user avatar
  • 31
1 vote
1 answer
192 views

Can I use another database instead of PostgreSQL in CKAN?

After visiting the official documentation of CKAN, I was unable to find why are we using a PostgreSQL database in CKAN from its inception. Is there any way to use another database with CKAN?
user avatar
  • 31
1 vote
0 answers
238 views

What CKAN integration/plugins are available for connecting to Hortonworks/HDFS/etc.?

I'm curious as to what options are available for integrating CKAN with external data sources as well as external data catalogs specifically as it relates to: Hortonworks / Cloudera / Hadoop / HDFS / ...
user avatar
1 vote
0 answers
144 views

What kind of sources can integrate CKAN?

I would like to use CKAN in my company but firts I have some questions to solve yet. For example: What kind of sources can integrate CKAN? I explain myself firts. If my company has its data ...
user avatar
4 votes
1 answer
112 views

Are the API keys on data.gov considered sensitive?

To access the US data.gov public datasets, you need a CKAN API key. Should I consider this sensitive information, e.g. can anyone having my API key 'misuse' it so that it causes me harm, directly or ...
user avatar
3 votes
0 answers
107 views

Open Data platform from scratch [closed]

I am doing research on how to build an open data platform with a web portal and a REST interface without relying on a turnkey solution. I found different solutions: CKAN, Socrata, OpenDataSoft and ...
user avatar
1 vote
1 answer
232 views

CKAN - Find and add tags to multiple datasets can this be done?

I want to add a tag "Water" to any dataset that includes data "agua" Can I use the API to search, find and update all datasets that contain the search string "agua" to add a tag "Water"
user avatar
5 votes
1 answer
306 views

Versions of CKAN datasets and its resources

I am working on an analysis based on open data from a CKAN data store. For this analysis to be reproducible it obviously needs the exact same input dataset. I would hence like to make sure that a ...
user avatar
2 votes
1 answer
44 views

Official Help and Support on customising CKAN

Please, anyone knows how or where can I get quick support for issues I'm having with CKAN? I work for Argentinian Government and I'm in charge of launching a Open Data Portal for all the country ...
user avatar
3 votes
1 answer
131 views

Is there a way to ask a CKAN repository only for changed datasets after a certain time?

I am trying to harvest several CKAN repositories for their metadata, using CKAN REST API. I wanted to only update the changed datasets (metadata only) in my repository, but I do not see a way to ...
user avatar
3 votes
2 answers
202 views

CKAN Harvester Issues

I've been trying to set up a CKAN installation for use as a Caribbean open data portal for a few weeks now but I've been running into challenges when I try to set up the CKAN Harvester and import some ...
user avatar
1 vote
1 answer
398 views

Extract all data from ckan

I'm trying to export all data from CKAN instances for a big data project. How can I do this?
user avatar
  • 21
2 votes
0 answers
61 views

data.gov CKAN API ignores row parameter, returns duplicate results for different search terms

Using the data.gov CKAN api, this search via the web GUI returns 566 results: children However, post requests via the CKAN API returns 10 results despite the row parameter being set and, incidentally,...
user avatar
  • 121
4 votes
1 answer
133 views

data.gov Action API Parameters Seem to be Ignored

When I hit the "package_search" action API at data.gov, 26564 results are currently returned: http://catalog.data.gov/api/3/action/package_search?q=fish When I pass the "rows" ...
user avatar
1 vote
2 answers
506 views

Querying CKAN in Python using ckanapi

I used to query with ckanclient thusly: import ckanclient ckan = ckanclient.CkanClient('http://catalog.data.gov/api/3') search_params = { 'q': 'tags:"...
user avatar
4 votes
1 answer
371 views

CKAN - ckanext-scheming - Add dataset button

I've been following the instructions and the examples to configure ckanext-scheming extension (ckanext-scheming). I am able to access by URL to the different schemas (as the example shows) that I've ...
user avatar
3 votes
1 answer
62 views

How to exclude datasets with no data on datahub.io search?

datahub.io contain many datasets, but some of it marked This dataset has no data For example http://datahub.io/dataset/industrial-production-and-turnover-indices or http://datahub.io/dataset/esis ...
user avatar
  • 235
6 votes
1 answer
382 views

CKAN exposing tables from a relational database

I am using CKAN 2.3 and I would like to compose datasets considering a specific schema from a relational database. Indeed, I would like to publish the list of any table into CKAN in order to show ...
user avatar
2 votes
1 answer
51 views

Is there any way to get a package's resource's field names/datatypes with downloading the entire resource?

The CKAN <site>/api/3/action/package_show API provides a lot of metadata, but for tabular (row-column) resources I don't see any way to get the field names and datatypes other than by reading ...
user avatar
  • 171
4 votes
1 answer
496 views

Installing GeoJSON preview plugin on CKAN

I've managed to stand up a CKAN instance, and would now like to preview GeoJSON data in CKAN. According to the ckanext-spatial documentation, I don't need to install the full ckanext-spatial package, ...
user avatar
5 votes
1 answer
479 views

Custom Categories in CKAN

Is it possible to have custom dataset categories appear in the side bar of the 'datasets' tab in CKAN 2.2? HealthData.gov appears to have these categories, but most examples I see have the default ...
user avatar
9 votes
2 answers
2k views

How do I get a full list of datasets available on Data.Gov using the CKAN API?

I'm fairly new to python, but I've been struggling to get anything more than ten results from a package_list request from Data.Gov's CKAN API. Here's what I'm using: response = urlopen('http://...
user avatar
  • 243
6 votes
1 answer
204 views

The Data.gov organization_list CKAN API is not working

This file is supposed to be giving the JSON format of all the organizations present in Data.gov as per the CKAN API documentation. However, that file gives an HTTP 400 (Bad request) error. Is there a ...
user avatar
  • 61
6 votes
1 answer
807 views

How to download all datasets from a CKAN instance using the API?

I've already tried ckanapi's dump datasets but it seems it only downloads the metadata. Is there a command that downloads the datasets referenced in the download_url field? I can script a download ...
user avatar
  • 319
3 votes
1 answer
365 views

Is it possible to use CKAN for commercial use?

Does anyone know if it's possible to use CKAN for commercial use?
user avatar
7 votes
1 answer
1k views

What is a good Python CKAN Tutorial?

Where can I find some resources to help me learn how to write Python to CKAN (in this instance data.gov.uk) repositories? I've had some signs of life from bits of code that I've found, but would ...
user avatar
  • 171
9 votes
1 answer
1k views

CKAN database scheme

I'm doing some research and I would like to learn how CKAN manages data, in particular, I would like to learn its database scheme. Do you know where I can find it?
user avatar
18 votes
6 answers
9k views

CKAN vs. Socrata

CKAN is sponsored by OKFN and runs data.gov, so what would be the benefits of switching to Socrata? Negatives? I'm partial to staying in line with OKFN, but I admit that its completely biased and I am ...
user avatar
  • 11.8k
8 votes
1 answer
551 views

Geospatial, temporal and keyword search using CKAN API on data.gov using ckanclient

Thanks to this answer , I can successfully use the python ckanclient package to search data.gov for "sea_water_temperature": import ckanclient q = 'tags:sea_water_temperature' ckan = ckanclient....
user avatar
10 votes
2 answers
2k views

Catalog.data.gov using CKAN API with python requests package

I'm not sure if this is a requests issue, a CKAN API issue, or a catalog.data.gov issue. I can do this GET query: import requests import json r = requests.get('http://catalog.data.gov/api/search/...
user avatar
8 votes
2 answers
729 views

Difference(s) Between Datahub.io and CKAN

datahub.io is powered by CKAN, and as far as I can tell, seems like a watered down flavor, perhaps for a certain user base. The about page isn't very helpful..does anyone know the exact differences ...
user avatar
  • 11.8k
6 votes
2 answers
362 views

CKAN API questions

I'm looking to search Data.gov and using the CKAN API for this. as a start I want to do a simple text search like this one for environmental data. some questions related to this: It appears that ...
user avatar
22 votes
3 answers
2k views

What does CKAN stand for and what does it do?

I have seen this acronym a lot on this website, but I don't know what it means! The main header of CKAN.org claims, "the world’s leading open-source data portal platform". What is a data portal ...
user avatar
6 votes
3 answers
246 views

Restrict search to open datasets on CKAN's Data Hub?

The Data Hub, powered by CKAN, is an impressive collection of datasets available on the web. Currently it lists more than 6000 datasets — however, not all of them are available under an Open Data ...
user avatar
  • 5,806
14 votes
4 answers
778 views

Cost of ownership - CKAN for city/local government or small federal agency

What is average cost/effort to launch CKAN instance and what are operational expenses to maintain it going forward? (Assuming small size government with limited IT resources)
user avatar