Uploading a file from url

[LekanAnni]

I get errors trying to upload file into CKAN using resource_create from URL with the below

from ckanapi import RemoteCKAN
ua = 'ckanapiexample/1.0 (+http://example.com/my/website)'
fileurl = "http://goog.com/go/file.csv"
mysite = RemoteCKAN('http://myckan.example.com', apikey='real-key', user_agent=ua)
mysite.action.resource_create(
package_id='my-dataset-with-files',
url='dummy-value', # ignored but required by CKAN<=2.5.x
upload=open(fileurl, 'rb'))

[wardi]

That's not a file, it's a url. Try urlopen() instead.

[wardi]

(or just set the url on the resource instead of uploading the file if that's what you prefer)

[LekanAnni]

Thanks Wardi, i tried the urllib2.urlopen(file), this works fine but the problem here is that its not getting the filename so CKAN cant view the resource.

[wardi]

You can set a file name explicitly by passing a tuple, e.g. upload=('myfilename.csv', urlopen(url)) This is borrowed from requests http://docs.python-requests.org/en/latest/user/quickstart/#post-a-multipart-encoded-file but works even if you're using LocalCKAN

[LekanAnni]

	 r = requests.post('http://ckan.org/api/action/resource_create',
                            data={'package_id': package['id'],
                            'name': resourcename,
                            'description': 'some text',
                            'format': extension,
                            'url': 'upload',  # Needed to pass validation
                             },
                      headers={'Authorization': APIKEY},
                     files = {'file': (filename,urllib2.urlopen(pkg_url) )})  

                 # This makes ckan url shows `http://upload` but when i change the filename to "upload", it shows URL: http://ckan.org/dataset/b9f4caa1-be5e-4a02-939e-282acce47306/resource/87211539-e543-412e-bf9a-90084f3a55cb/download/upload 

(without linkage to the file)

[wardi]

your code looks wrong.

files = {'file': (filename,urllib2.urlopen(pkg_url) )}
          ^ this should say 'upload' because it's the field name

filename is where you put your file's name

[LekanAnni]

Thanks wardi, i got it working now.