ckanext-deadoralive demo

README.markdown

Idea: ckan/ideas#65

Extension: https://github.com/ckan/ckanext-deadoralive

Service: https://github.com/ckan/deadoralive

Broken dataset: http://sweden.staging.ckanhosted.com/dataset/org_0_dataset_2

Broken resource: http://sweden.staging.ckanhosted.com/dataset/org_0_dataset_2/resource/32be1f07-4b48-4164-ab55-879cbf02fa20

Working resource: http://sweden.staging.ckanhosted.com/dataset/livsmedelsdatabasen/resource/6df185e8-9f0a-4e38-afa0-3628ba5e4d9f

Report: http://sweden.staging.ckanhosted.com/organization/broken_links

Report: http://sweden.staging.ckanhosted.com/ckan-admin/broken_links (sysadmins only)

Future: ckan/deadoralive#1

future_protocol.markdown

Link checker                                                     Client site
                 <----------------- Please check these links: -
                                         [<id_1>, <id_2> ...]
                 - 200 OK ------------------------------------>

                 - What's the URL for resource <id_1>? ------->
                 <---- The URL for resource <id_1> is <url_1> -  (Gets URL from db)
(Checks <url_1>) - Resource <id_1>'s URL is broken ----------->  (Saves result)

                 - What's the URL for resource <id_2>? ------->
                 <---- The URL for resource <id_2> is <url_2> -  (Gets URL from db)
(Checks <url_2>) - Resource <id_2>'s URL is broken ----------->  (Saves result)
                                ...

Install.txt

pip install ckanext-deadoralive
Add deadoralive to ckan.plugins in config file
Create a user for the link checker
Add ckanext.deadoralive.authorized_users to config file
Restart CKAN
pip install deadoralive
deadoralive --url ... --apikey ...
Add cron job

protocol.markdown

Link checker service                                            Client site
deadoralive                                                     ckanext-deadoralive
                - Give me up to 50 resources to check ------->
                <-------------------- [<id_1>, <id_2>, ... ] -  (Gets resource IDs from db)

                - What's the URL for resource <id_1>? ------->
                <---- The URL for resource <id_1> is <url_1> -  (Gets URL from db)
(Checks <url_1>) - Resource <id_1>'s URL is broken ----------->  (Saves result)

                - What's the URL for resource <id_2>? ------->
                <---- The URL for resource <id_2> is <url_2> -  (Gets URL from db)
(Checks <url_2>) - Resource <id_2>'s URL is working --------->  (Saves result)

                ...