Skip to content

Instantly share code, notes, and snippets.

@vitorbaptista

vitorbaptista/Ref and sort in util.py#sort_by_reference

Created July 11, 2012 23:24
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vitorbaptista/3094411 to your computer and use it in GitHub Desktop.
Save vitorbaptista/3094411 to your computer and use it in GitHub Desktop.
Download ZIP
OpenSpending Issue #474
Raw
Ref and sort in util.py#sort_by_reference
=== REF ===
[u'6a499088428a729ca4c2e9ca1d3a8bfa5646f592']
=== SORT ===
[(<Dataset(australian_federal_government_contract_spending:[<AttributeDimension(category)>, <AttributeDimension(sourceurl)>, <CompoundDimension(from:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(description)>, <DateDimension(publishdate:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(cnid)>, <DateDimension(contractend:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>]:[<Measure(amount)>])>,
{u'amount': 20629.650000000001,
u'category': u'Travel and Food and Lodging and Entertainment Services',
u'cnid': u'100604',
u'contractend': {u'day': u'30',
u'id': 303,
u'label': u'30. September 2010',
u'month': u'09',
u'name': u'2010-09-30',
u'quarter': u'2',
'taxonomy': u'contractend',
u'week': u'39',
u'year': u'2010',
u'yearmonth': u'201009'},
u'description': u'Domestic & International Airline and Travel Manage',
u'from': {u'id': 75,
u'label': u'National Health and Medical Research Council',
u'name': u'88601010284',
'taxonomy': u'from'},
u'id': u'427e14633c46c54a9fe33a17257e536c033db366',
u'publishdate': {u'day': u'10',
u'id': 1665,
u'label': u'10. July 2008',
u'month': u'07',
u'name': u'2008-07-10',
u'quarter': u'1',
'taxonomy': u'publishdate',
u'week': u'27',
u'year': u'2008',
u'yearmonth': u'200807'},
u'sourceurl': u'https://www.tenders.gov.au/?event=public.advancedsearch.keyword&keyword=CN100604',
u'time': {u'day': u'24',
u'id': 309,
u'label': u'24. June 2008',
u'month': u'06',
u'name': u'2008-06-24',
u'quarter': u'1',
'taxonomy': u'time',
u'week': u'25',
u'year': u'2008',
u'yearmonth': u'200806'},
u'to': {u'id': 3199,
u'label': u'AMERICAN EXPRESS CORPORATE SERVICES',
u'name': u'92108952085',
'taxonomy': u'to'}}),
(<Dataset(australian_federal_government_contract_spending:[<AttributeDimension(category)>, <AttributeDimension(sourceurl)>, <CompoundDimension(from:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(description)>, <DateDimension(publishdate:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(cnid)>, <DateDimension(contractend:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>]:[<Measure(amount)>])>,
{u'amount': 12449.620000000001,
u'category': u'Travel and Food and Lodging and Entertainment Services',
u'cnid': u'100607',
u'contractend': {u'day': u'30',
u'id': 303,
u'label': u'30. September 2010',
u'month': u'09',
u'name': u'2010-09-30',
u'quarter': u'2',
'taxonomy': u'contractend',
u'week': u'39',
u'year': u'2010',
u'yearmonth': u'201009'},
u'description': u'Domestic & International Airline and Travel Manage',
u'from': {u'id': 75,
u'label': u'National Health and Medical Research Council',
u'name': u'88601010284',
'taxonomy': u'from'},
u'id': u'5c520c21bbdacb2dbd93b07a367f849f37402d3d',
u'publishdate': {u'day': u'10',
u'id': 1665,
u'label': u'10. July 2008',
u'month': u'07',
u'name': u'2008-07-10',
u'quarter': u'1',
'taxonomy': u'publishdate',
u'week': u'27',
u'year': u'2008',
u'yearmonth': u'200807'},
u'sourceurl': u'https://www.tenders.gov.au/?event=public.advancedsearch.keyword&keyword=CN100607',
u'time': {u'day': u'24',
u'id': 309,
u'label': u'24. June 2008',
u'month': u'06',
u'name': u'2008-06-24',
u'quarter': u'1',
'taxonomy': u'time',
u'week': u'25',
u'year': u'2008',
u'yearmonth': u'200806'},
u'to': {u'id': 3199,
u'label': u'AMERICAN EXPRESS CORPORATE SERVICES',
u'name': u'92108952085',
'taxonomy': u'to'}}),
(<Dataset(australian_federal_government_contract_spending:[<AttributeDimension(category)>, <AttributeDimension(sourceurl)>, <CompoundDimension(from:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(description)>, <DateDimension(publishdate:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(cnid)>, <DateDimension(contractend:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>]:[<Measure(amount)>])>,
{u'amount': 11015.02,
u'category': u'Travel and Food and Lodging and Entertainment Services',
u'cnid': u'100608',
u'contractend': {u'day': u'30',
u'id': 303,
u'label': u'30. September 2010',
u'month': u'09',
u'name': u'2010-09-30',
u'quarter': u'2',
'taxonomy': u'contractend',
u'week': u'39',
u'year': u'2010',
u'yearmonth': u'201009'},
u'description': u'Domestic & International Airline and Travel Manage',
u'from': {u'id': 75,
u'label': u'National Health and Medical Research Council',
u'name': u'88601010284',
'taxonomy': u'from'},
u'id': u'6568518428bc77e622aef8141c2e8bde92f299ee',
u'publishdate': {u'day': u'10',
u'id': 1665,
u'label': u'10. July 2008',
u'month': u'07',
u'name': u'2008-07-10',
u'quarter': u'1',
'taxonomy': u'publishdate',
u'week': u'27',
u'year': u'2008',
u'yearmonth': u'200807'},
u'sourceurl': u'https://www.tenders.gov.au/?event=public.advancedsearch.keyword&keyword=CN100608',
u'time': {u'day': u'24',
u'id': 309,
u'label': u'24. June 2008',
u'month': u'06',
u'name': u'2008-06-24',
u'quarter': u'1',
'taxonomy': u'time',
u'week': u'25',
u'year': u'2008',
u'yearmonth': u'200806'},
u'to': {u'id': 3199,
u'label': u'AMERICAN EXPRESS CORPORATE SERVICES',
u'name': u'92108952085',
'taxonomy': u'to'}}),
(<Dataset(australian_federal_government_contract_spending:[<AttributeDimension(category)>, <AttributeDimension(sourceurl)>, <CompoundDimension(from:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(description)>, <DateDimension(publishdate:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(cnid)>, <DateDimension(contractend:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>]:[<Measure(amount)>])>,
{u'amount': 14627.08,
u'category': u'Travel and Food and Lodging and Entertainment Services',
u'cnid': u'100605',
u'contractend': {u'day': u'30',
u'id': 303,
u'label': u'30. September 2010',
u'month': u'09',
u'name': u'2010-09-30',
u'quarter': u'2',
'taxonomy': u'contractend',
u'week': u'39',
u'year': u'2010',
u'yearmonth': u'201009'},
u'description': u'Domestic & International Airline and Travel Manage',
u'from': {u'id': 75,
u'label': u'National Health and Medical Research Council',
u'name': u'88601010284',
'taxonomy': u'from'},
u'id': u'f39a6e26de4b01fa4de2e2f53e31ca8c1e5a26b1',
u'publishdate': {u'day': u'10',
u'id': 1665,
u'label': u'10. July 2008',
u'month': u'07',
u'name': u'2008-07-10',
u'quarter': u'1',
'taxonomy': u'publishdate',
u'week': u'27',
u'year': u'2008',
u'yearmonth': u'200807'},
u'sourceurl': u'https://www.tenders.gov.au/?event=public.advancedsearch.keyword&keyword=CN100605',
u'time': {u'day': u'24',
u'id': 309,
u'label': u'24. June 2008',
u'month': u'06',
u'name': u'2008-06-24',
u'quarter': u'1',
'taxonomy': u'time',
u'week': u'25',
u'year': u'2008',
u'yearmonth': u'200806'},
u'to': {u'id': 3199,
u'label': u'AMERICAN EXPRESS CORPORATE SERVICES',
u'name': u'92108952085',
'taxonomy': u'to'}}),
(<Dataset(eu-commission-fts:[<CompoundDimension(chapter:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(from:[<Attribute(label)>, <Attribute(original_name)>, <Attribute(uri)>, <Attribute(name)>])>, <AttributeDimension(cofinancing_rate)>, <CompoundDimension(title:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(country:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(coordinator)>, <CompoundDimension(nuts1:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(position_key)>, <CompoundDimension(nuts3:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(nuts2:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(city)>, <Attribute(geozone)>, <Attribute(name)>, <Attribute(country)>, <Attribute(label)>, <Attribute(alias)>, <Attribute(postcode)>, <Attribute(address)>, <Attribute(lat)>, <Attribute(lng)>])>, <CompoundDimension(item:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(action_type:[<Attribute(name)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <AttributeDimension(source_id)>, <CompoundDimension(article:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <AttributeDimension(grant_subject)>]:[<Measure(amount)>, <Measure(total)>])>,
{u'action_type': {u'id': 43,
u'label': u'06 Energy and transport',
u'name': u'06-energy-and-transport',
'taxonomy': u'action_type'},
u'amount': 10845.66,
u'article': {u'description': u'<p>This appropriation is intended to cover expenditure incurred by the Commission for collecting and processing information of all kinds needed for the analysis, definition, promotion, monitoring, evaluation and implementation of the European Union&#8217;s common transport policy, for all transport modes (inland, air, sea and river) and for all transport sectors (transport safety, internal market of transport with its implementation rules, optimisation of transport network, passengers rights and protection in all transport modes as well as for all other sectors related to transport).The main endorsed actions and objectives are intended to support the European Union&#8217;s common transport policy, including extension to third countries, technical assistance for all transport modes and sectors, specific training, definition of rules of transport safety, promotion of the common transport policy including establishment and implementation of trans-European network orientation endorsed by the treaty as well as strengthening passengers&#8217; rights and protection to all transport modes and to enforce existing Regulations on passenger rights, in particular through awareness-raising activities about the content of those Regulations, targeted at both the transport industry as well as the travelling public.</p>\n\n<p>These activities should promote and support intermodal barrier-free mobility for persons with reduced mobility (PRMs).</p>\n\n<p>In connection with Regulation (EC) No 261/2004 of the European Parliament and of the Council of 11 February 2004 establishing common rules on compensation and assistance to passengers in the event of denied boarding and of cancellation or long delay of flights, and repealing Regulation (EEC) No 295/91 (OJ L 46, 17.2.2004, p. 1), the Commission needs to develop additional measures to make enforcement of the Regulation more efficient.</p>\n\n<p>These actions and objectives could be supported at different levels (local, regional, national, European and international), for all transport modes and sectors and related to transport, as well as in technical, technological, regulatory, informative, environmental, climatic, political fields and for sustainable development.</p>\n\n<p>Air transport has long been one of the sectors in which the consumer authorities receive most complaints in the European Union. The increase in the number of commercial transactions performed electronically (using the Internet or a mobile telephone) has merely resulted in more breaches of European consumer legislation.</p>\n\n<p>One of the main complaints by EU consumers is that there are no effective means of redress at airports themselves, particularly when disputes arise as a result of failure on the part of airlines and other service providers to meet their obligations. The European consumer and air transport authorities therefore need to work together to secure an immediate improvement in passenger support and information facilities at airports and, at the same time, step up coregulation in the sector.</p>\n\n<p>Part of this appropriation will be used to establish a pilot project to set up an integrated air passenger support system at European Union airports, based on a single helpdesk and information system that is shared and maintained by all the stakeholders at European level. This will provide passengers with a guarantee that, whichever EU airport they are in, any complaints or requests for information that they make will be dealt with in the same manner, with support being provided by the local consumer authorities and coordinated through the information networks already in place within the EU.</p>',
u'id': 139,
u'label': u'Support activities to the European transport policy and passenger rights',
u'legal_basis': u'Task resulting from the Commission\u2019s prerogatives at institutional level, as provided for in Article 49(6) of the Financial Regulation.',
u'name': u'06-02-03',
'taxonomy': u'article'},
u'chapter': {u'description': u'',
u'id': 29,
u'label': u'Inland, air and maritime transport',
u'legal_basis': u'',
u'name': u'06-02',
'taxonomy': u'chapter'},
u'cofinancing_rate': u'N.A.',
u'coordinator': u'0',
u'country': {u'id': 6,
u'label': u'Belgium',
u'name': u'be',
'taxonomy': u'country'},
u'from': {u'id': 8,
u'label': u'Mobility and Transport (MOVE)',
u'name': u'mobility-and-transport-move',
u'original_name': u'Mobility and Transport',
'taxonomy': u'from',
u'uri': u'http://publicbodies.org/bodies/eu/9a8d5bf95972'},
u'grant_subject': u'',
u'id': u'3245aade10d562a4d56d4063b04f5bbfb9e6d0a5',
u'item': {u'description': u'',
u'id': 1,
u'label': u'(Unknown Item)',
u'legal_basis': u'',
u'name': u'unknown',
'taxonomy': u'item'},
u'nuts1': {u'id': 7,
u'label': u'R\xc9GION DE BRUXELLES-CAPITALE / BRUSSELS HOOFDSTEDELIJK GEWEST',
u'name': u'be1',
u'original': u'BE1',
'taxonomy': u'nuts1'},
u'nuts2': {u'id': 7,
u'label': u'R\xe9gion de Bruxelles-Capitale / Brussels Hoofdstedelijk Gewest',
u'name': u'be10',
u'original': u'BE10',
'taxonomy': u'nuts2'},
u'nuts3': {u'id': 7,
u'label': u'Arr. de Bruxelles-Capitale / Arr. van Brussel-Hoofdstad',
u'name': u'be100',
u'original': u'BE100',
'taxonomy': u'nuts3'},
u'position_key': u'',
u'source_id': u'50025',
u'time': {u'day': u'01',
u'id': 1,
u'label': u'01. January 2010',
u'month': u'01',
u'name': u'2010-01-01',
u'quarter': u'0',
'taxonomy': u'time',
u'week': u'00',
u'year': u'2010',
u'yearmonth': u'201001'},
u'title': {u'description': u'',
u'id': 1,
u'label': u'Energy and transport',
u'legal_basis': u'',
u'name': u'06',
'taxonomy': u'title'},
u'to': {u'address': u'LENNEKE MARELAAN 6',
u'alias': u'',
u'city': u'SINT STEVENS WOLUWE',
u'country': u'Belgium',
u'geozone': u'',
u'id': 1406,
u'label': u'AMERICAN EXPRESS CORPORATE TRAVEL NV',
u'lat': u'50.8482703821864',
u'lng': u'4.44699923012279',
u'name': u'american-express-corporate-travel-nv',
u'postcode': u'1932',
'taxonomy': u'to'},
u'total': 27000.0}),
(<Dataset(eu-commission-fts:[<CompoundDimension(chapter:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(from:[<Attribute(label)>, <Attribute(original_name)>, <Attribute(uri)>, <Attribute(name)>])>, <AttributeDimension(cofinancing_rate)>, <CompoundDimension(title:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(country:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(coordinator)>, <CompoundDimension(nuts1:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(position_key)>, <CompoundDimension(nuts3:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(nuts2:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(city)>, <Attribute(geozone)>, <Attribute(name)>, <Attribute(country)>, <Attribute(label)>, <Attribute(alias)>, <Attribute(postcode)>, <Attribute(address)>, <Attribute(lat)>, <Attribute(lng)>])>, <CompoundDimension(item:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(action_type:[<Attribute(name)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <AttributeDimension(source_id)>, <CompoundDimension(article:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <AttributeDimension(grant_subject)>]:[<Measure(amount)>, <Measure(total)>])>,
{u'action_type': {u'id': 56,
u'label': u'16 Communication',
u'name': u'16-communication',
'taxonomy': u'action_type'},
u'amount': 6125.9499999999998,
u'article': {u'description': u'',
u'id': 348,
u'label': u'Communication of the Representations',
u'legal_basis': u'',
u'name': u'16-03-02',
'taxonomy': u'article'},
u'chapter': {u'description': u'',
u'id': 131,
u'label': u'Going Local communication',
u'legal_basis': u'',
u'name': u'16-03',
'taxonomy': u'chapter'},
u'cofinancing_rate': u'N.A.',
u'coordinator': u'1',
u'country': {u'id': 6,
u'label': u'Belgium',
u'name': u'be',
'taxonomy': u'country'},
u'from': {u'id': 29,
u'label': u'Communication (COMM)',
u'name': u'communication-comm',
u'original_name': u'Communication',
'taxonomy': u'from',
u'uri': u'http://publicbodies.org/bodies/eu/6a04a560bcc5'},
u'grant_subject': u'AIRLINES TICKTES',
u'id': u'56b9fc46f83b6ade3b47bbda0f0451ccac03cfbd',
u'item': {u'description': u'',
u'id': 1,
u'label': u'(Unknown Item)',
u'legal_basis': u'',
u'name': u'unknown',
'taxonomy': u'item'},
u'nuts1': {u'id': 7,
u'label': u'R\xc9GION DE BRUXELLES-CAPITALE / BRUSSELS HOOFDSTEDELIJK GEWEST',
u'name': u'be1',
u'original': u'BE1',
'taxonomy': u'nuts1'},
u'nuts2': {u'id': 7,
u'label': u'R\xe9gion de Bruxelles-Capitale / Brussels Hoofdstedelijk Gewest',
u'name': u'be10',
u'original': u'BE10',
'taxonomy': u'nuts2'},
u'nuts3': {u'id': 7,
u'label': u'Arr. de Bruxelles-Capitale / Arr. van Brussel-Hoofdstad',
u'name': u'be100',
u'original': u'BE100',
'taxonomy': u'nuts3'},
u'position_key': u'AIRLINES TICKTES',
u'source_id': u'61817',
u'time': {u'day': u'01',
u'id': 2,
u'label': u'01. January 2009',
u'month': u'01',
u'name': u'2009-01-01',
u'quarter': u'0',
'taxonomy': u'time',
u'week': u'00',
u'year': u'2009',
u'yearmonth': u'200901'},
u'title': {u'description': u'',
u'id': 21,
u'label': u'Communication',
u'legal_basis': u'',
u'name': u'16',
'taxonomy': u'title'},
u'to': {u'address': u'LENNEKE MARELAAN 6',
u'alias': u'',
u'city': u'SINT STEVENS WOLUWE',
u'country': u'Belgium',
u'geozone': u'',
u'id': 1406,
u'label': u'AMERICAN EXPRESS CORPORATE TRAVEL NV',
u'lat': u'50.8482703821864',
u'lng': u'4.44699923012279',
u'name': u'american-express-corporate-travel-nv',
u'postcode': u'1932',
'taxonomy': u'to'},
u'total': 6125.9499999999998}),
(<Dataset(eu-commission-fts:[<CompoundDimension(chapter:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(from:[<Attribute(label)>, <Attribute(original_name)>, <Attribute(uri)>, <Attribute(name)>])>, <AttributeDimension(cofinancing_rate)>, <CompoundDimension(title:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(country:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(coordinator)>, <CompoundDimension(nuts1:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(position_key)>, <CompoundDimension(nuts3:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(nuts2:[<Attribute(original)>, <Attribute(name)>, <Attribute(label)>])>, <CompoundDimension(to:[<Attribute(city)>, <Attribute(geozone)>, <Attribute(name)>, <Attribute(country)>, <Attribute(label)>, <Attribute(alias)>, <Attribute(postcode)>, <Attribute(address)>, <Attribute(lat)>, <Attribute(lng)>])>, <CompoundDimension(item:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <CompoundDimension(action_type:[<Attribute(name)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <AttributeDimension(source_id)>, <CompoundDimension(article:[<Attribute(label)>, <Attribute(legal_basis)>, <Attribute(description)>, <Attribute(name)>])>, <AttributeDimension(grant_subject)>]:[<Measure(amount)>, <Measure(total)>])>,
{u'action_type': {u'id': 56,
u'label': u'16 Communication',
u'name': u'16-communication',
'taxonomy': u'action_type'},
u'amount': 12568.77,
u'article': {u'description': u'',
u'id': 348,
u'label': u'Communication of the Representations',
u'legal_basis': u'',
u'name': u'16-03-02',
'taxonomy': u'article'},
u'chapter': {u'description': u'',
u'id': 131,
u'label': u'Going Local communication',
u'legal_basis': u'',
u'name': u'16-03',
'taxonomy': u'chapter'},
u'cofinancing_rate': u'N.A.',
u'coordinator': u'1',
u'country': {u'id': 6,
u'label': u'Belgium',
u'name': u'be',
'taxonomy': u'country'},
u'from': {u'id': 29,
u'label': u'Communication (COMM)',
u'name': u'communication-comm',
u'original_name': u'Communication',
'taxonomy': u'from',
u'uri': u'http://publicbodies.org/bodies/eu/6a04a560bcc5'},
u'grant_subject': u'AIRLINES TICKETS, HOTEL SERV. FOR PARTICIPANTS OF A STUDY VI SIT TO BRUSSELS',
u'id': u'aceda9cd1db9f57ec5556d77f821ddd13a43a80a',
u'item': {u'description': u'',
u'id': 1,
u'label': u'(Unknown Item)',
u'legal_basis': u'',
u'name': u'unknown',
'taxonomy': u'item'},
u'nuts1': {u'id': 7,
u'label': u'R\xc9GION DE BRUXELLES-CAPITALE / BRUSSELS HOOFDSTEDELIJK GEWEST',
u'name': u'be1',
u'original': u'BE1',
'taxonomy': u'nuts1'},
u'nuts2': {u'id': 7,
u'label': u'R\xe9gion de Bruxelles-Capitale / Brussels Hoofdstedelijk Gewest',
u'name': u'be10',
u'original': u'BE10',
'taxonomy': u'nuts2'},
u'nuts3': {u'id': 7,
u'label': u'Arr. de Bruxelles-Capitale / Arr. van Brussel-Hoofdstad',
u'name': u'be100',
u'original': u'BE100',
'taxonomy': u'nuts3'},
u'position_key': u'AIRLINES TICKETS, HOTEL SERV. FOR PARTICIPANTS OF A STUDY VI SIT TO BRUSSELS',
u'source_id': u'53460',
u'time': {u'day': u'01',
u'id': 2,
u'label': u'01. January 2009',
u'month': u'01',
u'name': u'2009-01-01',
u'quarter': u'0',
'taxonomy': u'time',
u'week': u'00',
u'year': u'2009',
u'yearmonth': u'200901'},
u'title': {u'description': u'',
u'id': 21,
u'label': u'Communication',
u'legal_basis': u'',
u'name': u'16',
'taxonomy': u'title'},
u'to': {u'address': u'LENNEKE MARELAAN 6',
u'alias': u'',
u'city': u'SINT STEVENS WOLUWE',
u'country': u'Belgium',
u'geozone': u'',
u'id': 1406,
u'label': u'AMERICAN EXPRESS CORPORATE TRAVEL NV',
u'lat': u'50.8482703821864',
u'lng': u'4.44699923012279',
u'name': u'american-express-corporate-travel-nv',
u'postcode': u'1932',
'taxonomy': u'to'},
u'total': 12568.77}),
(<Dataset(epsrc-gotw:[<AttributeDimension(grant-title)>, <AttributeDimension(grant-reference)>, <AttributeDimension(grant-scheme)>, <CompoundDimension(to:[<Attribute(name)>, <Attribute(label)>])>, <DateDimension(time:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(department:[<Attribute(name)>, <Attribute(label)>])>, <AttributeDimension(grant-abstract)>, <DateDimension(end-date:[<Attribute(week)>, <Attribute(yearmonth)>, <Attribute(name)>, <Attribute(year)>, <Attribute(month)>, <Attribute(quarter)>, <Attribute(day)>, <Attribute(label)>])>, <CompoundDimension(institution:[<Attribute(name)>, <Attribute(label)>])>]:[<Measure(amount)>])>,
{u'amount': 60730.629999999997,
u'department': {u'id': 382,
u'label': u'Computing & Mathematics',
u'name': u'2651',
'taxonomy': u'department'},
u'end-date': {u'day': u'03',
u'id': 4447,
u'label': u'03. September 2006',
u'month': u'09',
u'name': u'2006-09-03',
u'quarter': u'2',
'taxonomy': u'end-date',
u'week': u'35',
u'year': u'2006',
u'yearmonth': u'200609'},
u'grant-abstract': u"During the 1970's and 1980's the main threat posed to the travelling public using airlines was that of hijacking. The X-ray screening of carry-on luggage was generally perceived as addressing this problem. However, in December 1988 the bombing of Pan American flight 103 over Lockerbie, Scotland, along with other previous bombings, radically changed this situation. Since September 2001, the increasing frequency of terrorist attacks across the world has highlighted the need for fully optimised screening techniques. The screening of hold baggage and carry-on baggage is critical for the provision safe air travel.Poor quality X-ray images pose serious problems for the security operators manning X-ray scanners at places such as airports. The operators search for the weapons of terrorism such as guns, knives or explosive devices in images containing the clutter of everyday items. It is a demanding and stressful job involving a complex visual task. Operators examine 200-300 passenger bags in a 20 minute shift. This means they only have a few seconds to make a decision. The job is particularly difficult because items appear as shadows in standard X-ray transmission images with no cues to their true position in depth. The same item will appear very different if its orientation is changed. Threat items can even be packed in ways to make them more difficult to spot.A team of researchers at the Nottingham Trent University is investigating a new approach to provide the X-ray machine operators with enhanced ways of interrogating complex X-ray imagery. In collaboration with scientists based at the Home Office Science and Technology Group at Sandridge near St Albans and the US Department of Homeland Security, the team are developing a 3D X-ray scanner that will provide video type image sequences of rotating objects in the display. The sequences are designed to exhibit kinetic depth in which contours and lines change their length and direction simultaneously. The resultant imagery provides the observer with hitherto unseen information concerning the actual contents of the objects being inspected through a powerful and compelling sensation of three-dimensional structure. The object is imaged from a large range of angles making it almost impossible to fool the system. In fact, visual psychologists originally investigated kinetic depth in the early 1950's to study the human visual system; now it looks set to be applied in the world of aviation security screening.Innovative engineering utilises a single stationary X-ray source together with a static arrangement of sensors to capture the raw image data. The luggage is moved on a conveyor belt through a normal X-ray machine inspection tunnel. However, the key to developing a practical 3D scanner now relies upon the research and development of advanced video processing techniques to reduce the total number of X-ray sensors required. This requires that the colour encoded images which indicate the type of material the X-ray beam has penetrated on its way to the sensor are carefully processed and ultimately combined with synthetic images created in software. If this can be achieved a new 3D scanner technology can be commercially realised. More futuristically, the implications for the success of this approach are far reaching in that the technique may well have the potential to improve the high energy X-ray screening of freight and/or vehicles as well as medical and industrial applications utilising other transmission imaging modalities. There is wide spread agreement among researchers in the security field that the biggest breakthroughs in improving security will depend on improving ways of processing data quickly and accurately and presenting it so that it can be easily interpreted.",
u'grant-reference': u'EP/C520351/1',
u'grant-scheme': u'Standard Research (Pre-FEC)',
u'grant-title': u'Dynamic 3D imaging for X-ray security screening: Crime feasibility study',
u'id': u'6a499088428a729ca4c2e9ca1d3a8bfa5646f592',
u'institution': {u'id': 73,
u'label': u'Nottingham Trent University',
u'name': u'281',
'taxonomy': u'institution'},
u'time': {u'day': u'04',
u'id': 3420,
u'label': u'04. July 2005',
u'month': u'07',
u'name': u'2005-07-04',
u'quarter': u'1',
'taxonomy': u'time',
u'week': u'27',
u'year': u'2005',
u'yearmonth': u'200507'},
u'to': {u'id': 7752,
u'label': u'Evans, Professor JPO',
u'name': u'74846',
'taxonomy': u'to'}})]
Raw
stacktrace
URL: http://openspending.org/api/2/search?q=cameroon
Module weberror.errormiddleware:162 in __call__
<< __traceback_supplement__ = Supplement, self, environ
sr_checker = ResponseStartChecker(start_response)
app_iter = self.application(environ, sr_checker)
return self.make_catching_iter(app_iter, environ, sr_checker)
except:
>> app_iter = self.application(environ, sr_checker)
Module repoze.who.middleware:87 in __call__
<< wrapper = StartResponseWrapper(start_response)
app_iter = app(environ, wrapper.wrap_start_response)
# The challenge decider almost(?) always needs information from the
>> app_iter = app(environ, wrapper.wrap_start_response)
Module beaker.middleware:73 in __call__
<< self.cache_manager)
environ[self.environ_key] = self.cache_manager
return self.app(environ, start_response)
>> return self.app(environ, start_response)
Module beaker.middleware:155 in __call__
<< headers.append(('Set-cookie', cookie))
return start_response(status, headers, exc_info)
return self.wrap_app(environ, session_start_response)
def _get_session(self):
>> return self.wrap_app(environ, session_start_response)
Module routes.middleware:131 in __call__
<< r'\1', oldpath)
response = self.app(environ, start_response)
# Wrapped in try as in rare cases the attribute will be gone already
>> response = self.app(environ, start_response)
Module pylons.wsgiapp:107 in __call__
<<
controller = self.resolve(environ, start_response)
response = self.dispatch(controller, environ, start_response)
if 'paste.testing_variables' in environ and hasattr(response,
>> response = self.dispatch(controller, environ, start_response)
Module pylons.wsgiapp:312 in dispatch
<< if log_debug:
log.debug("Calling controller class with WSGI interface")
return controller(environ, start_response)
def load_test_env(self, environ):
>> return controller(environ, start_response)
Module openspending.ui.lib.base:74 in __call__
<< begin = time()
try:
return WSGIController.__call__(self, environ, start_response)
finally:
db.session.remove()
>> return WSGIController.__call__(self, environ, start_response)
Module pylons.controllers.core:211 in __call__
<< return response(environ, self.start_response)
response = self._dispatch_call()
if not start_response_called:
self.start_response = start_response
>> response = self._dispatch_call()
Module pylons.controllers.core:162 in _dispatch_call
<< req.environ['pylons.action_method'] = func
response = self._inspect_call(func)
else:
if log_debug:
>> response = self._inspect_call(func)
Module pylons.controllers.core:105 in _inspect_call
<< func.__name__, args)
try:
result = self._perform_call(func, args)
except HTTPException, httpe:
if log_debug:
>> result = self._perform_call(func, args)
Module pylons.controllers.core:57 in _perform_call
<< """Hide the traceback for everything above this method"""
__traceback_hide__ = 'before_and_this'
return func(**args)
def _inspect_call(self, func):
>> return func(**args)
Module openspending.ui.controllers.api2:2 in search
Module openspending.lib.jsonexport:93 in jsonpify
<< Modelled after pylons.decorators.jsonify.
"""
data = func(*args, **kwargs)
return to_jsonp(data)
>> data = func(*args, **kwargs)
Module openspending.ui.controllers.api2:85 in search
<< except SolrException, e:
return {'errors': [unicode(e)]}
entries = [entry_apply_links(d.name, e) for d, e in entries]
if expand_facets and len(datasets) == 1:
>> entries = [entry_apply_links(d.name, e) for d, e in entries]
Module openspending.lib.browser:131 in _get_entries
<< entries.extend([(dataset, e) for e in dataset.entries(query)])
entries = util.sort_by_reference(ids, entries, lambda x: x[1]['id'])
for dataset, entry in filter(lambda e: e is not None, entries):
yield dataset, entry
>> entries = util.sort_by_reference(ids, entries, lambda x: x[1]['id'])
Module openspending.lib.util:72 in sort_by_reference
<< ordered = [None] * len(ref)
for x in sort:
ordered[ref_map[sort_fn(x)]] = x
return ordered
>> ordered[ref_map[sort_fn(x)]] = x
KeyError: u'00043db39def35fee379e2b952728cfa83da0210'
CGI Variables
CONTENT_TYPE '; charset=utf-8'
HTTP_ACCEPT 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
HTTP_ACCEPT_CHARSET 'ISO-8859-1,utf-8;q=0.7,*;q=0.3'
HTTP_ACCEPT_ENCODING 'gzip,deflate,sdch'
HTTP_ACCEPT_LANGUAGE 'en-US,en;q=0.8'
HTTP_CONNECTION 'close'
HTTP_COOKIE 'openspending.ui=0e98ddeeb47f2e3ed8669cf07b6b064507b70ee9df51291bbf8b4b8bb523e1a135367977; __unam=78e6377-1386d2f8bf2-70f78a93-19; __utma=130762833.2063908017.1341707688.1342041018.1342046296.11; __utmb=130762833.1.10.1342046296; __utmc=130762833; __utmz=130762833.1341707688.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none)'
HTTP_HOST 'openspending.org'
HTTP_USER_AGENT 'Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.10 Chromium/18.0.1025.168 Chrome/18.0.1025.168 Safari/535.19'
HTTP_X_FORWARDED_FOR '187.36.39.116, 127.0.0.1'
HTTP_X_VARNISH '2134245178'
PATH_INFO '/api/2/search'
QUERY_STRING 'q=cameroon'
RAW_URI '/api/2/search?q=cameroon'
REMOTE_ADDR '127.0.0.1'
REMOTE_PORT '80'
REQUEST_METHOD 'GET'
SERVER_NAME 'openspending.org'
SERVER_PORT '80'
SERVER_PROTOCOL 'HTTP/1.0'
SERVER_SOFTWARE 'gunicorn/0.13.4'
WSGI Variables
application <repoze.who.middleware.PluggableAuthenticationMiddleware object at 0x326b610>
beaker.cache <beaker.cache.CacheManager object at 0x326b490>
beaker.get_session <bound method SessionMiddleware._get_session of <beaker.middleware.SessionMiddleware object at 0x326b410>>
beaker.session {'_accessed_time': 1342046301.0253601, '_creation_time': 1342037390.5014119}
gunicorn.socket <socket._socketobject object at 0x44bb050>
paste.cookies (<SimpleCookie: __unam='78e6377-1386d2f8bf2-70f78a93-19' __utma='130762833.2063908017.1341707688.1342041018.1342046296.11' __utmb='130762833.1.10.1342046296' __utmc='130762833' __utmz='130762833.1341707688.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none)' openspending.ui='0e98ddeeb47f2e3ed8669cf07b6b064507b70ee9df51291bbf8b4b8bb523e1a135367977'>, 'openspending.ui=0e98ddeeb47f2e3ed8669cf07b6b064507b70ee9df51291bbf8b4b8bb523e1a135367977; __unam=78e6377-1386d2f8bf2-70f78a93-19; __utma=130762833.2063908017.1341707688.1342041018.1342046296.11; __utmb=130762833.1.10.1342046296; __utmc=130762833; __utmz=130762833.1341707688.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none)')
paste.parsed_dict_querystring (MultiDict([('q', 'cameroon')]), 'q=cameroon')
paste.parsed_querystring ([('q', 'cameroon')], 'q=cameroon')
paste.registry <paste.registry.Registry object at 0x49924d0>
paste.throw_errors True
pylons.action_method <bound method Api2Controller.search of <openspending.ui.controllers.api2.Api2Controller object at 0x4668150>>
pylons.controller <openspending.ui.controllers.api2.Api2Controller object at 0x4668150>
pylons.environ_config {'session': 'beaker.session', 'cache': 'beaker.cache'}
pylons.pylons <pylons.util.PylonsContext object at 0x46682d0>
pylons.routes_dict {'action': u'search', 'controller': u'api2'}
repoze.who.api <repoze.who.api.API object at 0x49928d0>
repoze.who.logger <logging.Logger instance at 0x326a7e8>
repoze.who.plugins {'username': <openspending.ui.lib.authenticator.UsernamePasswordAuthenticator object at 0x326b590>, 'apikey': <openspending.ui.lib.authenticator.ApiKeyAuthenticator object at 0x326b5d0>, 'form': <FriendlyFormPlugin 52868432>, 'basicauth': <BasicAuthPlugin 52868304>, 'auth_tkt': <AuthTktCookiePlugin 52868368>}
routes.route <routes.route.Route object at 0x285d4d0>
routes.url <routes.util.URLGenerator object at 0x4992610>
webob._parsed_query_vars (GET([('q', 'cameroon')]), 'q=cameroon')
webob.adhoc_attrs {'language': 'en-us'}
wsgi process 'Multiprocess'
wsgi.file_wrapper <class gunicorn.http.wsgi.FileWrapper at 0x113a6b0>
wsgiorg.routing_args (<routes.util.URLGenerator object at 0x4992610>, {'action': u'search', 'controller': u'api2'})
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment