Skip to content

Instantly share code, notes, and snippets.

@nurav
nurav / wsj_loader.py
Created February 12, 2018 18:57 — forked from rbrigden/wsj_loader.py
Load the WSJ speech dataset
import numpy as np
import os
class WSJ():
""" Load the WSJ speech dataset
Ensure WSJ_PATH is path to directory containing
all data files (.npy) provided on Kaggle.
Example usage:
import json
import requests
import os
from cern_webinfra_service_engine.message_processor import MessageProcessor
from cern_webinfra_service_engine.iresource import IResource
URSH_LOCATION = 'http://test-ursh.web.cern.ch'
URSH_TOKEN = ''

This is a roster of the work done for Balrog by Varun Joshi during Google Summer of Code 2016.

The project was successfully completed and its results have been deployed to the Balrog production instance. It has resulted in a significant reduction in the number of failed jobs due to update races. On the staging server, there used to be about 60 job failures due to update races in a day. This has been reduced to about 2-3 failures. The pull request for the GSoC project is #93. The associated bug is Bug 1223872

The other work done during the summer:

  • Adding a new SystemAddons blob. PR #95 (associated bug #1275370)
  • Add support for querying history by data version and primary key: This was required to support the main GSoC project. PR #91
def updateRelease(self, name, changed_by, old_data_version, product=None, read_only=None, blob=None, transaction=None):
if product or blob:
self._proceedIfNotReadOnly(name, transaction=transaction)
what = {}
if read_only is not None:
what['read_only'] = read_only
if product:
what['product'] = product
if blob:
blob.validate()
import re
import xml.etree.ElementTree as ET
from auslib import AUS
from auslib.blobs.base import Blob
from auslib.errors import BadDataError
class SuperBlob(Blob):
jsonschema = "superblob.yml"
@nurav
nurav / log
Created December 16, 2015 15:44
In file included from /home/varun/repos/kde/src/kfilemetadata/src/writers/taglibwriter.cpp:6:0:
/usr/include/taglib/fileref.h:92:25: warning: 'class TagLib::FileRef::FileTypeResolver' has virtual functions and accessible non-virtual destructor [-Wnon-virtual-dtor]
class TAGLIB_EXPORT FileTypeResolver
^
[ 88%] Building CXX object autotests/CMakeFiles/taglibextractortest.dir/taglibextractortest_automoc.cpp.o
In file included from /home/varun/repos/kde/src/kfilemetadata-build/autotests/taglibextractortest_automoc.cpp:4:0:
/home/varun/repos/kde/src/kfilemetadata-build/autotests/moc_taglibwriter.cpp:93:39: error: redefinition of 'const uint qt_section_alignment_dummy'
QT_PLUGIN_METADATA_SECTION const uint qt_section_alignment_dummy = 42;
^
In file included from /home/varun/repos/kde/src/kfilemetadata-build/autotests/taglibextractortest_automoc.cpp:3:0: