Skip to content

Instantly share code, notes, and snippets.

View bricksdont's full-sized avatar
🎹

Mathias Müller bricksdont

🎹
View GitHub Profile
@bricksdont
bricksdont / decode_chunk.sh
Last active January 20, 2020 09:56
Sockeye parallel decoding
#! /bin/bash
chunk_input_dir=$1
chunk_output_dir=$2
chunk_prefix=$3
chunk_index=$4
model_paths=$5
batch_size=$6
<?xml version="1.0" encoding="UTF-8"?>
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0" xmlns:text="www.doc.com">
<xsl:output method="xml" indent="yes"/>
<xsl:strip-space elements="*"/>
<xsl:template match="@*|node()">
<xsl:copy>
<xsl:apply-templates select="@*|node()"/>
</xsl:copy>
</xsl:template>
#!/usr/bin/env python
# -*- coding: utf-8 -*-
import lxml.etree as et
xml="""
<text:doc xmlns:text="www.doc.com">
<text:span text:style-name="Kursiv_5f_KeiinRecht">
<text:span text:style-name="T25">madhuparká</text:span>
# import embeddings
!ls shared/MUSE
import musevecs
mdls = musevecs.MUSE('shared/MUSE/wiki.multi.{0}.vecfull.txt', {'en', 'de', 'fr'}, nmax=200000)
enmdl = mdls.vecmap['en']
#! /bin/env python
import os
import logging
import mxnet as mx
import numpy as np
logging.getLogger().setLevel(logging.INFO)
############################################
# Parameter sharing between BucketingModules
@bricksdont
bricksdont / shared-params.py
Last active May 17, 2018 14:24
Sharing params between mxnet modules
#! /bin/env python
import os
import logging
import mxnet as mx
import numpy as np
logging.getLogger().setLevel(logging.INFO)
#######################################