eddiecorrigall

FreeNAS

Troubleshooting

Mini SAS Male SFF-8087 to 4 Female SATA cables

I bought 2 cables for a FreeNAS array of 8 hard drives in 2019. I used them with an LSI HBA and a Rosewill case. I had trouble with the hard drive connections when I initially set them up. Occasionally a drive would go offline. I assumed that his was poor contact with the hot swap bays and re-seat the drives until they came online. Recently I discovered the issue: one of the SATA connections on the Mini SAS Male SFF-8087 to 4 Female SATA cables does not reliably connect. From my /var/log/messages I get these errors:

Oct 7 23:52:42 freenas mps0: Controller reported scsi ioc terminated tgt 9 SMID 2103 loginfo 31120303

wangg12

In this article, I will share some of my experience on installing NVIDIA driver and CUDA on Linux OS. Here I mainly use Ubuntu as example. Comments for CentOS/Fedora are also provided as much as I can.

Table of Contents

• Install NVIDIA Graphics Driver via apt-get
• Install NVIDIA Graphics Driver via runfile
  • Remove Previous Installations (Important)
  • Download the Driver
  • Install Dependencies
  • Creat Blacklist for Nouveau Driver

• Stop lightdm/gdm/kdm

Eastsun

# -*- coding: utf-8 -*-
from __future__ import annotations
from pandas.api.extensions import ExtensionDtype, ExtensionArray
from typing import Optional, Union, Dict, Tuple, Any, Sequence
import numpy as np
import re


class VectorDtype(ExtensionDtype):
    _metadata = 'subtype', 'size'

agbragin

https://github.com/apache/incubator-airflow
https://github.com/ssadedin/bpipe
https://github.com/bloomreach/briefly
https://github.com/monajemi/clusterjob
https://github.com/tburdett/Conan2
https://github.com/broadinstitute/cromwell
https://github.com/joergen7/cuneiform
https://github.com/googlegenomics/dockerflow
https://github.com/thieman/dagobah
https://github.com/Factual/drake

victorfsf

Setting up Jupyter to run Django with an enviroment variables file.

Run (the file must include a DJANGO_SETTINGS_MODULE env variable):

export $(cat .env | grep -v ^# | xargs) 

dusenberrymw

/*

    Name:       Base16 Solarized Dark
    Author:     Ethan Schoonover (http://ethanschoonover.com/solarized)

    CodeMirror template adapted for IPython Notebook by Nikhil Sonnad (https://github.com/nsonnad/base16-ipython-notebook)
    CodeMirror template by Jan T. Sott (https://github.com/idleberg/base16-chrome-devtools)
    Original Base16 color scheme by Chris Kempson (https://github.com/chriskempson/base16)

*/

mnarayan

Philip Guo summarized the problem quite well in Burrito. Are there any modern solutions to this problem ?

A nice collection of all tools provided by @pditommaso. Some subset worth trying out.

So far Sumatra/noworkflow/recipy/WorldMake appear to care most about provenance tracking; nextflow appears to be a very promising upgrade to gnu make for containerized data science pipelines.

1. Nextflow
2. Sumatra
3. Luigi and SciLuigi
4. Doit and an tutorial from sw

bsweger

Useful Pandas Snippets

A personal diary of DataFrame munging over the years.

Data Types and Conversion

Convert Series datatype to numeric (will error if column has non-numeric values)
(h/t @makmanalp)

kylebgorman

# Copyright (c) 2013-2022 Kyle Gorman
#
# Permission is hereby granted, free of charge, to any person obtaining a
# copy of this software and associated documentation files (the
# "Software"), to deal in the Software without restriction, including
# without limitation the rights to use, copy, modify, merge, publish,
# distribute, sublicense, and/or sell copies of the Software, and to
# permit persons to whom the Software is furnished to do so, subject to
# the following conditions:
#

danielfrg

import re
import json
import luigi
import pandas as pd
from mysolr import Solr
from bs4 import BeautifulSoup


class InputText(luigi.ExternalTask):