Skip to content

Instantly share code, notes, and snippets.

View manisnesan's full-sized avatar
🎯
Focusing

Manikandan Sivanesan` manisnesan

🎯
Focusing
View GitHub Profile
@manisnesan
manisnesan / fusion-native.md
Last active November 25, 2020 15:53
Fusion Native Notes

Use the Katacoda hands on learning to review the directory structure and config examples https://academy.lucidworks.com/fusion-architecture/526426

Cloud Provider Setup

customize_fusion_values.sh script uses the helm chart, cloud provider and config yaml file (see customize_fusion_values.yaml.example) to spin up the cluster.

By default, --num-solr instances and ZK_REPLICAS are set to 3

This is the file being run that controls the components

@manisnesan
manisnesan / diagnosis.md
Last active November 17, 2020 03:04
Test if tensorflow is detecting GPU

Environment CUDA version: 10.2 Tensorflow: 2.2.0

$ nvidia-smi 
Mon Nov 16 11:59:35 2020       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.95.01    Driver Version: 440.95.01    CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
@manisnesan
manisnesan / recommendation-systems.md
Last active November 18, 2020 02:39
Recommendation Systems
Topics Curated/Authored By Link
Intro elipapa https://gist.github.com/elipapa/147ffde1694626d63976480ef95001f7
Baseline Recommender System in PyTorch Eugene Yan https://eugeneyan.com/writing/recommender-systems-baseline-pytorch/
Basics, Alternating Least Square(ALS), Collaborative Filtering, Youtube engine, Movie Recommendations, Companies, Recsys, Bandits, Frameworks, Evaluation Pratik Bhavsar https://www.notion.so/Recommendation-a97d984c25e148c6a83001f0116316e4
RecSys Eugene Yan https://eugeneyan.com/writing/recsys2020/
Overview tranctan https://gist.github.com/tranctan/6706e21ea0efacdb07247fa09a5282a4
MultiModal Ted Dunning https://www.slideshare.net/tdunning/building-multimodal-recommendation-engines-using-search-engines
---------------------------------------------------------------------------
ModuleNotFoundError Traceback (most recent call last)
<ipython-input-4-313c6378870c> in <module>
----> 1 from fastai.basics.all import *
~/SageMaker/.env/fastai/lib/python3.6/site-packages/fastai/basics.py in <module>
----> 1 from .data.all import *
2 from .optimizer import *
3 from .callback.core import *
4 from .learner import *
2020-09-08T08:57:09,716 - ERROR [coreLoadExecutor-8-thread-3-processing-n:192.168.0.13:8983_solr:CoreContainer@902] - {collection=c:access, core=x:access_shard1_replica1, node_name=n:192.168.0.13:8983_solr, replica=r:core_node1, shard=s:shard1} - Error creating core [access_shard1_replica1]: Could not load conf for core access_shard1_replica1: Can't load schema schema.xml: Plugin init failure for [schema.xml] fieldType "text_transitionTags": Plugin init failure for [schema.xml] analyzer/filter: Error loading class 'solr.WordDelimiterGraphFilterFactory'
org.apache.solr.common.SolrException: Could not load conf for core access_shard1_replica1: Can't load schema schema.xml: Plugin init failure for [schema.xml] fieldType "text_transitionTags": Plugin init failure for [schema.xml] analyzer/filter: Error loading class 'solr.WordDelimiterGraphFilterFactory'
at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:84) ~[solr-core-6.4.2.jar:6.4.2 34a975ca3d4bd7fa121340e5bcbf165929e0542f - ishan - 2017
#!/usr/bin/env bash
set -e
cd
case "$OSTYPE" in
darwin*) DOWNLOAD=https://repo.anaconda.com/miniconda/Miniconda3-latest-MacOSX-x86_64.sh ;;
linux*) DOWNLOAD=https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh ;;
*) echo "unknown: $OSTYPE" ;;
esac
@manisnesan
manisnesan / fastai.md
Last active January 17, 2022 01:39
FastAI Landing Page
@manisnesan
manisnesan / delete_git_submodule.md
Created August 25, 2020 15:25 — forked from myusuf3/delete_git_submodule.md
How effectively delete a git submodule.

To remove a submodule you need to:

  • Delete the relevant section from the .gitmodules file.
  • Stage the .gitmodules changes git add .gitmodules
  • Delete the relevant section from .git/config.
  • Run git rm --cached path_to_submodule (no trailing slash).
  • Run rm -rf .git/modules/path_to_submodule (no trailing slash).
  • Commit git commit -m "Removed submodule "
  • Delete the now untracked submodule files rm -rf path_to_submodule
@manisnesan
manisnesan / environment.yml
Created August 10, 2020 13:23
sbr environment
name: sbr
channels:
- conda-forge
- defaults
dependencies:
- _libgcc_mutex=0.1=main
- _tflow_select=2.3.0=mkl
- absl-py=0.9.0=py37_0
- astunparse=1.6.3=py_0
- backcall=0.2.0=pyh9f0ad1d_0
---------------------------------------------------------------------------
OSError Traceback (most recent call last)
<ipython-input-104-696308cd97b4> in <module>
----> 1 dblk_lm.summary(cases_mini[:100])
~/miniconda3/envs/fastai2/lib/python3.7/site-packages/fastai2/data/block.py in summary(self, source, bs, show_batch, **kwargs)
152 print(f"Setting-up type transforms pipelines")
153 dsets = self.datasets(source, verbose=True)
--> 154 print("\nBuilding one sample")
155 for tl in dsets.train.tls: