dtaivpp

Semantic Search with OpenSearch and Cohere

Cluster Settings:

PUT /_cluster/settings
{
    "persistent": {
        "plugins.ml_commons.allow_registering_model_via_url": true,
        "plugins.ml_commons.only_run_on_ml_node": false,
        "plugins.ml_commons.connector_access_control_enabled": true,

dtaivpp

Find the image to save

docker images

Save to destination

docker save -o /path/to/output.tar org/container

Import

docker docker load -i /path/to/output.tar

dtaivpp

version: '3'

services:
  opensearch:
    image: opensearchproject/opensearch:${OPENSEARCH_VERSION:-2.11.1}
    container_name: opensearch
    environment:
      discovery.type: single-node
      node.name: opensearch
      OPENSEARCH_JAVA_OPTS: "-Xms512m -Xmx512m"

dtaivpp

# Download this file with:
# curl -L https://gist.githubusercontent.com/dtaivpp/a9b00957aa7d9cfe33e92aff8d50c835/raw/logging_demo.py -o logging_demo.py
import logging

#
# Named loggers
#
logger = logging.getLogger(__name__)
print(logger.name)

dtaivpp

version = 2
  [plugins]
    [plugins."io.containerd.grpc.v1.cri"]
      [plugins."io.containerd.grpc.v1.cri".containerd]
        default_runtime_name = "nvidia"

        [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
          [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.nvidia]
            privileged_without_host_devices = false
            runtime_engine = ""

dtaivpp

usage: ghdorker [-h] [-v] [-s {repo,user,org}] [-d DORKS] [--debug] [-o OUTPUT_FILENAME] [--options INPUT_OPTION [INPUT_OPTION ...]] search

Search github for github dorks

positional arguments:
  search                The repo, username, or organization you would like to search

optional arguments:
  -h, --help            show this help message and exit
  -v, --version         show program's version number and exit

dtaivpp

import yaml
import os

yaml_files = []

rootDir = '.'
for dirName, subdirList, fileList in os.walk(rootDir):
  for fname in fileList:
    if fname[-4:] == 'yaml':
     yaml_files.append( dirName + "/" + fname)

dtaivpp

{
    "name": "Python 3",
    "build": {
        "dockerfile": "Dockerfile",
        "context": "..",
        "args": { 
            // Update 'VARIANT' to pick a Python version: 3, 3.6, 3.7, 3.8, 3.9
            "VARIANT": "3",
            // Options
            "INSTALL_NODE": "true",

dtaivpp

2021-04-30 10:38:14,360 - __main__ - ERROR - HTTPSConnectionPool(host='api-you-want-to-use.com', port=443): Max retries exceeded with url: /ccx/service/customreport2/org/wamitchell/ORG_Network_ID_Validation_-_IT_Location?Effective_as_of_Date=2021-04-30-01%3A00 (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:847)'),))
Traceback (most recent call last):
  File "c:\Software\<some-repo>\venv\lib\site-packages\urllib3\connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "c:\Software\<some-repo>\venv\lib\site-packages\urllib3\connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "c:\Software\<some-repo>\venv\lib\site-packages\urllib3\connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "c:\Software\<some-repo>\venv\lib\site-packages\urllib3\connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,

dtaivpp

# Credit to Mark Brilman https://www.markbrilman.nl/2011/08/howto-convert-a-pfx-to-a-seperate-key-crt-file/

# Output Key
# pkcs12 is just .pfx
openssl pkcs12 -in [yourfile.pfx] -nocerts -out [keyfile-encrypted.key]

# Output Cert
openssl pkcs12 -in [yourfile.pfx] -clcerts -nokeys -out [certificate.crt]

# Output Decrypted Key