thenamankumar

FIRST

• user will upload file to ROR -> upload S3 -> create entity in DB
• push job to sidekiq for chunking of the entity

SECOND

• process chunk generation async job in lambda
  • call lambda/chunk/generate?url=
    • parser url (html, md, pdf, docs, text, XML sitemap) based on MIME Type from content-type
    • text extraction
• chunking NLTK based limit 256 token length

thenamankumar

Adding streaming support and error recovery to reference GraphQL parser

GSOC 2020

Student: Naman Kumar

Mentor: Ivan Goncharov

Organisation: GraphQL Foundation

Goal

thenamankumar

const Rules: RulesType = require('./rules.json');

export type RuleName = string;

interface BaseRule {
  butNot?: RuleDefinition;
  optional?: boolean;
}

export interface OfValueRule extends BaseRule {

thenamankumar

{
  "SourceCharacter": { "ofPattern": "[\u0009\u000A\u000D\u0020-\uFFFF]" },

  "UnicodeBOM": { "ofValue": "\uFEFF" },

  "WhiteSpace": { "oneOf": ["\t", " "] },

  "LineTerminator": { "oneOfType": [{ "ofValue": "\n" }, { "ofValue": "\r" }, { "ofPattern": "\r\n" }] },

  "Comment": [{ "ofValue": "#" }, "CommentChar"],

thenamankumar

Keybase proof

I hereby claim:

• I am hereisnaman on github.
• I am strideraragon (https://keybase.io/strideraragon) on keybase.
• I have a public key ASDrXA_EfVMFlnwk2CgUyDulxeCcejj1MZhKKYq0SLsEjwo

To claim this, I am signing this object:

thenamankumar

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
	<key>Ansi 0 Color</key>
	<dict>
		<key>Alpha Component</key>
		<real>1</real>
		<key>Blue Component</key>
		<real>0.18094024062156677</real>

thenamankumar

export ZSH="/Users/naman/.oh-my-zsh"

ZSH_THEME="spaceship"
plugins=(
  git
  colorize
  zsh-256color
  zsh-autosuggestions
)

thenamankumar

set nocompatible
filetype off
filetype plugin on  " plugins are enabled
set rtp+=~/.vim/bundle/Vundle.vim

" vundlevim plugins
call vundle#begin()
Plugin 'SirVer/ultisnips'
Plugin 'digitaltoad/vim-pug'
Plugin 'nathanaelkane/vim-indent-guides'

thenamankumar

{
  "parser": "babel-eslint",
  "extends": "airbnb",
  "env": {
    "browser": true
  },
  "plugins": [
    "react"
  ]
}

thenamankumar

{
  "presets": [
    "es2015",
    "react"
  ],
  "plugins": [
    "react-hot-loader/babel"
  ]
}