Skip to content

Instantly share code, notes, and snippets.

View dev-amolrakh's full-sized avatar
🎯
Focusing

Amol Rakh dev-amolrakh

🎯
Focusing
View GitHub Profile
@dev-amolrakh
dev-amolrakh / fast_csv_load.py
Last active October 13, 2025 13:46
𝑬𝒇𝒇𝒊𝒄𝒊𝒆𝒏𝒕 𝑪𝑺𝑽 𝒍𝒐𝒂𝒅 (𝒅𝒕𝒚𝒑𝒆𝒔 + 𝒖𝒔𝒆𝒄𝒐𝒍𝒔 + 𝒄𝒉𝒖𝒏𝒌𝒊𝒏𝒈). 𝐏𝐫𝐨𝐛𝐥𝐞𝐦: Large CSV OOM or slow parse. 𝐒𝐨𝐥𝐮𝐭𝐢𝐨𝐧: Specify dtypes, read only needed cols, use chunks.
# fast_csv_load.py
import pandas as pd
def load_csv(path, usecols=None, dtypes=None, chunksize=10_000):
if dtypes is None:
dtypes = {}
if chunksize:
chunks = []
for chunk in pd.read_csv(path, usecols=usecols, dtype=dtypes, chunksize=chunksize):
chunks.append(chunk)
@dev-amolrakh
dev-amolrakh / set_seed.py
Created October 13, 2025 13:42
Set seeds for Python, NumPy, PyTorch, TensorFlow.
# set_seed.py
# Set deterministic seeds for reproducibility across libs.
import os
import random
import numpy as np
def set_seed(seed: int = 42):
os.environ["PYTHONHASHSEED"] = str(seed)
random.seed(seed)
@dev-amolrakh
dev-amolrakh / fileUploadConfig.js
Created October 13, 2025 13:34
Configures Multer for secure and organized file uploads in Express.js.
import multer from "multer";
const storage = multer.diskStorage({
destination: "uploads/",
filename: (_, file, cb) => cb(null, Date.now() + "-" + file.originalname),
});
export const upload = multer({ storage });
@dev-amolrakh
dev-amolrakh / responseLogger.js
Created October 13, 2025 13:32
Response Time Logger + Error Logging using Morgan and Winston. Simple Express.js setup for logging API response times and errors using Morgan and Winston. Helps backend developers track performance and store logs efficiently
// responseLogger.js
// Express.js middleware to log API response times and errors using Morgan and Winston.
import express from "express";
import morgan from "morgan";
import winston from "winston";
import path from "path";
import fs from "fs";
const app = express();
@dev-amolrakh
dev-amolrakh / connectDB.js
Last active October 13, 2025 14:06
Reusable function to connect to MongoDB using mongoose
import mongoose from "mongoose";
export const connectDB = async () => {
try {
await mongoose.connect(process.env.MONGO_URI);
console.log("MongoDB Connected");
} catch (err) {
console.error("DB Connection Failed:", err);
process.exit(1);
}
@dev-amolrakh
dev-amolrakh / ApiError.js
Created October 11, 2025 18:04
Centralize error management. (Common Error Handler)
export const errorHandler = (err, req, res, next) => {
console.error(err.stack);
res.status(err.status || 500).json({
success: false,
message: err.message || "Server Error",
});
};
@dev-amolrakh
dev-amolrakh / rateLimiter.js
Last active October 11, 2025 18:02
Rate Limiter Middleware: Prevent brute-force or DDoS attacks.
import rateLimit from "express-rate-limit";
export const limiter = rateLimit({
windowMs: 15 * 60 * 1000,
max: 100,
message: "Too many requests, try again later.",
});
@dev-amolrakh
dev-amolrakh / envLoader.js
Last active October 11, 2025 17:57
Purpose: Securely manage configuration outside code.
import dotenv from "dotenv";
dotenv.config();
export const API_KEY = process.env.API_KEY;
export const DB_URL = process.env.MONGODB_URI;