Skip to content

Instantly share code, notes, and snippets.

View rupeshtiwari's full-sized avatar
🎯
Focusing

Rupesh Tiwari rupeshtiwari

🎯
Focusing
View GitHub Profile
@rupeshtiwari
rupeshtiwari / Use Case: Protecting E-commerce Order Data from Ransomware.md
Last active May 31, 2024 20:17
Use Case: Protecting E-commerce Order Data from Ransomware with Amazon OpenSearch

For a real-world use case, we can choose sample e-commerce order data to set up a Security Analytics detector to protect against ransomware attacks. E-commerce platforms are frequent targets due to the valuable financial data they hold.

Use Case: Protecting E-commerce Order Data from Ransomware

image

Scenario:

We want to set up a Security Analytics detector in Amazon OpenSearch Service to monitor for ransomware activities like data exfiltration and system state backup deletion, commonly seen in ransomware attacks like BlackCat and LockBit.

Steps to Set Up Security Analytics Detector

@rupeshtiwari
rupeshtiwari / 01_I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!.md
Last active May 30, 2024 22:04
I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I'm happy to share that I have successfully passed the AWS Certified Data Analytics – Specialty (DAS-C01) exam. It was a challenging journey, and I'd like to share some of the key resources that helped me prepare for this achievement.

@rupeshtiwari
rupeshtiwari / Create React App Host in Amplify.md
Last active May 29, 2024 17:20
Create React App Host in Amplify, aws amplify, react app

Great, let's create a React application called "Activity Logger" and host it using AWS Amplify with Git integration. Here’s a step-by-step guide:

Step 1: Set Up the React App

  1. Install Node.js: Make sure you have Node.js and npm installed. You can download and install it from nodejs.org.

  2. Create a New React App: Use Create React App to bootstrap your React project.

@rupeshtiwari
rupeshtiwari / getting started with aws amplify.md
Created May 29, 2024 16:10
getting started with aws amplify

Getting started with aws amplify

Sure, let's use AWS Amplify to set up and host your Live App. AWS Amplify simplifies the process of building, deploying, and hosting web applications. Here's a step-by-step guide to create and deploy a simple HTML-based Quip Live App using AWS Amplify.

Step 1: Set Up Your AWS Amplify Project

  1. Install Amplify CLI:
    • Make sure you have Node.js and npm installed.
  • Install the Amplify CLI globally.
@rupeshtiwari
rupeshtiwari / apple script learning.md
Last active May 13, 2024 21:15
apple script learning

Hellow World App

tell application "Finder"
	display dialog "Hello World"
end tell
@rupeshtiwari
rupeshtiwari / apple script to move the presentation on top left fhd.md
Last active May 13, 2024 22:22
apple script to move the presentation on top left with full hd 1920x1080, resize, fhd,

Resize keynote to FHD (1920x1080)

tell application "Keynote"
	activate
	try
		set theDoc to front document
	on error
		set theDoc to make new document
	end try
@rupeshtiwari
rupeshtiwari / Mathura and Vrindavan.md
Last active May 7, 2024 19:56
Mathura and Vrindavan

Here's a streamlined guide with highlighted key points for each major attraction in Mathura, focusing on the essential aspects and must-do activities, particularly from a Hindu cultural perspective:

1. Shri Krishna Janmabhoomi Temple

  • Essentials: Birthplace of Lord Krishna, spiritual ceremonies.
  • Must-Do: Participate in the evening aarti; it's a profound devotional experience.

2. Dwarkadhish Temple

  • Essentials: Rich architecture, vibrant festivities.
  • Must-Do: Attend the festival celebrations during Janmashtami for a lively and colorful experience.
@rupeshtiwari
rupeshtiwari / seafile-with-segate-drive.md
Last active April 29, 2024 00:08
Personal cloud on MacOs, local cloud,

Certainly! Below is a README file you can use to guide yourself or others on setting up a Seafile Docker instance with data storage on an external drive (in this case, a Seagate external drive, which we'll refer to as ExtDrive). This document will include all necessary steps to ensure that Seafile uses this external drive for storing files.


Setting Up Seafile on Docker with External Drive Storage

This README provides detailed instructions on how to set up Seafile using Docker, specifically configured to store data on an external Seagate drive named ExtDrive. Follow these steps to ensure your data is stored securely and externally from your main system.

Prerequisites

@rupeshtiwari
rupeshtiwari / Data Analytics Late Arrival Handling.md
Last active April 25, 2024 14:21
Data Analytics Late Arrival Handling

Techniques to handle late arrival

Watermarks and Allowed Lateness are both vital techniques in managing late data in stream processing systems, but they serve slightly different purposes and are often used in conjunction to maximize data integrity and processing efficiency. Here’s an in-depth look at when and why you might choose to use each technique, or both together, along with real-world industry examples.

Watermarks

Purpose: Watermarks are primarily used to handle out-of-order data. They provide a way to estimate the "completeness" of data up to a certain point in time, based on event timestamps.

When to Use: Use watermarks when:

  • You expect data to arrive out of order.
  • You need a mechanism to know when to close a window and process its data.
@rupeshtiwari
rupeshtiwari / 00_GCP Data Services.md
Last active April 25, 2024 14:57
GCP Data Services, GCP services, Google services, Google

Here's the table sorted chronologically based on the release date of each Google Cloud service:

Google Cloud Service Release Date Based on/Open-source Inspiration Open-source Start Date Notes
Google BigQuery 2010 Dremel (Internal Google Tech) N/A BigQuery is inspired by Dremel but is not directly based on open-source technology.
Google Cloud Dataflow 2014 Apache Beam 2016 (as Apache Beam) Initially developed by Google as Google Dataflow, then donated to the Apache Software Foundation as Apache Beam.
Google Cloud Composer 2018 Apache Airflow 2015 Developed by Airbnb and later open-sourced as Apache Airflow, which Google adopted for Cloud Composer.
Google Data Fusion 2019 CDAP (Cask Data Application Platform) 2011