Skip to content

Instantly share code, notes, and snippets.

View rupeshtiwari's full-sized avatar
🎯
Focusing

Rupesh Tiwari rupeshtiwari

🎯
Focusing
View GitHub Profile
@rupeshtiwari
rupeshtiwari / AWS Machine Learning Certification Notes.md
Last active June 21, 2024 18:51
AWS Machine Learning Certification Notes

Preparing for the AWS Certified Machine Learning – Specialty Exam: Key Concepts and Tools

Earning the AWS Certified Machine Learning – Specialty certification requires a solid understanding of various machine learning concepts, tools, and AWS services. Here are some of the key topics and resources that helped me prepare for the exam.

What is classifier?

In Amazon SageMaker, a classifier is a type of machine learning model that categorizes or classifies data into distinct classes or categories based on input features. Here are the key concepts related to classifiers and the metrics used to evaluate them:

Key Metrics for Classifiers

  1. Accuracy:
@rupeshtiwari
rupeshtiwari / OpenSearch Basics.md
Last active June 13, 2024 02:06
OpenSearch Basics

What is OpenSearch and Amazon OpenSearch Service

OpenSearch is a distributed, community-driven, Apache 2.0-licensed, 100% open-source search and analytics suite used for a broad set of use cases like real-time application monitoring, log analytics, and website search. OpenSearch provides a highly scalable system for providing fast access and response to large volumes of data with an integrated visualization tool, OpenSearch Dashboards, that makes it easy for users to explore their data. OpenSearch is powered by the Apache Lucene search library, and it supports a number of search and analytics capabilities such as k-nearest neighbors (KNN) search, SQL, Anomaly Detection, Machine Learning Commons, Trace Analytics, full-text search, and more.

Amazon OpenSearch Service is an AWS-managed service that lets you run and scale OpenSearch clusters without having to worry about managing, monitoring, and maintaining your infrastructure, or having to build in-depth expertise in operating OpenSearch clusters

@rupeshtiwari
rupeshtiwari / 01_lambda parse image using amazon textract.md
Last active June 6, 2024 18:11
lambda parse image using amazon textract and index in amazon Q

Parse Image file using Amazon Textract and AWS Lambda

let's start from the beginning and go step-by-step to create and test your Lambda function. This will involve setting up necessary IAM roles and policies, creating an S3 bucket, uploading an image, writing the Lambda function, and testing it.

Step 1: Set Up IAM Role for Lambda

  1. Create an IAM Role for Lambda:
  • Open the IAM console.
@rupeshtiwari
rupeshtiwari / AWS Certified Data Engineer - Associate DEA-C01.md
Created June 1, 2024 19:39
AWS Certified Data Engineer - Associate DEA-C01

AWS Certified Data Engineer - Associate DEA-C01: Key Concepts and Best Practices

Passing the AWS Certified Data Engineer – Associate DEA-C01 exam is a significant achievement. As you transition from studying to applying your knowledge, it’s essential to understand and implement best practices across various AWS services. This blog will explore critical areas, including change data capture (CDC), performance tuning, access control, and more.

Implementing CDC-Based Upserts in a Data Lake

Efficiently managing data lakes is crucial for scalable analytics. Using Apache Iceberg with AWS Glue, you can implement a CDC-based upsert mechanism, ensuring your data lake remains up-to-date with minimal performance overhead. This approach supports efficient query performance by avoiding full data scans and focusing on incremental changes. For more information, refer to the [blog on implementing CDC-based upserts](https://aws.amazon.com/blogs/big-data/implement-a-cdc-based-upsert-in-a-data-lake-using-apache-icebe

@rupeshtiwari
rupeshtiwari / Use Case: Protecting E-commerce Order Data from Ransomware.md
Last active May 31, 2024 20:17
Use Case: Protecting E-commerce Order Data from Ransomware with Amazon OpenSearch

For a real-world use case, we can choose sample e-commerce order data to set up a Security Analytics detector to protect against ransomware attacks. E-commerce platforms are frequent targets due to the valuable financial data they hold.

Use Case: Protecting E-commerce Order Data from Ransomware

image

Scenario:

We want to set up a Security Analytics detector in Amazon OpenSearch Service to monitor for ransomware activities like data exfiltration and system state backup deletion, commonly seen in ransomware attacks like BlackCat and LockBit.

Steps to Set Up Security Analytics Detector

@rupeshtiwari
rupeshtiwari / 01_I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!.md
Last active May 30, 2024 22:04
I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I'm happy to share that I have successfully passed the AWS Certified Data Analytics – Specialty (DAS-C01) exam. It was a challenging journey, and I'd like to share some of the key resources that helped me prepare for this achievement.

@rupeshtiwari
rupeshtiwari / Create React App Host in Amplify.md
Last active May 29, 2024 17:20
Create React App Host in Amplify, aws amplify, react app

Great, let's create a React application called "Activity Logger" and host it using AWS Amplify with Git integration. Here’s a step-by-step guide:

Step 1: Set Up the React App

  1. Install Node.js: Make sure you have Node.js and npm installed. You can download and install it from nodejs.org.

  2. Create a New React App: Use Create React App to bootstrap your React project.

@rupeshtiwari
rupeshtiwari / getting started with aws amplify.md
Created May 29, 2024 16:10
getting started with aws amplify

Getting started with aws amplify

Sure, let's use AWS Amplify to set up and host your Live App. AWS Amplify simplifies the process of building, deploying, and hosting web applications. Here's a step-by-step guide to create and deploy a simple HTML-based Quip Live App using AWS Amplify.

Step 1: Set Up Your AWS Amplify Project

  1. Install Amplify CLI:
    • Make sure you have Node.js and npm installed.
  • Install the Amplify CLI globally.
@rupeshtiwari
rupeshtiwari / apple script learning.md
Last active May 13, 2024 21:15
apple script learning

Hellow World App

tell application "Finder"
	display dialog "Hello World"
end tell
@rupeshtiwari
rupeshtiwari / apple script to move the presentation on top left fhd.md
Last active May 13, 2024 22:22
apple script to move the presentation on top left with full hd 1920x1080, resize, fhd,

Resize keynote to FHD (1920x1080)

tell application "Keynote"
	activate
	try
		set theDoc to front document
	on error
		set theDoc to make new document
	end try