Skip to content

Instantly share code, notes, and snippets.

View rupeshtiwari's full-sized avatar
🎯
Focusing

Rupesh Tiwari rupeshtiwari

🎯
Focusing
View GitHub Profile
@rupeshtiwari
rupeshtiwari / aws forecast demo.md
Created September 11, 2024 14:03
aws forecast demo

To build a short demo for AWS Forecast, you’ll want to focus on the key steps involved in setting up, training, and generating predictions. Here's a simple guide to create a short demo:

1. Define the Scope of the Demo (5-10 minutes)

  • Objective: Show how to upload historical data, train a model, and generate predictions using AWS Forecast.
  • Example Use Case: Predict demand for a product based on historical sales data.

2. Prepare Your Data (1 minute)

  • Use a simple time-series dataset (e.g., historical sales, demand data, or temperature).
  • Format the dataset as CSV with columns such as timestamp, item_id, and demand.
  • Make sure the dataset is in a format acceptable by AWS Forecast (e.g., Amazon S3 CSV file).
@rupeshtiwari
rupeshtiwari / samsung android mobile copy to mac laptop.md
Created August 30, 2024 12:12
samsung android mobile copy to mac laptop

To transfer photos from your Android device to your Mac using the command line, follow these steps:

  1. Install adb (Android Debug Bridge):

    • If you haven't already installed adb, you can do so using Homebrew:
      brew install android-platform-tools
  2. Enable Developer Options and USB Debugging on Android:

    • Go to Settings > About phone, then tap Build number seven times to enable Developer Options.
@rupeshtiwari
rupeshtiwari / AWS Machine Learning Certification Notes.md
Last active June 21, 2024 18:51
AWS Machine Learning Certification Notes

Preparing for the AWS Certified Machine Learning – Specialty Exam: Key Concepts and Tools

Earning the AWS Certified Machine Learning – Specialty certification requires a solid understanding of various machine learning concepts, tools, and AWS services. Here are some of the key topics and resources that helped me prepare for the exam.

What is classifier?

In Amazon SageMaker, a classifier is a type of machine learning model that categorizes or classifies data into distinct classes or categories based on input features. Here are the key concepts related to classifiers and the metrics used to evaluate them:

Key Metrics for Classifiers

  1. Accuracy:
@rupeshtiwari
rupeshtiwari / OpenSearch Basics.md
Last active June 13, 2024 02:06
OpenSearch Basics

What is OpenSearch and Amazon OpenSearch Service

OpenSearch is a distributed, community-driven, Apache 2.0-licensed, 100% open-source search and analytics suite used for a broad set of use cases like real-time application monitoring, log analytics, and website search. OpenSearch provides a highly scalable system for providing fast access and response to large volumes of data with an integrated visualization tool, OpenSearch Dashboards, that makes it easy for users to explore their data. OpenSearch is powered by the Apache Lucene search library, and it supports a number of search and analytics capabilities such as k-nearest neighbors (KNN) search, SQL, Anomaly Detection, Machine Learning Commons, Trace Analytics, full-text search, and more.

Amazon OpenSearch Service is an AWS-managed service that lets you run and scale OpenSearch clusters without having to worry about managing, monitoring, and maintaining your infrastructure, or having to build in-depth expertise in operating OpenSearch clusters

@rupeshtiwari
rupeshtiwari / 01_lambda parse image using amazon textract.md
Last active June 6, 2024 18:11
lambda parse image using amazon textract and index in amazon Q

Parse Image file using Amazon Textract and AWS Lambda

let's start from the beginning and go step-by-step to create and test your Lambda function. This will involve setting up necessary IAM roles and policies, creating an S3 bucket, uploading an image, writing the Lambda function, and testing it.

Step 1: Set Up IAM Role for Lambda

  1. Create an IAM Role for Lambda:
  • Open the IAM console.
@rupeshtiwari
rupeshtiwari / AWS Certified Data Engineer - Associate DEA-C01.md
Created June 1, 2024 19:39
AWS Certified Data Engineer - Associate DEA-C01

AWS Certified Data Engineer - Associate DEA-C01: Key Concepts and Best Practices

Passing the AWS Certified Data Engineer – Associate DEA-C01 exam is a significant achievement. As you transition from studying to applying your knowledge, it’s essential to understand and implement best practices across various AWS services. This blog will explore critical areas, including change data capture (CDC), performance tuning, access control, and more.

Implementing CDC-Based Upserts in a Data Lake

Efficiently managing data lakes is crucial for scalable analytics. Using Apache Iceberg with AWS Glue, you can implement a CDC-based upsert mechanism, ensuring your data lake remains up-to-date with minimal performance overhead. This approach supports efficient query performance by avoiding full data scans and focusing on incremental changes. For more information, refer to the [blog on implementing CDC-based upserts](https://aws.amazon.com/blogs/big-data/implement-a-cdc-based-upsert-in-a-data-lake-using-apache-icebe

@rupeshtiwari
rupeshtiwari / Use Case: Protecting E-commerce Order Data from Ransomware.md
Last active May 31, 2024 20:17
Use Case: Protecting E-commerce Order Data from Ransomware with Amazon OpenSearch

For a real-world use case, we can choose sample e-commerce order data to set up a Security Analytics detector to protect against ransomware attacks. E-commerce platforms are frequent targets due to the valuable financial data they hold.

Use Case: Protecting E-commerce Order Data from Ransomware

image

Scenario:

We want to set up a Security Analytics detector in Amazon OpenSearch Service to monitor for ransomware activities like data exfiltration and system state backup deletion, commonly seen in ransomware attacks like BlackCat and LockBit.

Steps to Set Up Security Analytics Detector

@rupeshtiwari
rupeshtiwari / 01_I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!.md
Last active May 30, 2024 22:04
I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I Passed the AWS Certified Data Analytics – Specialty (DAS-C01) Exam!

I'm happy to share that I have successfully passed the AWS Certified Data Analytics – Specialty (DAS-C01) exam. It was a challenging journey, and I'd like to share some of the key resources that helped me prepare for this achievement.

@rupeshtiwari
rupeshtiwari / Create React App Host in Amplify.md
Last active May 29, 2024 17:20
Create React App Host in Amplify, aws amplify, react app

Great, let's create a React application called "Activity Logger" and host it using AWS Amplify with Git integration. Here’s a step-by-step guide:

Step 1: Set Up the React App

  1. Install Node.js: Make sure you have Node.js and npm installed. You can download and install it from nodejs.org.

  2. Create a New React App: Use Create React App to bootstrap your React project.