rehmatworks

I needed to create a unique index on a MongoDB collection and I faced the duplicate errors. To delete duplicates, here is what I found to be working. This solution was suggested by ChatGPT 3.5. Please try this at your own risk.

Apologies for the confusion. To delete duplicates while keeping one copy of each document, you can use the following steps:

1. Connect to your MongoDB database and switch to the "profiles" database.

2. Identify the duplicate documents based on the "details.company_id" field using the aggregation framework:

rehmatworks

[
  "Afghanistan",
  "Albania",
  "Algeria",
  "Andorra",
  "Angola",
  "Antigua and Barbuda",
  "Argentina",
  "Armenia",
  "Australia",

rehmatworks

[
  "Abas",
  "Abbas",
  "Abbasi",
  "Abdul ghani",
  "Abdul majid",
  "Abdul satar",
  "Abdullah",
  "Abid",
  "Adnan",

rehmatworks

[
  "Aabha",
  "Aabia",
  "Aabid",
  "Aabida",
  "Aabidaat",
  "Aabidah",
  "Aabir",
  "Aabira",
  "Aabirah",

rehmatworks

import requests


API_KEY = 'admin-consumer-api-key'
API_BASE = 'https://api.amzdata.io/admin'
CONSUMER_BASE = f'{API_BASE}/consumers'
API_ACL_GROUP_NAME = 'paid-users'


class KongAdmin:

rehmatworks

import requests

headers = {
    'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
    'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36',
    'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
}

response = requests.get('https://www.dnb.com/business-directory/company-profiles.pfizer_inc.140f48fa0b37556f925afcaec7b5c566.html', headers=headers)

rehmatworks

iptables -I DOCKER-USER -i eth0 -j DROP
iptables -I DOCKER-USER -m state --state RELATED,ESTABLISHED -j ACCEPT

rehmatworks

server {
    listen 80;
    server_name example.com;
    root /home/user/sites/example;
    index index.php index.html;

    location / {
         try_files $uri $uri/ /index.php$is_args$args;
    }

rehmatworks

# Become root
sudo su

# Update apt package cache
apt update

# Install NGINX
apt install nginx

# Creae a non-sudo user

rehmatworks

docker swarm init
docker service create --mode global --publish target=8000,published=80 serpsbot/flask-test

# Get join token for workers
docker swarm join-token worker

## Will return
docker swarm join --token xyz ip-address:port

## Execute this command on all worker nodes. We have deployed the service in global mode, so every worker that joins the cluser will