Skip to content

Instantly share code, notes, and snippets.

ALICE-5378: Add LinkedIn verification step into sourcing pipeline

Overview

This feature adds a new step in the enrichment pipeline where we verify the validity of the sourced persons company. We use the API provided by CrustData to get all the information pertaining to the persons linkedin URL (if available), then compare if the company obtained is the same as the one obtained from enrichment using fuzzy matching.

Background

Currently enrichment can provide stale data. Cognism returns data from when the person's information was scraped and not as it is at the time of enrichment, meaning the data can be outdated. This can lead to incorrect research or entirely wrong potential enrollments. The idea is to identify such cases using CrustData and for now document them. Potentially considering replacement or another option in the future.