Skip to content

Instantly share code, notes, and snippets.

Avatar

Charmy Feng fcharmy

View GitHub Profile
View bad_case_response.json
{
"overview": {
"concept_group_names": [
"category",
"sleeve_length",
"pattern"
]
},
"results": [
{
View confusion_matrix_response.json
{
"overview": {
"concept_group_names": [
"category",
"sleeve_length",
"pattern"
]
},
"results": [
{
View pr_curve_response.json
{
"overview": {
"concept_group_names": [
"category",
"sleeve_length",
"pattern"
]
},
"results": [
{
View pr_curve_request.json
{
"metric": [
"pr_curve"
],
"image": [
{
"image": {
"im_id": "xxx",
"width": 512,
"height": 512
View confusion_matrix_request.json
{
"metric": [
"confusion_matrix"
],
"image": [
{
"image": {
"im_id": "xxx",
"width": 512,
"height": 512
View acc_1_response.json
{
"overview": {
"concept_group_names": [
"category",
"sleeve_length",
"pattern"
]
},
"results": [
{
View acc_1_request.json
{
"metric": [
"acc_1"
],
"image": [
{
"image": {
"im_id": "xxx",
"width": 512,
"height": 512
View prec_rec_f1_request.json
{
"metric": [
"prec_rec_f1"
],
"image": [
{
"image": {
"im_id": "xxx",
"width": 512,
"height": 512
View prec_rec_f1_response.json
{
"overview": {
"concept_group_names": [
"category",
"sleeve_length",
"pattern"
],
"metrics": {
"prec_rec_f1": {
"type": "table",
@fcharmy
fcharmy / ig_scrapy_spider.py
Last active Sep 26, 2018
Crawl IG hashtag posts including post link, main images url, thumbnail, is_video, username, likes, caption, posted time, user profile image url. Only show the spider implementation, pipeline need to be implement separately.
View ig_scrapy_spider.py
import json
import urllib.parse as urlparse
from scrapy import Item, Field, Spider, Request
from scrapy.exceptions import CloseSpider
# ------ Instagram settings ------
IG_SERVER = "https://www.instagram.com"
IG_PATH = '/explore/tags/'
IG_POST_PATH = "p/"
You can’t perform that action at this time.