Skip to content

Instantly share code, notes, and snippets.

@Bhargav-Rao
Last active November 19, 2018 12:52
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save Bhargav-Rao/d77ed02fadd50223b31c0b7aa8f5ddae to your computer and use it in GitHub Desktop.

A dashboard for Heat Detector

Need

Heat Detector is quite famous networkwide for its ability to detect rude and abusive comments. However the problem that we are facing at hand is that not many people are feeding back accurately (The bot utilizes ML and feedback is very very important for it's improvement). This issue can be easily solved by having a web dashboard.

Thoughts

Unlike CopyPastor, which had to be written from scratch, the dashboard for HD can be easily forked from Sentinel. The similarities between Natty and HD are:

  • Both are related to flagging (comment vs answer)
  • Both have various reasons for detections
  • Both need feedback

Hence we can remod Sentinel and create a similar web dash board for HD. As none of us know Ruby, we'll need to trouble Art again.

Changes

Changes needed on the HeatDetector side:

  • A proper/strict rule to differentiate between what should be a true positive and what should be a false positive.
  • A way to provide feedback through a command, so that a userscript could be made use of.
  • And of course, calling the dashboard in every report.

Challenges

  • Framing the strong rules to differentiate between a heated argument and not is often subjective. Quantizing this in someway in order to improve the algorithm would be the first challenge. (This is not related to the dashboard development work, but the way we provide feedback).
  • Few of the posts might be borderline, and we wouldn't want to feedback these. Hence a way to "not provide feedback" would be needed.

Hosting

We can host it on the sobotics webserver. That would not be an issue.

Names

I've thought of a few, which are closely related to Heat Detection.

Inferno

Inferno

Sprinkler

Sprinkler

@Filnor
Copy link

Filnor commented Jan 5, 2018

👍 I fully agree with you that a dashboard like that would a huge improvement to review heat, but i would like to add a minor point:

In the review rules should be determined how to deal with self-blaming comments (e.g. "Oh gosh, I missed that. Stupid me.") as they get caught very often.

Also for the name, I would suggest Sprinkler, as we are fighting the heat.

@jdd-software
Copy link

I love inferno :D since we will fill the dashboard with bad stuff, "Oh gosh, I missed that. Stupid me." is a false positive (problem mostly related to a combination between Perspective and Regex), feeding these comments as good comment probably can avoid the problem.

Giving correct feedback to Heat Detector is fundamental since it mainly depends on Machine Learning, the problem with comments are that they are "Subjective", We have posted some meta to find a threshold, but with no direct result.

Currently before adding the feedback to the model I need to manually review'em, I think we will need a third feedback that is "so so bad", this way the cristal clear rude we can add directly to feed.

@ArtOfCode-
Copy link

ArtOfCode- commented Jan 5, 2018

Reasons we can't just add posts/feedback capabilities to Redunda, and avoid adding another dependency? cc @Undo1 @NobodyNada

As for name, I vote Sprinkler.

@Bhargav-Rao
Copy link
Author

Aside: Sprinkler and Inferno are just the names which I've thought of, do propose other names, if you feel that they're better!

@Floern
Copy link

Floern commented Jan 5, 2018

Some other name suggestions: Hypoxia or Ice

Also, I vote against Sprinkler

@Bhargav-Rao
Copy link
Author

Bhargav-Rao commented Jan 5, 2018

FWIW, I do think that Inferno isn't that good name for the dash. It can be used for the HD Datadump project, which is also on the cards.

The reason why I thought of Sprinkler was because it is used to prevent accidental fires upon heat detection. Ice is also a nice name, but I'd vote against Hypoxia. Need to find a nice logo for Ice, if we decide to continue on that. "Tempest" 🌊, is one other thing which I can come up with.

@jdd-software
Copy link

For information, I currently have a table with around 40.000 comments in mysql, furthermore probably we need to understand what to show in dashboard. I'm not so sure that SE likes us to show user who passed comment or any other user names. (@ are easy to remove with regex) but if they don't have @ it's almost impossibile. SE before providing feed manually reviewed and removed see https://meta.stackoverflow.com/questions/326494/can-i-have-a-dump-of-rude-abusive-comments#comment359354_326494 and other comments.

@Floern
Copy link

Floern commented Jan 14, 2018

Lava, Torch, Slake, Water Gun, Drench, Molotov, Condenser, Cinder, Ember, Slag

@Bhargav-Rao
Copy link
Author

Well, now that the quartata called dibs on the name, we'll not be able to use Inferno, even if we wanted to. So, @Floern, we'll be using one of your names. We need a kick ass logo to go with the name.

@Filnor
Copy link

Filnor commented Jan 15, 2018

@FelixSFD
Copy link

@jdd-software We could restrict the dashboard (or at least showing comments) to authenticated SOBotics-members

@Filnor
Copy link

Filnor commented Jan 24, 2018

Top 3 results of the name voting (now closed):

  1. Winner: Hydrant, and the logo could be a 7-headed hydrant (suggested by Andras Deak) with 10 votes/62.5%
  2. Ice (suggested by Bhargav Rao) with 6 votes/37.5%
  3. Sprinkler (suggested by Bhargav Rao) with 5 votes/31.3%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment