hd_dash.md

A dashboard for Heat Detector

Need

Heat Detector is quite famous networkwide for its ability to detect rude and abusive comments. However the problem that we are facing at hand is that not many people are feeding back accurately (The bot utilizes ML and feedback is very very important for it's improvement). This issue can be easily solved by having a web dashboard.

Thoughts

Unlike CopyPastor, which had to be written from scratch, the dashboard for HD can be easily forked from Sentinel. The similarities between Natty and HD are:

• Both are related to flagging (comment vs answer)
• Both have various reasons for detections
• Both need feedback

Hence we can remod Sentinel and create a similar web dash board for HD. As none of us know Ruby, we'll need to trouble Art again.

Changes

Changes needed on the HeatDetector side:

• A proper/strict rule to differentiate between what should be a true positive and what should be a false positive.
• A way to provide feedback through a command, so that a userscript could be made use of.
• And of course, calling the dashboard in every report.

Challenges

• Framing the strong rules to differentiate between a heated argument and not is often subjective. Quantizing this in someway in order to improve the algorithm would be the first challenge. (This is not related to the dashboard development work, but the way we provide feedback).
• Few of the posts might be borderline, and we wouldn't want to feedback these. Hence a way to "not provide feedback" would be needed.

Hosting

We can host it on the sobotics webserver. That would not be an issue.

Names

I've thought of a few, which are closely related to Heat Detection.

Inferno

Sprinkler

👍 I fully agree with you that a dashboard like that would a huge improvement to review heat, but i would like to add a minor point:

In the review rules should be determined how to deal with self-blaming comments (e.g. "Oh gosh, I missed that. Stupid me.") as they get caught very often.

Also for the name, I would suggest Sprinkler, as we are fighting the heat.

I love inferno :D since we will fill the dashboard with bad stuff, "Oh gosh, I missed that. Stupid me." is a false positive (problem mostly related to a combination between Perspective and Regex), feeding these comments as good comment probably can avoid the problem.

Giving correct feedback to Heat Detector is fundamental since it mainly depends on Machine Learning, the problem with comments are that they are "Subjective", We have posted some meta to find a threshold, but with no direct result.

Currently before adding the feedback to the model I need to manually review'em, I think we will need a third feedback that is "so so bad", this way the cristal clear rude we can add directly to feed.

Reasons we can't just add posts/feedback capabilities to Redunda, and avoid adding another dependency? cc @Undo1 @NobodyNada

As for name, I vote Sprinkler.

Aside: Sprinkler and Inferno are just the names which I've thought of, do propose other names, if you feel that they're better!

Some other name suggestions: Hypoxia or Ice

Also, I vote against Sprinkler

FWIW, I do think that Inferno isn't that good name for the dash. It can be used for the HD Datadump project, which is also on the cards.

The reason why I thought of Sprinkler was because it is used to prevent accidental fires upon heat detection. Ice is also a nice name, but I'd vote against Hypoxia. Need to find a nice logo for Ice, if we decide to continue on that. "Tempest" 🌊, is one other thing which I can come up with.

For information, I currently have a table with around 40.000 comments in mysql, furthermore probably we need to understand what to show in dashboard. I'm not so sure that SE likes us to show user who passed comment or any other user names. (@ are easy to remove with regex) but if they don't have @ it's almost impossibile. SE before providing feed manually reviewed and removed see https://meta.stackoverflow.com/questions/326494/can-i-have-a-dump-of-rude-abusive-comments#comment359354_326494 and other comments.

Lava, Torch, Slake, Water Gun, Drench, Molotov, Condenser, Cinder, Ember, Slag

Well, now that the quartata called dibs on the name, we'll not be able to use Inferno, even if we wanted to. So, @Floern, we'll be using one of your names. We need a kick ass logo to go with the name.

I have created a form for the name voting

@jdd-software We could restrict the dashboard (or at least showing comments) to authenticated SOBotics-members

Top 3 results of the name voting (now closed):

1. Winner: Hydrant, and the logo could be a 7-headed hydrant (suggested by Andras Deak) with 10 votes/62.5%
2. Ice (suggested by Bhargav Rao) with 6 votes/37.5%
3. Sprinkler (suggested by Bhargav Rao) with 5 votes/31.3%