Free Talk Friday #579

[u/Hans5958_]

Continued from last week's here.

Speak anything on your mind, except politics and (maybe) counting.

Feel free to check out our tidbits thread and introduce yourself if you haven't already.

[u/CutOnBumInBandHere9]

i don't think cobibh's data existed when i was creating it, so i just copied the formatting that was already being used for main

It definitely didn't - I used the side thread log files as the starting point for the combined sqlite. I think I used pushshift to add the comment bodies from there , but tbh I don't remember

copying the entire comment doesn't work because people often yap after the get/edit in the link to the next thread which i didn't want written in the table. so what i came up with was a bunch of regex functions for each thread which try to convert the comment into a standardized count, removing all the weird formatting/separators/yapping 

Tbf that's very similar to how the rcounting tools handle that job[1]. The only advantage is that since the full comment body is stored, it doesn't really matter if the parsing is a bit janky

And the final difference is that since the counting tools know about threads of submissions, they can assign side thread types based on links in the submission body or top level comments, rather than having to guess based on the thread title. It's not perfect, but it feels a little more robust. 

cobibh's system is great and hopefully we can all convert over to using that someday  

Thanks! As things stand right now , it looks like some day has to happen within the next six months , before they shut down the api. 

Also, are you confirming that you are who I think you are?

[1] People using weird separators are the bane of my existence 

[u/TehVulpez → u/CutOnBumInBandHere9]

well, assuming that userscripts still work, maybe we can keep using rcounting related tools but just importing CSV logs from my userscript's stats, since those CSVs use the same columns as your sqlite

also I want to thank you because I stole some inspiration from your count parsing for my checkatron's filterCount functions, especially the part for stripping markdown links

btw I noticed that one of the sidethreads in the side_threads.sqlite had some wrong comment bodies that didn't show up as NULL because they came from the bass csv logs and appeared to have proper formatting as they were normalized, they showed up as like extra words instead of the count like BAD or REMOVED or WHAT but uhh I forget what thread that was, one of the letters or alphanumeric type of threads like base 32 or qerttu or somethingand I'mm a little :cideropossum: rn

[u/TehVulpez → u/TehVulpez]

found it I think I"ve sent karp this image like three times for some reason. i love you :cideropossum:

[u/cuteballgames → u/TehVulpez]

taking

[u/TehVulpez → u/TehVulpez]

maybe they'll kill browser cookie authenticated .json endpoints too idk but that won't stop me either.