#staff | Logs for 2014-04-16

« return[00:00:09] -!- Cyprus has quit [Quit: out]
[00:07:50] -!- mechanicjay has quit [Quit: Leaving.]
[00:24:54]MrBluze|afk is now known as MrBluze[03:01:55] -!- mechanicjay [mechanicjay!~jhowe@Soylent/Staff/Sysop/mechanicjay] has joined #staff
[03:01:55] -!- mode/#staff [+v mechanicjay] by juggler
[03:05:17]<NCommander> hey mechanicjay
[03:07:28]<mechanicjay> Hey NCommander
[03:07:35]<NCommander> mechanicjay, how's life?
[03:07:44]* NCommander just updated the DNS for using El Load Balancer[03:09:36]<mechanicjay> Busy, I'm only 3 weeks behind on grading stuff now. I think my students are about to revolt. I'm also a non-deterministic amount of time late on several projects at work, because I'm depending on resources I have no authority to command.
[03:09:49]<mechanicjay> Other than that, not bad!
[03:10:06]<mechanicjay> Load Balancing is very good news.
[03:10:11]<mechanicjay> How have you been?
[03:20:25]<NCommander> mechanicjay, surviving
[03:20:30]<NCommander> (sorry, IRC being buggy for me)
[03:20:36]<NCommander> Dealing with a lot of shit at work
[03:26:37] -!- Bytram|away [Bytram|away!~pc@Soylent/Staff/Developer/martyb] has joined #staff
[03:26:37] -!- mode/#staff [+v Bytram|away] by juggler
[03:27:02]Bytram|away is now known as Bytram[03:45:20] -!- MrBluze [MrBluze!~MrBluze@Soylent/Staff/IRC/MrBluze] has parted #staff
[04:08:01]<audioguy> mechanicjay: Did you get my email, I never got a reply. Assumed you were snowed.
[04:12:50]<mechanicjay> hey audioguy, yep, been snowed. When I finally got to replying, your server rejected my mail :( I resent from a different account a little while ago.
[04:15:58]<audioguy> Yeah, just saw that, reading... email from you... smbfc was rejected, will look into and whitelist. Not sure why that would be rejected.
[04:17:29]<mechanicjay> I'm relaying through my ISP's smtp server, which would be a cablevision or optonline domain -- I'd not be surprised if they've gotten themselves on some RBL list or something.
[04:20:17]<audioguy> Oddly, looking at my mail log, I am seeing a lot of these saying address soylent-staff-bounces@lists.soylent... does not resolv. NCommander was making some changes to dns, I wonder...
[04:21:03]<NCommander> audioguy, I only touched the soylentnews.org A record
[04:21:05]<NCommander> nothing else
[04:22:09]<mechanicjay> yeah, the lists record still looks just as mildly incorrect as it's been for months.
[04:22:10]<audioguy> Ok, this is a litle weird. Ok, some of that is really old though, checking the dates.
[04:22:55]<audioguy> mechanicjay: so far havent found a bounce for you, still looking, mess of bounces here. :-)
[04:23:19]<audioguy> 'your-server.de?
[04:23:54]<mechanicjay> I'd forward you the bounce, but, ermm.
[04:24:12]<mechanicjay> Reporting-MTA: dns;mta3.srv.hcvlny.cv.net (tcp-daemon)
[04:24:33]<audioguy> if you forward to audioguy@soylentnews.org should come in no matter what
[04:25:12]<audioguy> Ah cv.net I see
[04:25:22]<audioguy> Did not expect it to be that one.
[04:25:28]<audioguy> Can track it down now.
[04:27:10]<mechanicjay> Yeah, I'm too cheap to pay them for a static ip, so I relay outgoing through them. I don't need to fight with the RBL lists every 6 months when my IP changes.
[04:27:15]<audioguy> odd, that looks like t is from NCommander address at slashcott
[04:28:22]<mechanicjay> yeah, slashcott, would be smarthost relaying to me, which smarthost relays out to cv.net
[04:28:24]<audioguy> Oh, here is another from jason, that should be you.
[04:30:46]<audioguy> actual envelope sender is always from smbfc.net? I am whitelisting your email address.
[04:31:11]<mechanicjay> audioguy: should be
[04:32:37]<mechanicjay> audioguy: if not, I have something misconfigured somewhere -- which is not out of the question.
[04:32:45]<audioguy> And I just checked the original block, looks like just a one time deal maybe. So I will unblock that as well.
[04:33:41]<audioguy> Original block was for spam sent on Mar 14 2014
[04:34:03]<audioguy> From that cv.net server. Unblocked all now though
[04:34:41]<audioguy> Sorry about that
[04:35:46]<audioguy> So, about your idea. Interesting approach. So basically lie in dns about the status of the alternate servers. :-)
[04:36:04]<audioguy> Should work.
[04:36:23]Bytram is now known as Bytram|away[04:36:38]<audioguy> Wondering what that will do to dns.
[04:37:27]<audioguy> Thinking about what advertising this in dns will do as far as spam.
[04:37:58]<audioguy> I don't run backup mail servers anymore, the reason is that spammers would try to abuse them constantly.
[04:38:07]<mechanicjay> Well, actually, that is of minor concern, which is why I wouldn't want to set an mx record for anything that's not already setup to handle spam filtering
[04:39:00]<audioguy> The problem I had was that the spam filtering between the main and back servers needed to be different. I tend to customize that to specific businesses.
[04:39:20]<audioguy> And it got to be a pain to keeep track of all the differences.
[04:39:46]<audioguy> Oh, I am set up for spam filtering, all right... :-
[04:39:58]<mechanicjay> haha, clearly!
[04:40:03]<audioguy> Less sure about the main system.
[04:40:49] -!- Bytram|away has quit [Ping timeout: 240 seconds]
[04:41:29]<audioguy> We would still actually need to advertise both addresses, since one of the things that could go down is the dns itself.
[04:41:45]<audioguy> Or would we...
[04:42:29]<audioguy> Thiking, well, yes we would since there would be no way for the dns to fail over to the 'B' system if it did not exist.
[04:42:42]<audioguy> to point to the b system
[04:56:17]<xlefay> audioguy, your-server.de might be me. PM me the full hostname?
[04:57:08]<xlefay> mechanicjay, as for SMTP. Instead of relaying through your ISP for SN mail, just use the submission ports *most* IPs will allow that particular port to go through
[04:58:19]<mechanicjay> xlefay: its only slashcott mail that relay's though me.
[04:59:09]<xlefay> eh, I thought, you meant from home you use your ISPs SMTP's
[04:59:39]<xlefay> but in case of SN you -can- use the submission port to send stuff out, so you'll be using SN's mail server directly
[05:00:07]<mechanicjay> my mailserver which runs on my home ISP, uses my ISP as a smarthost relay because my IP is dynamic.
[05:01:09]<xlefay> which makes sense, but that wasn't what I was referring to but nvm, I suck at explaining anyway ;)
[05:01:25]<mechanicjay> :)
[05:03:09]<NCommander> Oh fuck it
[05:03:17]* NCommander swears at AArch64 ASM[05:03:24]<paulej72> !grab NCommander
[05:03:56]<NCommander> no bot
[05:04:16]<xlefay> ...
[05:04:17]<mechanicjay> xlefay: can you send me and audioguy non-sn email addresses for ops folks for alerts?
[05:04:18]<xlefay> .op NCommander
[05:04:18] -!- mode/#staff [+o NCommander] by juggler
[05:05:34]<xlefay> you got it?
[05:07:09]<xlefay> !quote 114
[05:07:22]<xlefay> The bot isn't voiced; that's why you didn't see it
[05:08:30]<paulej72> .op
[05:08:30] -!- mode/#staff [+o paulej72] by juggler
[05:08:46]<paulej72> !quote 114
[05:09:12]<paulej72> love it
[05:18:23]* xlefay notes he's moving the last of his data of the "C:" drive... and prepares to install Ubuntu onto his HTPC[05:20:17]<mattie_p> hey folks
[05:20:30]<xlefay> hey, what's up?
[05:20:31]<paulej72> hey mattie_p
[05:20:40]<mattie_p> my daughter is home, finally!
[05:21:18]<xlefay> Awesome! :)
[05:21:23]<mattie_p> the whole family is glad to have her back, but none of us as much as her
[05:21:24]<paulej72> two thumbs up
[05:21:47]<mattie_p> she's getting supplemental nutrition shakes through a tube for the time being, but things are looking up
[05:22:59]<mattie_p> What's been shaking here while I've been gone? I saw all the upgrades and backports, looking good
[05:30:52]<xlefay> mattie_p, I'm glad things are looking up :)
[05:31:30]<mattie_p> yeah, one thing down, now back to the job search
[05:32:18]<mattie_p> I should be able to make next week's staff meeting, my daughter was getting discharged when it was scheduled today
[05:32:28]<xlefay> Which staff meeting?
[05:32:43]* xlefay notes he didn't get a mail about a staff meeting..[05:32:52]<mattie_p> the one you've been sending emails about...
[05:32:56]<xlefay> That's for Sysops
[05:32:57]<mattie_p> Tuesday 2300 UTC ...
[05:32:59]<mattie_p> oh
[05:33:18]<xlefay> but NCommander never replied so.. trying to schedule one for next week
[05:33:26]<mattie_p> I just assumed it was a staff meeting because it was on the list
[05:33:39]<xlefay> It did kinda say in the subject "Sysops" :)
[05:34:28]<mattie_p> well, whatever, I want to learn this stuff anyway
[05:34:34]<mattie_p> I'll just listen in
[05:35:01]<mattie_p> you should be lucky I even looked at my email
[05:37:40]<mrcoolbp> hah
[05:38:18]<mrcoolbp> I'm with mattie, we kinda cross groups a bit, so we like to stay in the loop, even though some of it might be a bit out of our area of expertise
[05:40:21]<audioguy> The X-man knows all, including when the next meeting is. :-)
[05:40:47]<xlefay> ehm, what?
[05:40:53]<mattie_p> you
[05:41:23]<mattie_p> you are one of the bigwigs now, if you haven't noticed
[05:41:44]<mattie_p> I'm not sure who the 2IC is, or even if we have one, but you'd be a candidate along with paulej72
[05:42:01]<mattie_p> 2IC == 2nd in charge
[05:42:22]<audioguy> The X-Man so big he does not even need to know he is big. :-)
[05:43:03]<mrcoolbp> heh
[05:44:22]<audioguy> Actually I thought that was mattie_p
[05:44:50]<mattie_p> well, I've been out of the loop for a while with my daughter, and xlefay stepped up and has been doing great things
[05:44:50]<xlefay> As did I
[05:45:09]<mrcoolbp> yeah xlefay has been working night and day
[05:45:15]<mrcoolbp> literally
[05:45:50]<NCommander> xlefay, sorry
[05:45:51]<audioguy> Nothing with your daughter would change your position. Things are not THAT cutthroat around here. :-)
[05:46:04]<xlefay> NCommander, no worries, I send the mail out late
[05:46:07]<mattie_p> oh, I didn't think so, I'm just saying he's the man
[05:46:09] -!- Bado [Bado!~Bado@Soylent/Staff/Developer/Bado] has joined #staff
[05:46:09] -!- mode/#staff [+v Bado] by juggler
[05:46:20]<mrcoolbp> NCommander: speaking of which, what is mattie_p's position? mmmmm?
[05:46:28]<mattie_p> bottom
[05:46:30]<mattie_p> nograb
[05:46:30]<mrcoolbp> hi bado
[05:46:34]<mrcoolbp> heh
[05:46:34]<xlefay> bottom?
[05:46:40]<Bado> Heya!
[05:46:44]<mattie_p> hi Bado
[05:46:45]<mrcoolbp> it's a gay joke xlefay
[05:46:54]<Bado> How are you peeps doing?
[05:46:58]<xlefay> eh, not sure if you know but as far as I know, NCommander = @ top; Mattie & team leaders are second and then team members
[05:47:12]<xlefay> least, mattie_p that's how I thought it was structured, /me notes mrcoolbp is also in that list but then as a team leader
[05:47:19]<mrcoolbp> that's what I thought xlefay
[05:47:26]<xlefay> mrcoolbp, that's what the 'bottom?' was about ;)
[05:47:47]<mattie_p> I just didn't know if anything had changed, I really haven't had much time lately and didn't know if I missed another revolution
[05:47:48]<mrcoolbp> but I was promised an org chart, though I note NCommander has been quite busy
[05:47:48]<xlefay> That reminds me, I have to make a list of people who responded to the "Are you still in?" e-mail
[05:48:15]<xlefay> mrcoolbp, how about, we just make one & include the information from the e-mails?
[05:48:16]<mrcoolbp> mattie_p I overthrowed xlefay as site dunce
[05:48:33]<NCommander> mattie_p, that's correct w.r.t. to structure
[05:48:46]<mrcoolbp> well there ya go
[05:48:52]<mattie_p> good, glad that's settles
[05:48:59]<mattie_p> s/les/led/
[05:49:03]<mrcoolbp> lol
[05:49:17]* NCommander thought we had an org chart, though I thought it was kinda simple ...[05:49:38]<mattie_p> I put it on pastebin, forget the address. I'll have to see if I can find it
[05:49:39]<xlefay> I think, we're refering to an actual image showing where people are
[05:49:51]<mrcoolbp> NCommander feel free to pass that along to the rest of us
[05:49:52]<mrcoolbp> /me hold back giggles
[05:49:59]<mrcoolbp> = )
[05:50:02]* NCommander is just feeling kinda eh[05:50:12]<mrcoolbp> I'm just playing with you NC
[05:50:29]<mrcoolbp> NCommander: you still stressing about the NFP location thing?
[05:50:36]<mattie_p> NCommander, you back from Canada yet?
[05:50:38]<NCommander> mrcoolbp, more than that
[05:50:39]<NCommander> mattie_p, I am
[05:51:02]<audioguy> As to leadership, we follow, strictly, the Pirates Code
[05:51:20]<mattie_p> we follow whoever gives us rum?
[05:51:20]<xlefay> !grab audioguy
[05:51:22]<xlefay> ftw!
[05:51:33]<mrcoolbp> pirate's code++
[05:51:37]<mechanicjay> who has rum?
[05:51:40]<NCommander> audioguy, quick, construct a boat on the minecraft server and let us sail the seven digital seas!
[05:51:43]* mrcoolbp has rum[05:51:49]* NCommander hates yum[05:51:53]<mrcoolbp> haha
[05:51:55]<NCommander> */rimshot*
[05:51:56]<audioguy> hah, yes.
[05:52:03]<mrcoolbp> where's the minecraft server!?!
[05:52:05]* mechanicjay prefers scotch[05:52:24]<NCommander> mrcoolbp, to be created when we are incorperated, less the distraction prevent that from ever being finished
[05:52:34]* mrcoolbp nods[05:52:41]<audioguy> It's rum for me.
[05:52:54]<audioguy> AArggghhh
[05:53:01]<xlefay> Ice tea ftw.
[05:56:21] -!- Bado has quit [Quit: Bado]
[06:04:47] -!- Bado [Bado!~Bado@Soylent/Staff/Developer/Bado] has joined #staff
[06:04:47] -!- mode/#staff [+v Bado] by juggler
[06:05:27]<mechanicjay> Okay, spring is officially whacky. It was 70 degrees yesterday...there is currently a dusting of snow on the ground.
[06:05:49]<mattie_p> hah, we had the same weather a couple of days ago here in Colorado
[06:07:44] -!- mrcoolbp has quit []
[06:07:55]<mechanicjay> oooh, I spent about 10 days in Colorado a couple years ago, tried really hard not to fall in love with the place.
[06:09:22] -!- SirFinkus [SirFinkus!~textual@l-64-313-06-125.hsd0.wa.comcast.net] has joined #staff
[06:09:37]<mattie_p> yeah, its beautiful here
[06:11:38]<mechanicjay> I think the size of your natl parks is larger than the whole of New Jersey.
[06:12:20]<mattie_p> that is very possible
[06:24:37]<mattie_p> well, I'm out for the night, talk to everyone tomorrow
[06:28:36] -!- Bado has quit [Quit: Bado]
[07:02:02]<NCommander> mechanicjay, I forgot where you are in RL?
[07:03:02]<mechanicjay> NCommander: The beautiful and dreamy North Jersey.
[07:17:17]<NCommander> mechanicjay, yeah, we're getting hail here in NYC
[07:17:24]<NCommander> mechanicjay, we should get together and $BEER
[07:29:20]<mechanicjay> NCommander: agreed, I think my calendar is opening up in about 18 years.
[07:33:24]<NCommander> mechanicjay, yeash
[07:34:43] -!- chromas has quit [Remote host closed the connection]
[07:34:59]<mechanicjay> NCommander: That's not a blow off or anything. My time gets less spoken for by the middle of May. So, let's $BEER after that.
[07:35:10] -!- chromas [chromas!~chromas@47-85-184-52.dhcp.knwc.wa.charter.com] has joined #staff
[07:35:19]<NCommander> mechanicjay, sure, although I'm unsure if I'll still be in NYC then
[07:36:47]<xlefay> Well the install went fine.. except the part where I had to go install grub properly myself
[08:06:55]<xlefay> .. and KVM's running!
[08:07:10]* xlefay enjoys seeing FreeBSD booting up[08:42:21]<NCommander> xlefay, why are you running FreeBSD?
[12:34:07] -!- Bytram|away [Bytram|away!~pc@Soylent/Staff/Developer/martyb] has joined #staff
[12:34:07] -!- mode/#staff [+v Bytram|away] by juggler
[13:38:01] -!- Bytram|away has quit [Ping timeout: 240 seconds]
[13:53:29] -!- mechanicjay has quit [Quit: Leaving.]
[14:58:01] -!- SirFinkus has quit [Ping timeout: 240 seconds]
[15:00:10] -!- SirFinkus [SirFinkus!~textual@l-64-313-06-125.hsd0.wa.comcast.net] has joined #staff
[15:54:49] -!- SirFinkus has quit [Ping timeout: 240 seconds]
[15:55:51] -!- SirFinkus [SirFinkus!~textual@l-64-313-06-125.hsd0.wa.comcast.net] has joined #staff
[16:42:30] -!- mechanicjay [mechanicjay!~jhowe@Soylent/Staff/Sysop/mechanicjay] has joined #staff
[16:42:30] -!- mode/#staff [+v mechanicjay] by juggler
[16:51:35] -!- LaminatorX [LaminatorX!~18d900fb@Soylent/Staff/Editor/LaminatorX] has joined #staff
[16:51:35] -!- mode/#staff [+v LaminatorX] by juggler
[18:01:14]<mechanicjay> Hey, I just got a goofy error
[18:01:46]<mechanicjay> You've reached your maximum number of comments you can post: 77 comments over 4 hours. Chances are, you're behind a firewall or proxy, or clicked the Back button to accidentally reuse a form. Please try again. If the problem persists, and all other options have been tried, contact the site administrator.
[18:01:56] -!- Cyprus [Cyprus!~Cyprus@2001:470:ljlz::py] has joined #staff
[18:01:56] -!- Cyprus has quit [Changing host]
[18:01:57] -!- Cyprus [Cyprus!~Cyprus@localhost] has joined #staff
[18:01:59]<mechanicjay> I'm actually AC (unintentially) ATM
[18:07:54]LaminatorX is now known as LaminatorX|out-to-lunch[18:59:29] -!- mechanicjay has quit [Quit: Leaving.]
[19:07:39] -!- mrcoolbp [mrcoolbp!~mrcoolbp@Soylent/Staff/mrcoolbp] has joined #staff
[19:07:39] -!- mode/#staff [+v mrcoolbp] by juggler
[19:10:19]<mrcoolbp> paulej72, NCommander: what are the paramaters of the comment-post-limiter?
[19:10:52]<mrcoolbp> I have a high-karma user that only posted twice in a 24 hour period getting the
[19:10:58]<mrcoolbp> "SoylentNews only allows a user with your karma to post 10 times per day" error
[19:15:20] -!- drussell [drussell!~cde90fbb@205.233.pt.umv] has joined #staff
[19:19:03]<mrcoolbp> .op
[19:19:03] -!- mode/#staff [+o mrcoolbp] by juggler
[19:22:46]<mrcoolbp> LaminatorX: any progress on the FAQ page?
[19:23:06]<mrcoolbp> LaminatorX|out-to-lunch: any progress on the FAQ page?
[19:23:25]<mrcoolbp> NCommander: Moderation seems to be broken
[19:41:56] -!- janrinok [janrinok!~janrinok@Soylent/Staff/Editor/janrinok] has joined #staff
[19:41:56] -!- mode/#staff [+v janrinok] by juggler
[19:42:55]<janrinok> Any sys guys got a suggestion for the following problem? - http://soylentnews.org[19:43:31]<janrinok> It's an AC so there is not much I can tell him even if you find a problem...
[19:52:46]<mrcoolbp> janrinok, let me look, I'm looking into something similar right now
[19:54:01]<mrcoolbp> janrinok, that's strange, a story submission isn't really the best way to contact us on these matters...but maybe we need a web form so people can report things like this and stay annon
[19:54:26]<mrcoolbp> like, how would we respond to him/her/it/alien?
[19:55:16]<mrcoolbp> NCommander: ding
[19:55:31]<mrcoolbp> somethings definitely wonky today with commenting and moderation
[19:56:06]<janrinok> that was my point - as long as we don't have any problem at our end with this particular AC (e.g like the one yesterday) then we're good.
[19:56:37]<mrcoolbp> janrinok: I deleted the story submission, but I can log it as a bug for now I guess...
[19:56:50]<janrinok> mrcoolbp: I like the idea of a 'problem' page
[19:56:57]<janrinok> mrcoolbp++
[19:57:00]<paulej72> everyone is posting with the same IPID since it is all coming from the load balancer. This may hav borked commenting and modding
[19:57:12]<mrcoolbp> hmmm
[19:57:34]<mrcoolbp> that's not good
[19:59:53]<mrcoolbp> yup: http://soylentnews.org[20:05:29]<mrcoolbp> paulej72: should we email NCommander?
[20:05:41]<mrcoolbp> oh wait, I can try texting him
[20:05:50]<paulej72> yes can you do either.
[20:06:01]<paulej72> or both
[20:06:29] -!- mode/#staff [+v Cyprus] by juggler
[20:08:01]<mrcoolbp> txt sent
[20:12:43]<mrcoolbp> I'm guessing he's sleeping
[20:13:14]<janrinok> well, while we're waiting - how are you guys?
[20:15:56]<mrcoolbp> not bad
[20:16:02]<mrcoolbp> and yourself?
[20:16:20]<paulej72> Forbid users from moderating any comments posted by someone in their subnet? is set to ture
[20:16:54]<paulej72> basically no one can mod new posts as we are all on the same subnet and ipaddress.
[20:17:39]<janrinok> good thanks - until I found this little bug....
[20:18:21]<audioguy> Ha ha ha ha.
[20:18:23]<paulej72> daily limit for AC posts from an IPID is 10
[20:18:31]<mrcoolbp> janrinok: el_oscuro link points to a weird address in the LaCie story
[20:18:51]<janrinok> ok I'll check it again
[20:18:52]<mrcoolbp> I'll fix
[20:18:57]<janrinok> lol ok to you
[20:19:12]<audioguy> Gentlemen, we have a prophet among us. 'audioguy'
[20:19:24]<audioguy> My words from yesterday:
[20:19:32]* janrinok kneels in presence of prophet....[20:19:35]<audioguy> 'Don't worry, NCommander is working on load balancing. That sould be good for at least ONE technical faux paux to make us look like complete idiots again."
[20:19:39]* mrcoolbp neels reluctantly[20:19:46]<mrcoolbp> haha
[20:19:48]<mrcoolbp> I rememeber that
[20:19:59]<paulej72> thanks audioguy LOL again on that
[20:20:04]<mrcoolbp> save us o profit!
[20:20:06]<audioguy> :-)
[20:20:45]<janrinok> Seriously, is this likely to be a quick fix or should I push something out as an immediate story to let others know we are aware of the problem?
[20:20:47]<audioguy> Ye must pay obiesance to the mighty machine
[20:21:00]<mrcoolbp> I texted NCommander but...nothing, I guess I can spam him with an email too...
[20:21:13]<audioguy> He needs to roll this back and figure out solution in dev machine.
[20:21:29]<audioguy> mrcoolbp:
[20:21:42]<mrcoolbp> ..........
[20:21:45]<audioguy> don't email him yet
[20:21:51]<mrcoolbp> k
[20:22:13]<audioguy> pm
[20:25:11]<audioguy> Ok, an email will be sent...
[20:26:13]<mrcoolbp> sent
[20:26:21]LaminatorX|out-to-lunch is now known as LaminatorX[20:26:43]<mrcoolbp> Hey LaminatorX, how was lunch?
[20:27:30]<LaminatorX> Mostly errands, but I'm glad to have gotten them done.
[20:28:04]<LaminatorX> RE: The FAQ. I seem to blocked on it for some stupid reason.
[20:28:39]<janrinok> LaminatorX: hi - good to see you back on IRC. Hope all is well.
[20:29:06]<mrcoolbp> LaminatorX: I have both errands and forgotten to-do list items to bang out today as well
[20:29:10]<mrcoolbp> = )
[20:29:19]<audioguy> I got email, mrcoolbp so good first test.
[20:29:23]<LaminatorX> Most is well. work stress has been a thing, but the tide is shifting from hopeless to hopefull, so that's good.
[20:29:25]<mrcoolbp> nice
[20:29:41]<janrinok> LaminatorX: nice to hear!
[20:30:31]* janrinok had better pull his socks up - LaminatorX is back in town....[20:30:47]<LaminatorX> Better than Mac the Knife, I suppose.
[20:30:53]<janrinok> lol
[20:32:56]<mrcoolbp> janrinok: "the Screen Time and Young Children" might be a chance to try out the "extended copy" feature, it's a bit on the long side
[20:33:19]<janrinok> OK, I'll re-edit
[20:34:12]<janrinok> mrcoolbp: is there a maximum size that we should be aiming for in the summary? Have I missed a memo - again?
[20:34:35]<mrcoolbp> janrinok: we need to formalize the process still
[20:34:43]<janrinok> ok np
[20:35:40]<mrcoolbp> from #editorial the other day: <05paulej72> i have a general comment. it seem that front page article is getting rater long for some stories.
[20:36:25]<LaminatorX> We can certainly make more use of that tool.
[20:36:29]<mrcoolbp> yeah
[20:36:51]<audioguy> The new sidebar box 'Site News' could be used to mention this problem
[20:36:51]<janrinok> Yes, I recall that, but what is long on one screen is pretty good on another. I wondered if someone had decided that x lines should be the max because of reason y.
[20:40:03]<mrcoolbp> xlefay: if someone is using the webclient, they should not be able to use a registered nick right?
[20:40:24]<LaminatorX> I am.
[20:40:46]<LaminatorX> You just have to check the box to use services.
[20:40:53]<mrcoolbp> I meant without doing that, sorry
[20:41:43]<paulej72> If someone wants the site news updated let me know and I’ll get it done.
[20:42:12]<mrcoolbp> audioguy: can we hijack the sitenews temporarily?
[20:42:35]<mrcoolbp> I've got more bug reports about this in a short time than anything else so far
[20:42:37]<audioguy> Let's do that, since this could take a while to fix. And let me see if I have a new number to put in before that is done...checking...
[20:43:23]<audioguy> Now have 45 name submissions
[20:43:26]<paulej72> I can add something to the top and push the vote news down. I will need text though
[20:43:32]<mrcoolbp> paulej72: you could update "site status" as well please
[20:44:09]<paulej72> mrcoolbp: ?
[20:44:27]<mrcoolbp>http://status.soylentnews.org[20:45:12]<paulej72> Noone is going to see that page and I am not sure where it lives
[20:45:16]<mrcoolbp> paulej72, maybe: "We are currently experiencing a minor problem with commenting and moderation, please stand by"
[20:45:20]<audioguy> We are experiencing some problems with a new load balancing test causing limits on some posts. Should be fixed within 2-3 hours.
[20:45:21]<mrcoolbp> for the box then ^
[20:45:40]<mrcoolbp> that works too
[20:45:53]<audioguy> Some combo of the two, I think.
[20:46:15]<paulej72> I like mrcoolbp’s version with due to load balancer testing
[20:46:20]<mrcoolbp> sure
[20:46:49]<paulej72> We are currently experiencing a minor problem with commenting and moderation due to load balancer testing, please stand by.
[20:46:50]<audioguy> sounds good to me paulej72
[20:47:03]<paulej72> audioguy: de we have a new number?
[20:47:08]<mrcoolbp> 47
[20:47:10]<mrcoolbp> er 45
[20:47:17]<audioguy> please stand by does not add much, they want to know when it will be fixed.
[20:47:27]<mrcoolbp> audioguy: we don't know that now
[20:47:36]<Cyprus> lol
[20:47:40] -!- chromas has quit [Quit: No Ping reply in 180 seconds.]
[20:47:41]<Cyprus> whoops wrong window
[20:47:48]<paulej72> mrcoolbp: agreed
[20:47:59]<audioguy> Usual strategy is to guess. :-)
[20:48:51] -!- chromas [chromas!~chromas@47-85-184-52.dhcp.knwc.wa.charter.com] has joined #staff
[20:49:03]<mrcoolbp> audioguy: that box isn't time-stamped, so giving a 2-3 hours doesn't tell them that much either, maybe "in a few hours" ?
[20:49:07]<audioguy> How log would it take to completely undo this change, paulej72 ? I would say that would be the esitimate.
[20:49:15]<mrcoolbp> maybe we are overthinking the wording...
[20:49:22]<paulej72> issue will be fixed when NCommander gets his ass out of bed
[20:49:29]<mrcoolbp> ^^^
[20:49:33]<audioguy> 'We arer working on the problem'
[20:49:39]<janrinok> ^^^+1
[20:49:43]<mrcoolbp> +2
[20:49:54]<audioguy> At least working on getting NC out of bed. :-)
[20:50:00]<mrcoolbp> heh
[20:51:09] -!- drussell has quit [Quit: Web client closed]
[20:51:33]<janrinok> why are we still tied to one individual when something goes wrong?
[20:51:41]<Cyprus> was just about to ask that
[20:51:45]<mrcoolbp> same
[20:51:56] -!- drussell [drussell!~drussell@205.233.pt.umv] has joined #staff
[20:52:13]<audioguy> Well, I would guess paulej72 would know how to undo this in a pinch but the process is to require approvals.
[20:52:44]<janrinok> in extremis (i.e. site is borked) that should be authority enough?
[20:52:52]<audioguy> This is a new change and NC is the most knowlegable about it.
[20:53:08]<audioguy> Site is not down, just crippled a bit.
[20:53:13]<paulej72> audioguy: this was done in the linode console and I do not have access to it yet. xlefay and mechanicjay do have access
[20:53:44]<mrcoolbp> we notified sysops via email
[20:53:46]<audioguy> Ah, at any reate someonde does have access if need be.
[20:54:06]<audioguy> More sensible to wait for NCommander though.
[20:54:12]<paulej72> there is a DNS change that set the site to point to the load balancer,
[20:54:31]<audioguy> It may be that just THAT could be undone.
[20:55:21]<janrinok> sry guys - I was really just thinking aloud, but it does seem like a single-point of failure....
[20:55:47]<paulej72> now we know why slash uses nexus that are on different servers, so they could load balance the front end easier
[20:57:06]<audioguy> NCommander: is on the east coast, should be up I would think. He did mention some intense stuff at work yesterday.
[20:58:07]<mrcoolbp> he was up pretty late and has weird sleep patterns but yeah it's about 3pm here
[20:58:54]<audioguy> Yes now we know. NCommander actually did this right, we had plenty of warning this time. None of us realized what would happen, which seems pretty obvious in retrospect.
[20:58:59]<paulej72> NCommander has not been on a normal sleep schedule since China. Him and xlefay are see who can outlast the orher in staying up coding past their bedtimes
[21:00:36]<audioguy> It may be useful to have some sort of norm for when to give up on waiting for someone and pass the task on to the next person in such circumstances.
[21:00:51]<paulej72> the issue cropped up because we do not have a full test procedure that we follow when we make changes. We now have more stuff to add to that document when we create it.
[21:01:06]<audioguy> Yes indeed.
[21:01:11]<Cyprus> well, its testing, and the emergency coverage issues you guys have always had
[21:01:25]<Cyprus> it seems to be a recurring pattern that you're waiting for a superadmin to wake up
[21:02:12]<audioguy> Atually, I remember at one point we were thinking the staff slash could be used for stuff like this, since it is a system that is actually used, with posts going up periodically.
[21:02:19]<paulej72> See we have two people from sysops here who do not have access to the system that we need to fix this. I am not real upset as I just offically joined sysops not long ago and I was out for a while.
[21:02:48]<audioguy> Is not xlefay here?
[21:02:56]<mrcoolbp> not that we've seen for hours
[21:03:34] -!- drussell has quit [Quit: Leaving]
[21:03:36]<paulej72> he was earlier when I first noticed that everuone was on the same IPID, but at the time we did not know it would bork commenting and modding
[21:03:36]<audioguy> Well, everyone was just sent an email. At least the site is not completely down.
[21:04:19]<paulej72> maybe we should not post new stories until we fix this?
[21:04:23]<Cyprus> i would suggest figuring out your on notification personell issues related to anything that isn't federated to a large group of people
[21:04:37]<mrcoolbp> paulej72: agreed
[21:04:54]<mrcoolbp> janrinok, laminatorX can you guys delay the queue a little?
[21:05:05]<mrcoolbp> just bump it an hour or so for now please
[21:05:17]<LaminatorX> Will do.
[21:05:21]<mrcoolbp> thx
[21:05:51]<paulej72> I could make some changes to some of the vars to fix some of this, but one issue that formkeys seems to have a hard coded limit set for number of posts per time frame.
[21:07:11]<audioguy> Our dns needs to be more under our control, on a proper machine, not requiring a control panel. Then any admin could fix this.
[21:10:51]<mrcoolbp> audioguy: sounds like point of order # 1 for the next sysops meeting
[21:11:07]<audioguy> You just read my mind.
[21:11:42]* mrcoolbp waves his hands around mysteriously[21:11:59]<audioguy> I believe the control panel stuff is required for certain internal functions, but I think we could possible delegate to an internal dns some parts of the domain.
[21:14:05]<audioguy> One thing to cosider for stuff like this is having an emergency backoff for the change that is somehere on the staff slash. ('If this fails while I am alseep, follow this procedure')
[21:15:49] -!- drussell [drussell!~drussell@205.233.pt.umv] has joined #staff
[21:15:57]<mrcoolbp> .voice drussell
[21:15:57] -!- mode/#staff [+v drussell] by juggler
[21:18:27]<mrcoolbp> audioguy: that sounds like a rule we should follow zealously
[21:19:38]* mrcoolbp considers lunch[21:20:43]<mrcoolbp> audioguy: we may not have noticed the issue on the staff slash due to the much lower comment volume
[21:21:08]<paulej72> never tested on staff slash only dev
[21:22:05]<audioguy> But staff has more posts than dev.
[21:22:51]<mrcoolbp> definitely true, still not as many as I was hoping though.
[21:23:05]<audioguy> So may or may not have shown this, it is clear a procedure for testing under load, or at least a way to quickly recover is needed.
[21:23:20]<audioguy> Or both.
[21:23:40]<audioguy> It's hard to find a good load outside the actual site.
[21:24:09]<Cyprus> !grab audioguy
[21:24:12]<Cyprus> aww
[21:25:00]<mrcoolbp> that's low man...
[21:26:03]<mrcoolbp> audioguy: it was always part of the plan to have tests done on the staff slash. New code goes to Dev->Staff->Prod
[21:26:23]* mrcoolbp notes this wasn't just new code though[21:27:19]<mrcoolbp> Landon: you around?
[21:27:31]<audioguy> I think the 'quick way to recover' plan is what was needed here, ultimately.
[21:27:50]<mrcoolbp> yeah, that sounds like the take-away from this one
[21:28:37]<mrcoolbp> some comments are still getting through
[21:28:47]<mrcoolbp>http://soylentnews.org[21:28:52]<mrcoolbp> 7 minutes ago ^
[21:29:07]<audioguy> I can't really think of a good way to simulate the high load plus people editing prefs, loging in, and a multitude of other stuff that happens on the main site.
[21:29:56]<mrcoolbp> yeah, and since there's only 8 or so active users on the staff slash, even asking them to "hammer" it wouldn't be that effective
[21:30:43]<Landon> mrcoolbp blop
[21:37:49]<paulej72> Ncommander has returned to the living
[21:39:00]<NCommander> screw me
[21:39:18]<NCommander> I fucking tested this on dev
[21:44:10]* Cyprus hands NCommander a beer[21:44:45]* paulej72 hands NCommander a burbon and a scotch as well[21:47:44]<NCommander> I was up for hours last night after this change went live
[21:48:29]<paulej72> last two posts on dev are from the load balancer IPID.
[21:49:12]<NCommander> Crap crap crap
[21:49:22]<NCommander> paulej72, fuck, thats likely due to SSL
[21:49:25]<paulej72> NCommander: most of the issues take time to show as formkeys and comments have limits per timeframe guilt in.
[21:49:34]<paulej72> built*
[21:49:57]<NCommander> yeah
[21:50:00]<NCommander> I'm trying to repair
[21:50:49]<paulej72> modding would from same subnet would have taken time as well because older comments would have been on differen ipids
[21:51:41]<paulej72> NCommander: not ssl as I am not logged in via ssl and I am on the sam ipid as everyone else
[21:52:15]<NCommander> paulej72, dev rediects everyone from SSL
[21:52:21]<NCommander> er, to SSL
[21:53:15]<paulej72> It looks like I did not post on dev while we were behind the load balancer
[21:54:08]<paulej72> noone has posted to dev since the move last night away from the load balancet
[21:54:41]<NCommander> Just kill me
[21:54:42]<NCommander> Please
[21:55:14]<paulej72> post to dev right now gives me proper IPID that I have used in the past
[21:58:28]<NCommander> paulej72, because dev isn't loadbalancered
[22:04:49]<NCommander> paulej72, fixed
[22:06:36]<paulej72> NCommander: what did you need to do to fix it?
[22:07:03]<paulej72> I have tested as well and it I got my regular IPID on SN
[22:08:31]<NCommander> paulej72, whitelisted 192.168.0.0/24 to pass in X-Forwarded-By
[22:08:49]<NCommander> its still borked for SSL though
[22:43:45] -!- LaminatorX has quit [Quit: Web client closed]
[23:11:08]<xlefay> mrcoolbp, check your email
[23:11:21]<mrcoolbp> just saw it, and PMed him
[23:11:38]<mrcoolbp> should we all check if we have that enabled xlefay?
[23:11:43]<mrcoolbp> also good morning = )
[23:13:11]<xlefay> It's actually 2312 and no, I figure people will just join #help if they need nick protection enabled and haven't got a clue how to do it
[23:13:59]<xlefay> Essentially it doesn't mean a lot, it just means someone doesn't get renamed SoyCow if they forgot to log in on time. Not only is it impolite to use someone's nickname (if they don't have nick protection on, which is the default since weeks) but you can also get "killed" for doing so
[23:14:19]<xlefay> Which means, someone can "ghost" the nick via nickserv and the person using the nick would get booted off so
[23:17:16]<mrcoolbp> xlefay: my worry was someone impersonating staff
[23:17:58]<xlefay> /ns set enforce on
[23:19:56]<mrcoolbp> what's the deafult time?
[23:20:20]<xlefay> mattie_p, ncommander, paulej72, audioguy, cosurgi, drussel, janrinok, landon: /ns set enforce on
[23:20:20]<janrinok> On stories? its UTC same as GMT
[23:20:32]<xlefay> 60 seconds, feel free to set it higher via: /ns set enforcetime
[23:20:38]<mrcoolbp> janrinok talking with xlefay
[23:20:44]<janrinok> Oh sry
[23:20:45]<mrcoolbp> xlefay I set mine to 3 seconds
[23:20:49]<mrcoolbp> = )
[23:20:51]<NCommander> xlefay, thought I had that set
[23:20:52]<NCommander> oops
[23:21:20]<mrcoolbp> xlefay maybe an email should go out to that effect...
[23:21:22]<xlefay> janrinok, do see that highlight ;-)
[23:21:37]<xlefay> mrcoolbp, maybe 10% of the users or so don't have it set
[23:21:50]<xlefay> it's not worth sending out an e-mail for the effect
[23:21:52]<mrcoolbp> like I said, I'm more concerned about staff
[23:22:27]<Landon> I'm pretty sure me talking at all would be suspicious activity best served with a swift kick, so no worries
[23:22:35]<xlefay> 4 staff members have set it so far. I doubt most will.
[23:22:58]<mrcoolbp> we should have them all set that
[23:23:05] -!- Landon was kicked from #staff by xlefay!~xlefay@Soylent/Staff/Sysop/xlefay [this is extremely suspicious :o]
[23:23:08]<mrcoolbp> that should be part of the orientation packet = )
[23:23:16]<mrcoolbp> hah
[23:23:38] -!- Landon [Landon!~Landon@Soylent/Staff/IRC/Landon] has joined #staff
[23:23:38] -!- mode/#staff [+v Landon] by juggler
[23:23:42]<xlefay> :P
[23:23:54]<Landon> took me a while to remember what channel I was on
[23:24:10]<xlefay> ha sorry, couldn't reset taking your suggestion seriously
[23:24:24]<janrinok> xlefay: which highlight?
[23:24:53]<xlefay> mattie_p, audioguy, cosurgi, drussel, janrinok: /ns set enforce on
[23:25:05]<mrcoolbp> janrinok: just type: /msg nickserv set enforce on
[23:25:31]<Cyprus> alternately, post a list, and we can ghost them randomly
[23:25:54]<mrcoolbp> don't make me devoice you!
[23:26:00]<mrcoolbp> = )
[23:26:05]<xlefay> Well, you can only ghost them if you know the password itself :P
[23:27:00]<mrcoolbp> paulej72: Current Name Voting Submissions = 45
[23:27:01]<xlefay> Thanks janrinok, NCommander, paulej72, mrcoolbp, Landon and whoever else I missed
[23:27:38]<janrinok> np
[23:27:57]<Landon> wat!
[23:27:58]<paulej72> mrcoolbp: now you tell me after I just got done booting everyon off of the server during the reboot i did to update the site news message
[23:28:05]<mrcoolbp> lol
[23:28:12]<mrcoolbp> we told you earlier smart guy
[23:28:35]<paulej72> no I do not rememger seeing that mrcoolbp
[23:29:15]<paulej72> I missed it as it was a naked number mrcoolbp :)
[23:29:27]<paulej72> too small to see
[23:29:29]<mrcoolbp> <05@paulej72> If someone wants the site news updated let me know and I’ll get it done.
[23:29:30]<mrcoolbp> <14@mrcoolbp> audioguy: can we hijack the sitenews temporarily?
[23:29:30]<mrcoolbp> <14@mrcoolbp> I've got more bug reports about this in a short time than anything else so far
[23:29:30]<mrcoolbp> <+audioguy> Let's do that, since this could take a while to fix. And let me see if I have a new number to put in before that is done...checking...
[23:29:30]<mrcoolbp> <+audioguy> Now have 45 name submissions
[23:29:38]<janrinok> site is now updating normally, I'm going to call it a day. cu guys tomorrow.
[23:29:48]<mrcoolbp> later janrinok
[23:30:27]<xlefay> So did anyone update status.soylentnews.org?
[23:30:47]<mrcoolbp> paulej72 sorry man, just trying to help. we can update it tomorrow.
[23:30:56]<mrcoolbp> xlefay: we don't know how to
[23:30:57] -!- janrinok has quit [Quit: leaving]
[23:32:12]<paulej72> mrcoolbp: I updated the template, but did not kick memcache or apache. It will eventually be pulled once the caches get stale and for a while it will cycle between the two.
[23:32:13]<xlefay> I'm planning on making a little script to auto pull shit from Icinga anyway, might just as well add an easy to use interface to add information
[23:32:26]<xlefay> mrcoolbp, ^
[23:32:36]<xlefay> Hey, maybe I could make it so that you have to e-mail it!
[23:32:50]<mrcoolbp> whatever works
[23:33:22]<mrcoolbp> we should add something here explaining it: http://wiki.soylentnews.org[23:33:33]<paulej72> xlefay: if you use email, make sure it only accepts mail from certain users.
[23:34:12]<xlefay> I wasn't being serious. I'm just going to make a little simple to use form
[23:34:21]<xlefay> wait, what, we've got emergency procedures?
[23:34:28]<mrcoolbp> lol
[23:34:38]<paulej72> xlefay: never know hwo is serious with this crowd
[23:34:39]<mrcoolbp> and you call yourslef a sysop
[23:34:59]<xlefay> mrcoolbp, I'm being sarcastic as to our usage of those
[23:35:10]<xlefay> Ironically, the use of that document is mostly for non-sysopses
[23:35:11]* mrcoolbp was too[23:35:34]<xlefay> paulej72, ha sorry
[23:35:39]<Landon> General Emergency Procedure: Call 0118 999 881 999 119 725
[23:35:39]<paulej72> mrcoolbp: the emergency procedures are out of date just like slash documentation so they are perfect for sysops
[23:35:41]<Landon> 3
[23:35:50]<xlefay> 2
[23:35:51]<mrcoolbp> paulej72: sigh
[23:35:54]<mrcoolbp> 1
[23:36:00]<mrcoolbp> blastoff?
[23:36:05]<mrcoolbp> profit!>!>
[23:36:06]* juggler BOOM![23:36:08]<Landon>http://theitcrowd.wikia.com[23:36:57]<xlefay> I'm starting to notice the effects of my mouse battery being almost empty :(
[23:37:07]<xlefay> no more scroll :|
[23:37:31]<xlefay>http://www.logitech.com = awesome
[23:37:58]<paulej72> xlefay: you could get a ball and put it in the bottom of your mouse, Hook it up to a little gernerator and you would have a slef charging mouse.
[23:38:28]<xlefay> actually, that's not a bad idea
[23:38:44]<mrcoolbp> that's not a bad idea...except I'm thinking of those bike generators for the headlamps, man those where hard to pedal....
[23:38:44]<xlefay> Do you think I should make it dance too?
[23:38:48]<paulej72> the return of mouse balls FTW
[23:38:49]<Landon> paulej72: we could use the ball to encode movement too
[23:38:55]<Landon> two uses in one!
[23:38:59]<mrcoolbp> haha
[23:39:09]<paulej72> lol Landon