I'm so sorry, but if it makes you feel any better, my fun-time-Buffy party night involved watching a robot throw Spike through a window, so if you want to trade... no wait, I wouldn't give up that memory for anything.

Buffy ,'Get It Done'


Bureaucracy 2: Like Sartre, Only Longer  

A thread to discuss naming threads, board policy, new thread suggestions, and anything else that has to do with board administration and maintenance. Guaranteed to include lively debate and polls. Natter discouraged, but not deleted.

Current Stompy Feet: ita, Jon B, DXMachina, P.M. Marcontell, Liese S., amych


Rob - Aug 29, 2003 12:44:14 pm PDT #4981 of 10005

We can't do anything about that, but fewer open threads is still better.

I really don't agree. I haven't seen any proof that the number of threads contributes to excess concurrent connections, and what I learned from digging around in all the code doesn't support it.

Concurrent connections is what the issue, so I think the first Angel Watch'n'Post will be our next stress test. But just last night I figured out why we need to have explicit closes of connections (even though the PHP doc claims one doesn't) and why the ones ita put in weren't working. I think there's a good chance this won't be an issue in the future.


§ ita § - Aug 29, 2003 12:46:13 pm PDT #4982 of 10005
Well not canonically, no, but this is transformative fiction.

I really don't agree.

We don't get to make that choice -- we've been explicitly recommended to minimise table space.

It also seems to me that the shorter a query runs, the less time the connection is open for, so the fewer concurrent connections there'll be.

But I could be off on that.

edit: Could you explain again why PHP wasn't implicitly closing the connections? I don't have your e-mail with me, and I forget.


DXMachina - Aug 29, 2003 12:48:15 pm PDT #4983 of 10005
You always do this. We get tipsy, and you take advantage of my love of the scientific method.

I really don't agree. I haven't seen any proof that the number of threads contributes to excess concurrent connections, and what I learned from digging around in all the code doesn't support it.

It only does in the context of more threads offering more opportunities to post, i.e., the more threads there are the more likely the posting and reading volume will go up, leading to more concurrent connections.


Rob - Aug 29, 2003 1:01:33 pm PDT #4984 of 10005

ita is right about query length increasing the number of concurrent connections, but I have to ask how much per thread. For example, how much does Spoiler's Lite cost compared to Natter. We don't have any way of measuring that, but I think the value of a few of these low volume threads has to outweigh their cost in increased query times.

edit: Could you explain again why PHP wasn't implicitly closing the connections? I don't have your e-mail with me, and I forget.

My theory is that when PHP is running as a module compiled into Apache, it defers cleaning up resources (like unclosed MySQL links) until the module is unloaded. That's only going to happen when the child process Apache spawns to handle connections goes away, which might never happen, depending on how they've configured Apache.

When PHP runs via CGI, everything is cleaned up after each script is run. But that's much less efficient, so I doubt that's the way it's set up on our host.


§ ita § - Aug 29, 2003 1:09:56 pm PDT #4985 of 10005
Well not canonically, no, but this is transformative fiction.

I have to ask how much per thread.

The per-threadness affects searches of the threads table only -- front page, message center, probably no big.

But trimming the posts table is a bigger deal -- and once threads are closed a) posting diminishes some, probably and b) they definitely can be archived and removed entirely from the table.

I'd rather we do that before any Angel-rush, rather than after or during.


DCJensen - Aug 29, 2003 1:10:14 pm PDT #4986 of 10005
All is well that ends in pizza.

Hw about if we make spoilage lite a thread with a price on it's head?

Keep it open, but if a time comes when we have to drop something because of rising conections, it's closed.

Was there some sort of consensus as to location of archived threads? I remember discussion as to their being moved offsite.

Too bad we can't set up a duplicate site somewhere with just our archives, no posting.

Buffista Retro: The words that were. with downloadable zip files (Oh, I do miss bbs qwk packets) of threadsucks.


§ ita § - Aug 29, 2003 1:14:20 pm PDT #4987 of 10005
Well not canonically, no, but this is transformative fiction.

Buffista Retro: The words that were. with downloadable zip files (Oh, I do miss bbs qwk packets) of threadsucks.

Daniel, you do know that everything that's been archived *is* downloadable, right?


DCJensen - Aug 29, 2003 2:12:16 pm PDT #4988 of 10005
All is well that ends in pizza.

yes, ita, but I also know we can still read some.

I was imder the impression that reading the archives has the same effect on our simultanious connections that reading an open thread does. If this is so, moving them to somewhere else might alleviate some server hits.


Michele T. - Aug 29, 2003 2:41:32 pm PDT #4989 of 10005
with a gleam in my eye, and an almost airtight alibi

Yeah, if we're trying to decrease table space, it seems to me the *first* thing to do is get all the closed threads off the board. And possibly figure out if there's some way to automate the process, since we go through Natter threads hella fast.


lori - Aug 29, 2003 2:47:16 pm PDT #4990 of 10005

We ARE getting the closed threads off the board. But as DX has pointed out, there are some niggly not-automated time-consuming details that slow this process down a bit. But he and others are working that task.