Diana the Valkyrie

Diana the Valkyrie's Newsletter - July 2012

June 2012

Summer in England, not too hot, not too dry!

New and updated Galleries

Galleries added this month.

The Library

Stories added this month.

The Movie Theatre

Movies added this month.


Part of the process for digesting the newsthumbs was running slowly, so I looked into it. Here's what I found.

Some posts are multi-part. If you want to post something big on Usenet, you have to divide it up into smaller pieces. I was dealing with this, by working out what the "mother" posting was, and then appending each "daughter" to that. When I coded that, I was thinking, maybe one or two daughters. So I did it the first (and easiest) way I thought of, using unix cat. So for each daugher, I did "cat mother daughter > mother".

That reads the mother, reads the daughter, and writes out the combined file as the new mother. The problem with that, is when the file is very long - the one I watched was 60 mb, and it was adding 64kb at a time. That meant that for each chunk of 64kb, it was reading and writing the whole of the mother file. And that was taking a long time.

I've changed it. Now I'm opening the mother, seeking to the end of file, and appending the daugher to that. So I'm avoiding the read-and-write of the big file for each daughter. Things are running a lot faster now.

Running OK

Down on the server farm

I replaced Freya, which was a 466 MHz with a 2.53 Ghz, and lots more memory. That meant I could give Freya the jobs done by Rhoda - one fewer computer.

I also did some useful experimentation with NAT-PAT on the firewall; that reduced the number of IP addresses I need by one. I'm looking forward to the time when fibre broadband reaches me, and I can stop using the very expensive megastream, but I'll have fewer IP addresses to use.

The experimental subject was the garden-cam, which looks out of my window across the fields, it's a great view, and you can see walkers going down my lane, and the occasional car.

DtV Family web sites

Here's the full list of DtV family web sites

Back Page

I checked the site statistics that Sandra counts up each night.

At the end of June 2012, there were about 1,397,000 pictures (272 gigabytes), 428 gigabytes of video, 14160 text files (mostly stories) and a total of about 701 gigabytes. There's about 540 million pictures altogether in Newsthumbs, increasing at about 5 million per month.

To the Magic Carpet