Greg
animals language
brewing multimedia
cooking music
fiction opinion
gardening photography
general technology
history
Greg's diary
October 2012
Translate this page
Select day:
Mo Tu We Th Fr Sa Su
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30 31
Select month in 2012:
Jan Feb Mar Apr
May Jun Jul Aug
Sep Oct Nov Dec
Today's diary entry
Diary index
About this diary
Previous month
Next month
Greg's home page
Greg's photos
Network link stats
Greg's other links
Copyright information
    
Groogle
This view of the diary is limited to these topics: technology. There may be lack of continuity in the text, and some days may be completely missing. In case of doubt, please enable the complete display.

Monday, 1 October 2012 Dereel Images for 1 October 2012
Top of page
next day
last day

Kernel and module bloat
Topic: technology, opinion Link here

I noted yesterday that the nvidia driver module had got smaller. It certainly didn't get small. Once upon a time, UNIX kernels were really small, because they had to:

=== root@eureka (/dev/pts/6) ~ 73 -> l -rS /src/UNIX/Sixth-Edition/unix /src/UNIX/Seventh-Edition/unix
-r--r--r--  1 grog  wheel  28684 Jul 18  1975 /src/UNIX/Sixth-Edition/unix
-r-xr-xr-x  1 grog  wheel  51274 Jun  9  1979 /src/UNIX/Seventh-Edition/unix

We have more space nowadays, and kernels have increased dramatically in size since then. And why not? The Sixth Edition was designed for a machine with 128 kB of address space, so the kernel took up roughly 20% of the address space. My current kernel on eureka has:

=== root@eureka (/dev/pts/6) ~ 83 -> size /boot/kernel/kernel
   text    data     bss     dec     hex filename
10686327        1430612 1132352 13249291         ca2b0b /boot/kernel/kernel

So the text takes up 10 MB, roughly 0.125% of the 8 GB physical memory and far less a proportion of the address space. But then there are modules:

=== root@eureka (/dev/pts/6) ~ 66 -> l -rS /boot/modules/* /boot/kernel/*|grep -v symbols
...
-r-xr-xr-x  1 root  wheel    868616 Jun 22 14:29 /boot/kernel/vxge.ko
-r-xr-xr-x  1 root  wheel   1062640 Jun 22 14:29 /boot/kernel/hpt27xx.ko
-r-xr-xr-x  1 root  wheel   1111896 Jun 22 14:29 /boot/kernel/if_bxe.ko
-r-xr-xr-x  1 root  wheel   1533240 Jun 22 14:29 /boot/kernel/ispfw.ko
-r-xr-xr-x  1 root  wheel   1946832 Jun 22 14:29 /boot/kernel/zfs.ko
-r-xr-xr-x  1 root  wheel  15094112 Sep 30 12:06 /boot/modules/nvidia.ko
-r-xr-xr-x  1 root  wheel  15110160 Jun 22 14:12 /boot/kernel/kernel

The nvidia driver is very nearly as large as the kernel! But that's the new, smaller module. I saved the old one:

=== root@eureka (/dev/pts/6) /usr/ports/x11/nvidia-driver 88 -> tar tzvf nvidia-driver-295.59.tbz nvidia.ko
-r-xr-xr-x  0 root   wheel 16989264 Jul  4 12:24 nvidia.ko

How can any single driver be larger than the kernel? Simple: fill it with unnecessary junk like blobs for every supported card. I presume that's what this is:

=== root@eureka (/dev/pts/6) /usr/ports/x11/nvidia-driver/work/NVIDIA-FreeBSD-x86_64-304.51/src 94 -> nm nv-kernel.o
...
00000000004e2430 t _nv000239rm
00000000004e25c7 t _nv000240rm
00000000004e27b3 t _nv000241rm
00000000004e275e t _nv000242rm
...

It's part of over 10,000 similar labels. This explains why the current driver doesn't include “legacy” cards: that would bloat things even further. But why put all this in wired kernel memory? The module should identify the card and load the appropriate blob at probe time, as firmware(9) decrees.


Wednesday, 3 October 2012 Dereel
Top of page
previous day
next day
last day

You have been endorsed!
Topic: technology, opinion Link here

Lately I've been receiving messages like this one, sent from LinkedIn:

Date: Wed, 3 Oct 2012 19:41:31 +0000 (UTC)
From: Tom Rhodes <member@linkedin.com>
To: Greg Lehey <groggyhimself@lemis.com>
Received: from maile-aa.linkedin.com (maile-aa.linkedin.com [69.28.147.164])
        by w3.lemis.com (Postfix) with ESMTP id 9CF323B74B
        for <groggyhimself@lemis.com>; Wed,  3 Oct 2012 19:41:32 +0000 (UTC)
Subject: Tom Rhodes has endorsed you!
Message-ID: <975062635.5112619.1349293291862.JavaMail.app@ela4-app2310.prod>

Tom Rhodes has endorsed you!

Greg,

I've just endorsed you for skills &amp; expertise!

See your endorsements by clicking here:

http://www.linkedin.com/e/d4m02c-h7uudz6c-4d/Jmg7x16irWb3uf_He_84g0mS/spe/true/eml-skills_endorsements-btn-0-new_teaser/?hs=false&tok=23qfpEuZat95s1

And yes, the &amp; is in the original. In each case, it claims to be from somebody I know, though in some cases I haven't had anything to do with them for years. And of course they haven't endorsed me. The message really comes from LinkedIn, and the URL points to LinkedIn. But look at it: it contains the component eml-skills_endorsements-btn-0-new_teaser. Is LinkedIn doing something funny?


Thursday, 4 October 2012 Dereel
Top of page
previous day
next day
last day

Ballarat Gardens in Spring 2012
Topic: gardening, technology Link here

Spent most of the morning preparing a web page for Ballarat Gardens in Spring 2012, not too early. Somehow I need to wean the Friends from PDFs to proper web pages.


More network disconnects
Topic: technology Link here

Another network disconnect today, the first in nearly a week. Another of the kind that I suspect is a firmware reset, but this time clearly heralded by Optus network activity:

Oct  4 15:39:50 nerd-gw fstats: +CGREG  1  81E3  8FC8E66
...
Oct  4 15:43:40 nerd-gw fstats: +CGREG  1  81E3  8FC8E4A
...
Oct  4 15:48:08 nerd-gw fstats: +CGREG  1  81E3  8FC8E52
...
Oct  4 15:56:49 nerd-gw fstats: +CGREG  1  81E3  8FC48E8
Oct  4 16:00:46 nerd-gw fstats: +CGREG  1  81E3  8FC8F2E
Oct  4 16:00:58 nerd-gw fstats: +CGREG  2
Oct  4 16:00:58 nerd-gw fstats: +CGREG  2
Oct  4 16:00:58 nerd-gw fstats: +CGREG  1  81E3  8FC48E8
Oct  4 16:04:04 nerd-gw ppp[1663]: tun0: Phase: deflink: read (0): Got zero bytes
Oct  4 16:04:04 nerd-gw kernel: ugen0.2: <HUAWEI Technology> at usbus0 (disconnected)
Oct  4 16:04:04 nerd-gw kernel: u3g0: at uhub0, port 1, addr 2 (disconnected)
Oct  4 16:04:04 nerd-gw ppp[1663]: tun0: CCP: deflink: State change Stopped --> Closed
Oct  4 16:04:04 nerd-gw ppp[1663]: tun0: CCP: deflink: State change Closed --> Initial

The +CGREG lines refer to cell registrations. In the past I've had a lot of that, always between two cells (8FC48E8 and 8FC8F2E), but now we also have 8FC8E4A, 8FC8E52 and 8FC8E66. In addition, there were 12 seconds of no registration at all. In the past I wasn't sure what caused the firmware resets, but it's beginning to look like it is triggered by network activity.


Friday, 5 October 2012 Dereel Images for 5 October 2012
Top of page
previous day
next day
last day

Domain name renewal: for you, four times the price
Topic: technology, gardening Link here

The domain fbbg.org.au is coming up for renewal, and I got a reminder with typical content:

The following domain(s) will expire on the date indicated unless renewed. Please visit http://www.transact.com.au/ to renew.

Of course there's no information on domain renewal at http://www.transact.com.au/; it's far deeper. Took the search function and arrived at http://www.transact.com.au/en/business/products/web-hosting/domain-names. And the price was really good: $17 for two years.

But how do you renew? There's no information there about renewal. In the end called TransACT up and asked. They didn't know either, but they got Steve McCulloch to call me back. He didn't want to know anything about the $17: for me it was $60. I pointed at the web page, and he said he'd get back to me. When he did, he said:

The price for domain renewal is $60 as shown in the webhosting section if you scroll down. The link that takes you through to the incorrect pricing is not for Victoria but ACT.

What's wrong with this picture? For one thing, he doesn't say where he has been looking for that price, except that it was in “webhosting”, something I don't want. Another is that they have different prices in different states in the first place. And finally, after much searching I still didn't find the prices that allegedly applied to me.

Called up the Australian Competition & Consumer Commission, a name they try hard to hide, on 1300 302 502. Spoke to Shrupi, who told me that there's nothing illegal about asking for different prices in different places, but after some prodding agreed that the ACT page was misleading, and that that could be grounds for investigation. She made a note of the matter , but they won't take any action unless there are further reports.

Started writing a reply to Steve, but first checked the web site again. And this time, on their home page (only!) there was a random link in their clever flash animation: “Are you in Victoria?”. Clicked on that and got a parallel page http://www.transact.com.au/en-VIC/business/products/web-hosting/, which divulged (but only after clicking on “web hosting”, which I didn't want) a price of $60 for DNS hosting, in connection with web hosting. And the corresponding page for the ACT doesn't include any price at all for DNS registration.

But in each case there's a link on the left: “Domain name registration”. And it takes me to the page I originally found. The Victorian version appears identical to the ACT version: it mentions $17 for 2 years.

So: it seems that, for some strange reason, if you choose to host your web with TransACT and you're located in Victoria, they charge you not only monthly fees for the hosting, but additional $43 for domain name registration.

Once again: what's wrong with this picture? We cancelled our web hosting with TransACT a little over a year ago. But the $60 has to do with web hosting only. The fact that they treat their customers differently is a strange business tactic, given that the hosting is probably done on the same machine. But I came to the conclusion that Steve had had as much difficulty as I with their web site, and ended up offering me the wrong product. I put this to him, but he said, no, he had checked. This sounds to me like a third person was also confused by the organization of their web site.

To be fair to Steve, he offered to give me the renewal for $17. But by then it was too late; I had renewed elsewhere. Apart from the price, there's also the issue of the difficulty getting things done. There should be a page on the web site where you can do it automatically. Somehow I'm left with the feeling that TransACT, in Victoria at any rate (ex Neighbourhood Cable) has serious organizational issues.


Sunday, 7 October 2012 Dereel
Top of page
previous day
next day
last day

Efficient power supplies save power
Topic: technology Link here

I've now had my new Antec EA-550 power supply for over a week, and I've been keeping track of the power it uses:

Reading                   Total       Power
(kWh)       Date       Time       Power       usage
311.848       28 September 2012       8:57
315.493       29 September 2012       9:20       3.645       149.5 W
319.077       30 September 2012       8:32       3.584       154.5 W
322.736       1 October 2012       9:14       3.659       148.1 W
326.469       2 October 2012       8:42       3.733       159.1 W
330.209       3 October 2012       9:27       3.740       151.1 W
333.609       4 October 2012       8:39       3.400       146.6 W
337.399       5 October 2012       9:26       3.790       152.9 W
341.247       6 October 2012       11:18       3,848       148.8 W
344.625       7 October 2012       10:15       3.378       153.9 W       (DST transition)

Overall that's a consumption of 32.777 kWh over 9 days, 18 minutes (because of the daylight savings time transition this morning), or an average of 151.5 W. How does that compare with the old power supply? I didn't keep as many records of that, but what I have is:

Reading                   Total       Power
(kWh)       Date       Time       Power       usage
284.131       21 September 2012       15:54
287.834       22 September 2012       11:10       3.703       192.2 W
296.727       24 September 2012       12:14       8.893       181.2 W
300.845       25 September 2012       9:32       4.118       192.3 W
305.281       26 September 2012       10:01       4.436       181.2 W

Overall that's a consumption of 21.15 kWh over a period of 4 days, 18 hours and 7 minutes, or an average of 185.3 W. Given a presumed efficiency of 91% for the new power supply, that suggests that the old one has about 74% efficiency.

So on average I'm saving 33.8 W, or 0.8 kWh per day. At the current price of $0.245 per kWh, that's $0.206 per day, or $75 a year, and it would take me 558 days to save the $115 purchase price of the new supply. That's somewhat less than I expected, but still completely acceptable.


Monday, 8 October 2012 Dereel Images for 8 October 2012
Top of page
previous day
next day
last day

EDID: Good when it's right
Topic: technology, opinion Link here

Looking at the EDID information for my new 2560×1440 monitor was instructive, though I didn't really need to go into that much detail: the monitor Just Worked. But it was another matter with my Sanyo PLV-Z700 data projector: in the over 2 years I have had it, I haven't been able to get a really clean display at the native 1920×1080. Time to look at the EDID.

What a surprise! It had 14 different timing specifications, none of which matched the native resolution, and only 2 even matched the aspect ratio:

(--) Oct 08 10:27:08 NVIDIA(0): --- EDID for SANYOZ700 (CRT-1) ---
(--) Oct 08 10:27:08 NVIDIA(0): EDID Version                 : 1.3
(--) Oct 08 10:27:08 NVIDIA(0): Manufacturer                 : SAN
(--) Oct 08 10:27:08 NVIDIA(0): Monitor Name                 : SANYOZ700
(--) Oct 08 10:27:08 NVIDIA(0): Product ID                   : 47619
(--) Oct 08 10:27:08 NVIDIA(0): 32-bit Serial Number         : 16843009
(--) Oct 08 10:27:08 NVIDIA(0): Serial Number String         :
(--) Oct 08 10:27:08 NVIDIA(0): Manufacture Date             : 2008, week 38
(--) Oct 08 10:27:08 NVIDIA(0): DPMS Capabilities            :
(--) Oct 08 10:27:08 NVIDIA(0): Prefer first detailed timing : Yes
(--) Oct 08 10:27:08 NVIDIA(0): Supports GTF                 : No
(--) Oct 08 10:27:08 NVIDIA(0): Maximum Image Size           : 0mm x 0mm
(--) Oct 08 10:27:08 NVIDIA(0): Valid HSync Range            : 15.0 kHz - 80.0 kHz
(--) Oct 08 10:27:08 NVIDIA(0): Valid VRefresh Range         : 50 Hz - 85 Hz
(--) Oct 08 10:27:08 NVIDIA(0): EDID maximum pixel clock     : 160.0 MHz
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0): Established Timings:
(--) Oct 08 10:27:08 NVIDIA(0):   640  x 480  @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   640  x 480  @ 72 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   640  x 480  @ 75 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   800  x 600  @ 56 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   800  x 600  @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   800  x 600  @ 72 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   800  x 600  @ 75 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1024 x 768  @ 70 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1024 x 768  @ 75 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1280 x 1024 @ 75 Hz
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0): Standard Timings:
(--) Oct 08 10:27:08 NVIDIA(0):   1360 x 765  @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1376 x 774  @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1400 x 1050 @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):   1280 x 1024 @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0): Detailed Timings:
(--) Oct 08 10:27:08 NVIDIA(0):   1024 x 768  @ 60 Hz
(--) Oct 08 10:27:08 NVIDIA(0):     Pixel Clock      : 65.00 MHz
(--) Oct 08 10:27:08 NVIDIA(0):     HRes, HSyncStart : 1024, 1048
(--) Oct 08 10:27:08 NVIDIA(0):     HSyncEnd, HTotal : 1184, 1344
(--) Oct 08 10:27:08 NVIDIA(0):     VRes, VSyncStart : 768, 771
(--) Oct 08 10:27:08 NVIDIA(0):     VSyncEnd, VTotal : 777, 806
(--) Oct 08 10:27:08 NVIDIA(0):     H/V Polarity     : -/-
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0): Raw EDID bytes:
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0):   00 ff ff ff ff ff ff 00  4c 2e 03 ba 01 01 01 01
(--) Oct 08 10:27:08 NVIDIA(0):   26 12 01 03 0e 00 00 00  0a d0 9d a3 4f 52 a9 26
(--) Oct 08 10:27:08 NVIDIA(0):   0f 4c 58 ff ff 80 8b c0  8d c0 90 40 81 80 01 01
(--) Oct 08 10:27:08 NVIDIA(0):   01 01 01 01 01 01 64 19  00 40 41 00 26 30 18 88
(--) Oct 08 10:27:08 NVIDIA(0):   36 00 00 00 00 00 00 18  00 00 00 fd 00 32 55 0f
(--) Oct 08 10:27:08 NVIDIA(0):   50 10 00 0a 20 20 20 20  20 20 00 00 00 fc 00 53
(--) Oct 08 10:27:08 NVIDIA(0):   41 4e 59 4f 20 0a 20 20  20 20 20 20 00 00 00 fc
(--) Oct 08 10:27:08 NVIDIA(0):   00 5a 37 30 30 0a 20 20  20 20 20 20 20 20 00 ef
(--) Oct 08 10:27:08 NVIDIA(0):
(--) Oct 08 10:27:08 NVIDIA(0): --- End of EDID for SANYOZ700 (CRT-1) ---

And that's all. Other specifications are clearly wrong (Maximum Image Size: 0mm x 0mm), it claims that it prefers a resolution of 1024×768 (“Prefer first detailed timing”). The manufacture date of late 2008 also looks wrong: I don't think it had been announced then. I'm beginning to wonder if “Manufacture Date” isn't set when the EDID data is compiled and never changed, so it gives more of an insight into the history of the project than anything else. It seems that EDID data are very much neglected generally. That's a pity.

Of course, I'm no closer to my correct timings. I wonder if I can find them in binary in the driver for Microsoft: look for a sequence 2560 x y z 1440, for example, where x, y and z are monotonic increments of 2560. But it would make sense to first see if the Microsoft driver does any better than my home-made mode lines.


Thursday, 11 October 2012 Dereel Images for 11 October 2012
Top of page
previous day
next day
last day

Don't mix battery types
Topic: technology, opinion Link here

I've had mainly good experience with the Nickel-Zinc batteries that I bought last year. My only concern is that the high voltage (1.8 V) would be too much for some devices designed for conventional 1.5 V ZnC or alkaline batteries, so in many cases I tried mixing them with NiMH batteries to get voltages such as 3 V from one of each.

People say you shouldn't do that. Why? They're in series, so the voltages just add up. But in practice, I've noticed that when they discharge, it's the NiZn battery first, and it shows alarmingly low voltages. The first time I thought it was possibly a defective battery, but it happened again today. The NiMH battery had a voltage of 1.2 V, almost normal, but the NiZn battery was showing about 0.6 V when I took it out of the device. By the time I put it in the charger, only a few minutes later, it had recovered to 1.235 V, and it charged almost normally to 1.835 V (in contrast to 1.866 V for the same battery in February). But clearly there's something wrong here.

Peter Jeremy came up with the expectation that it would be the other battery that would be reverse charged: although the battery is discharged, it continues to have current go through it. But that would apply to either battery, depending on which goes flat first. Clearly a weakness in my view of batteries as simply a source of voltage in series with a variable resistor. Another “Don't Do That, Then”.


Friday, 12 October 2012 Dereel
Top of page
previous day
next day
last day

Yet Another ls option
Topic: technology, opinion Link here

Once upon a time, files were small. The First Edition of Unix had a maximum file size of 64 kB, and even today we see the effect of the ancient 2 GB limit in the Linux O_LARGEFILE flag to open. But the truth is much larger. I back up my systems to disk, and looking at them is something like:

=== grog@eureka (/dev/pts/14) ~ 29 -> ls -l /src/dump/boskoop/
total 168169
-rw-r--r--  1 root  wheel  36211690564 Mar 20  2012 boskoop.disk0-1.bz2
-rw-r--r--  1 root  wheel  16596907252 Dec 24  2009 boskoop.disk0.bz2
-rw-r--r--  1 grog  wheel   4173914809 Jul 20  2006 boskopp.tar.gz
-rw-r--r--  1 root  wheel  10273920512 Mar 18  2012 delicious-image
-rw-r--r--  1 root  wheel  80026361856 Mar 18  2012 old-boskoop-image
-rw-r--r--  1 root  wheel  28968755200 Mar 16  2012 root.tar

What are those values? How big are the files? Your eyes go funny just trying to count the digits. How much easier this would be:

=== grog@eureka (/dev/pts/14) ~ 32 -> ls -l, /src/dump/boskoop/
total 168169
-rw-r--r--  1 root  wheel  36,211,690,564 20 Mar  2012 boskoop.disk0-1.bz2
-rw-r--r--  1 root  wheel  16,596,907,252 24 Dec  2009 boskoop.disk0.bz2
-rw-r--r--  1 grog  wheel   4,173,914,809 20 Jul  2006 boskopp.tar.gz
-rw-r--r--  1 root  wheel  10,273,920,512 18 Mar  2012 delicious-image
-rw-r--r--  1 root  wheel  80,026,361,856 18 Mar  2012 old-boskoop-image
-rw-r--r--  1 root  wheel  28,968,755,200 16 Mar  2012 root.tar

But then, I have the source, so I can do it. But the “how” is interesting. There are a number of steps:

  1. How do you get printf to print the commas? Does it even work? Clearly a case for RTFM, which tells me:

    `''          Decimal conversions (d, u, or i) or the integral portion
                 of a floating point conversion (f or F) should be
                 grouped and separated by thousands using the non-mone-
                 tary separator returned by localeconv(3).

    What's that character? It looks like a quote or apostrophe ('), but so does the character after it, and they don't look the same. But they are: it's just in what passes for bold font on an xterm. But further up other confusing characters (zero and space) are explained, so this one's a candidate too. On my to-do list:

    1. Update man page to explain that the character is an apostrophe.

  2. Find the code and do a quick-and-dirty modification. ls is /bin/ls, so the source should be in /usr/src/bin/ls/, and it is. It was relatively trivial to find the place: it's in print.c. For test purposes, I just added a ' to the format, which of course would always print the commas:

    --- print.c     (revision 241498)
    +++ print.c     (working copy)
    @@ -612,7 +612,7 @@
    -               (void)printf("%*jd ", (u_int)width, bytes);
    +               (void)printf("%*j'd ", (u_int)width, bytes);

    But that came up with an unexpected problem:

    cc -O2 -pipe  -DCOLORLS -std=gnu99 -fstack-protector -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wunused-parameter -Wcast-align -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wold-style-definition -Wno-pointer-sign -c /usr/src/bin/ls/print.c
    cc1: warnings being treated as errors
    /usr/src/bin/ls/print.c: In function 'printsize':
    /usr/src/bin/ls/print.c:615: warning: unknown conversion type character ''' in format
    /usr/src/bin/ls/print.c:615: warning: too many arguments for format
    *** [print.o] Error code 1

    What's that? Who's right, the man page or the compiler? In this case, the man page. The compiler tries to second-guess what should be in a format, and it's wrong. But it only does that if the format is a string literal. The next attempt was:

    @@ -611,8 +611,10 @@
    -       } else
    -               (void)printf("%*jd ", (u_int)width, bytes);
    +       } else {
    +                const char *format = "%*j'd ";
    +               (void)printf(format, (u_int)width, bytes);
    +        }
     }

    And that worked. Well, it compiled anyway.

    My to-do list:

    2. Fix compiler's format parsing.
  3. So, run ls -l again. No change. It seems that printf is ignoring the format specifier. Back to RTFM:

    `''          Decimal conversions (d, u, or i) or the integral portion
                 of a floating point conversion (f or F) should be
                 grouped and separated by thousands using the non-mone-
                 tary separator returned by localeconv(3).

    Locales rearing their ugly head again. OK, how do I find out what my non-monetary separator is? localeconv() is a library function, so I can't use that to look. What commands are there? It proves that there's only locale(1) and mklocale(1). locale(1) seems the obvious one to choose:

    DESCRIPTION
         The locale utility is supposed to provide most locale
         specific information to the standard output.

    That “supposed” didn't exactly fill me with confidence. But still, all I wanted to do was print the contents of my current locale. How do you do that? Run locale(1) with no options:

    === grog@eureka (/dev/pts/7) ~ 20 -> locale
    LANG=
    LC_CTYPE="C"
    LC_COLLATE="C"
    LC_TIME="C"
    LC_NUMERIC="C"
    LC_MONETARY="C"
    LC_MESSAGES="C"
    LC_ALL=

    Not quite what I was looking for. I wanted to know what values I had set, and for that I needed keywords. The -k option looked like a possibility:

         -k      Print the names and values of all selected keywords.

    But that's the wrong way round: it wants me to tell it which keywords, and I want it to tell me all keywords. There doesn't seem to be a way to get it to show all of them. On my to-do list:

    3. Modify locale(1) to print all keywords if no argument is passed to the -k option.
  4. Carried on searching in localeconv(3), which gave me the contents of struct lconv, conveniently with comments that are missing from the header file /usr/include/locale.h.

    4. Add comments to /usr/include/locale.h.

    The name of the struct member is thousands_sep, and locale(1) understands that:

    === grog@eureka (/dev/pts/9) ~ 48 -> locale -k thousands_sep
    thousands_sep=""

    Not quite what I was hoping for, but at least it explains part of the problem. But why isn't it set? I have LC_NUMERIC="C". Does that not allow commas? How do I find out? I still don't know. Round about this time, Callum Gibson was trying his own experiments, and established that setting the variable LC_ALL changes things:

    export LC_ALL=en_AU.ISO8859-1

    That's not as obvious as it seems. The output of locale(1) looks like these environment variables, but the only one that seems to make any difference is LC_ALL. After that, my test version of ls finally worked:

    === grog@eureka (/dev/pts/14) ~ 32 -> /usr/obj/usr/src/bin/ls/ls -l /src/dump/boskoop/
    total 168169
    -rw-r--r--  1 root  wheel  36,211,690,564 20 Mar  2012 boskoop.disk0-1.bz2
    -rw-r--r--  1 root  wheel  16,596,907,252 24 Dec  2009 boskoop.disk0.bz2
    -rw-r--r--  1 grog  wheel   4,173,914,809 20 Jul  2006 boskopp.tar.gz
    -rw-r--r--  1 root  wheel  10,273,920,512 18 Mar  2012 delicious-image
    -rw-r--r--  1 root  wheel  80,026,361,856 18 Mar  2012 old-boskoop-image
    -rw-r--r--  1 root  wheel  28,968,755,200 16 Mar  2012 root.tar
    5. Review documentation of how to set locales, possibly fix..
  5. Next was to do things properly. Add an option for the commas, rather than print them all the time. That's relatively trivial, but which option? ls doesn't have too many option characters left, and there's the consideration of compatibility with POSIX.2, the other BSDs (including, in this case, Mac OS X) and Linux. In many ways it's a lost cause, of course. The options for GNU ls vary wildly from those for BSD ls, including lots of long options such as --show-control-chars, a verbose way of representing FreeBSD's -w option. And others, such as -T, have completely unrelated meanings.

    Still, it's good not to add more entropy than necessary, and I'm going to have to investigate this one.

    6. Choose a good option character.

    For now, the most obvious one seems to be the comma character ,. That works. But possibly POSIX doesn't like that, and it's liable to stir up a bikeshed when I commit.

  6. So, finally I'm done. Or am I? No, there's more:

    7. Update man page and usage() function.

  7. But then we're done! Well, no. Callum Gibson reported that it still didn't work for his program. So I wrote a little one that just called printf with the ' format modifier. And it didn't work. We traced the problem to the difference in ls: at the start of the program there's a

    (void)setlocale(LC_ALL, "");

    And this appears to be necessary. Is it adequately documented? There's something in setlocale(3) (obviously), but I managed to miss it. So:

    8. Investigate setlocale() documentation.

But then I'm really done—I hope. It's amazing how much work there is apart from just hacking the code.


Saturday, 13 October 2012 Dereel Images for 13 October 2012
Top of page
previous day
next day
last day

More fun processing photos
Topic: photography, technology, opinion Link here

House photo day today, without very much to report. The weather was moist, but I managed to get most photos done without trouble. The processing was a different matter.

In the last few months I've changed the environment in which I run DxO Optics “Pro”. I used to run it on a Microsoft machine that Chris Yeardley lent me, until Powercor destroyed it with a power surge. Then I ran it on VirtualBox, first with Microsoft “Windows” XP, then with a 64 bit “Windows” 8 preview, since DxO claim it's faster that way. I've also installed a couple of new versions.

One thing that's clear: the program remains glacially slow. But with each version there are undocumented changes in behaviour. One new version won't work with XP because it doesn't handle network shares well (or, as DxO support puts it, I don't have enough memory) independently of the amount of memory I throw at it. And today it occurred to me that some of the settings that I was using changed when I restarted the program. In particular, the all-important distortion correction and chromatic aberration were always set to “off” when I started the program.

How do I save default settings? I suspect that in the past it was just a matter of stopping the program normally (as opposed to letting it crash), but that no longer seems to work. There's a “Preferences” section, of course, and it allows you to save a default “Preset” (profile), and to automatically save the (undescribed) settings in a “sidecar” file, something that contains processing information for an individual image—clearly not what I'm looking for. The latter started happening after installing some version, so it seems that this version also overrode other options.

Spent quite a bit of time trying to read the manual. It's not that bad, but it's big: 141 pages, much of which is introductory material. It would be nice to have some overview. With a bit of trouble managed to save a “Workspace”, via a completely different menu interface. Hopefully that will work.


More network disconnects
Topic: technology, opinion Link here

Three more network disconnects today, for once all clearly pointing at Optus: in each case I received a terminate request. But does that help? The Optus people who determine policy probably don't even understand the issues, and I'd probably still need to reproduce it with a different dongle. Is it worth it? Roll on the radiation tower.


Sunday, 14 October 2012 Dereel Images for 14 October 2012
Top of page
previous day
next day
last day

Flowers in garden again
Topic: gardening, photography, technology, opinion Link here

Garden flower photo day today, again without too much difficulty. The real issue was with DxO Optics “Pro”. I strongly suspect that a(nother) bug has slipped in in the last version. I can save my workspaces all I want, but when I load them again, it is still missing a number of settings. More experimentation needed, but for the time being I need to set all the parameters manually Every Time.

The other issues I have are that DxO, Microsoft “Windows” 8 and VirtualBox all seem to be buggy enough that together they crash about one run in 3. And when I restart “Windows”, it doesn't reconnect the network drives, for reasons that aren't obvious to me. I've found that the easiest way to handle it is simply reinstate an old version of a saved VM. It takes a while to unpack the tarball, but then the system comes up exactly as I want it. Since I'm not modifying anything on the local disk, there's no problem.


Monday, 15 October 2012 Dereel
Top of page
previous day
next day
last day

More thoughts on NiZn batteries
Topic: technology, opinion Link here

A couple of days ago I noted that mixing different kinds of batteries is a Bad Thing after all, due to the possibility of passing more current through a discharged battery than it can handle. On that occasion the device was the indoor part of my wireless inside/outside thermometer, and I had put one Nickel-Zinc battery with one NiMH battery because two NiMH batteries weren't enough to run the illumination. So this time I put in two NiZn batteries, and sure enough, the illumination was wonderful.

But that was 4 days ago. Today I looked again, and it was as dim as if I had had NiMH batteries in there. Measured the voltages: 1.6 V and 0.9 V. Why? It almost looks as if I had had a partially discharged battery in there, though I wasn't aware of it. A few minutes later, by the time I put the batteries in the charger, the second battery had recovered to 1.007 V, and it charged to 1.848 V, still a little below the other at 1.896 V.

So: what's the reason? It's clear that using different batteries or batteries with different states of charge is not good. But what about differences in the batteries themselves? NiZn is still a very new technology, and I don't know anybody else who uses them. It's reasonable to assume that the quality is not as uniform as more mainstream batteries. Is it possible that minor differences in the batteries mean that one discharges more quickly than the other and then gets destroyed by its stronger neighbour? In any case, from now on I'll recharge all batteries before using them.


Tuesday, 16 October 2012 Dereel Images for 16 October 2012
Top of page
previous day
next day
last day

UPS problems solved
Topic: technology Link here

Another power failure at 3:21 this morning. Again only a brief failure, again the new UPS and the new power supply on eureka didn't help. Vented my anger on IRC, with unexpected results:

gr00gle: Grrr.
gr00gle: Another brief power failure, another system down.
gr00gle: New UPS.  New PSU.
gr00gle: What can be causing it?
callum: It's not plugged in to the UPS?
peter: snap
Darius: hehe
callum: Seems the most obvious.
callum: After all, you do have a messy desk.
* gr00gle . o O ( For every complex problem there's a solution that is simple, elegant
* gr00gle and wrong )
gr00gle: Still, worth a try.
...
gr00gle: Grrr.
gr00gle: Channel right, gr00gle wrong.
gr00gle: When I switched eureka to the power monitor, I also switched it off the UPS.
gr00gle: And for that, I bought a new UPS!
nox: gr00gle, ouch
callum: gr00gle: I knew it all along.

But on further investigation, it wasn't that simple. The first problem occurred on 6 September 2012, but I didn't move eureka to the power monitor until some time later. Looking at the boot logs, it must have been on 13 September 2012. So it seems that the old UPS did have a problem. Still, about time to tidy up behind my monitors.


DxO bug reports
Topic: photography, technology Link here

Finally got round to putting in a bug report for the problems I'm having with DxO Optics “Pro”. Their bug report site is only for customers, so here's the content:

Since installing version 7.5.4 of DxO Optics "Pro", I have had numerous difficulties with the interface. In particular:

It's worth mentioning that I didn't notice any of these problems until I installed version 7.5.4.


Wednesday, 17 October 2012 Dereel
Top of page
previous day
next day
last day

Video online
Topic: multimedia, photography, technology, opinion Link here

I've been taking photos for over half a century, and I've spent a lot of effort over the last few years to put them on the web in a manner I consider appropriate. But in the early 1980s I was unfaithful: I first borrowed, then bought a video camera, and declared that from then on all my records would be on video.

It took until about 10 years ago for me to reconsider. Videos can contain more information than photos, but watching them takes time. Even today I don't often look at YouTube videos, because my experience is that they're seldom worth the expenditure of time. But clearly there are areas where video is far superior to still photos, such as the clip I did yesterday. And YouTube has an advantage that you can access the videos directly and embed them into other pages, so for once I'm happy with a mainstream solution.

But what of the videos I've taken over the last nearly 30 years? Along with copies of my father's far older ciné films, they're on at least 32 VHS cassettes. Not a good long-term storage medium, so today I dragged them out, along with a couple of old VCRs and the horrible Digitrex DVD recorder, and started copying, not helped by the horrible interface to the Digitrex and the fact that the VCRs both had difficulty rewinding the tapes.

That took all day, and I'm still wondering how to present the clips. It's clear that I'll first have to cut them apart—that's easy enough, if somewhat laborious—but how do I include them in my file system hierarchy?


Diary topics revisited
Topic: technology, opinion, photography, multimedia Link here

About four years ago I made a change to this diary, adding “topics”, or “categories”. Nothing new; others have been doing it for years. But of course I wanted to do it My Way. Not too many categories; people will miss things like that. And preferably ones that are orthogonal. At the time, it seems that computers (“technology”, for want of a better term), photography and multimedia were relatively orthogonal, but they're coalescing. All the more reason for a small number of categories.


Thursday, 18 October 2012 Dereel Images for 18 October 2012
Top of page
previous day
next day
last day

Video processing software
Topic: multimedia, technology, opinion Link here

Now that my old videos are gradually trickling in in digital format, it's time to cut them into individual clips. What do I use for that? Recently I've been using avidemux2, but this time I got a message I hadn't expected:

 
This should be no-audio.gif.  Is it missing?
Image title: no audio
Dimensions: 618 x 180, 10 kB
Dimensions of original: 618 x 180, 10 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Thursday, 18 October 2012:
thumbnails    small images    diary entry

OK, that's really for for AVI images, and this is MPEG. In the past I've used Project X, so I tried that again. But how do you use it? There's still no documentation, and I forgot. The only documentation I found was out of date and only addresses small parts of the program. In addition, the program uses a single window with a tiny view of the clip, and it doesn't even resize when I go full screen (2560×1440).

So: Google is your friend. Found a recommendation for kdenlive, yet another KDE component. I've had bad experiences with KDE in the past: it wants to take over your life. But the recommendations looked good, so installed it anyway. 32 dependencies, requiring 370 MB of downloads—297 of them for oxygen-icons-4.8.4.tar.xz alone! And when I had it installed, I couldn't find the executable. It had been put in /usr/local/kde4/bin/kdenlive, which is not in any PATH. I suppose it makes sense in a KDE environment, but that's part of the “take over your life” attitude. Ran it and tried to load some videos. It appears to take the Microsoft attitude that the cwd is meaningless, and placed me in ~/Downloads instead. When I got it to go to the right place, it didn't want to know: it didn't display any of the videos there.

OK, RTFM time. Selected “help” and got:

 
This should be no-help.gif.  Is it missing?
Image title: no help
Dimensions: 418 x 155, 8 kB
Dimensions of original: 418 x 155, 8 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Thursday, 18 October 2012:
thumbnails    small images    diary entry

Another part of KDE that I don't have installed. Off to look for the online help and discovered that (apparently) you must have a “project“, not just run a program that takes an input, processes it and produces an output. After playing around a bit, I was able to load a clip and do things with it. It looks like a steep learning curve, but it may be worth it.


Friday, 19 October 2012 Dereel Images for 19 October 2012
Top of page
previous day
next day
last day

More video copying
Topic: multimedia, technology, opinion Link here

Continued with copying video tapes today—I had forgotten how long this can take in real time. In the process it occurred to me how many different video cameras I have had. In 1984 I borrowed one for a specific event, and in 1985, just before the birth of my daughter Yana, I bought my first own camera/video recorder combination. But that didn't last long: in late 1988, I think, I got a hand-held 8mm Sony camcorder, to be followed up with a second in late 1999. That one died in 2006, and since then we haven't taken any video, though I bought a second-hand Samsung recorder to copy the tapes.

And today it occurred to me that the VHS tapes I had been copying were copies of the original 8 mm tapes. So I went looking for them, and to my surprise found another 60 of them. That's nearly 100 tapes in total.

But where are the records? I kept detailed records of what was on the VHS tapes, but I can't find anything similar for the 8mm tapes. And tape number 1 was an Exabyte cartridge, which can hardly date back to 1988. It seems that at the time I looked on the 8mm cartridges as a transport mechanism, rather the way I do with CF cards now.

So I started on tape 2, which really did seem to be the original. But then old analogue problems came back: the playback was less than perfect, and this horrible Digitrex DVD recorder paused recording with the message “Paused due to copy protection”. So it looks as if I'm going to have to find an alternative way to read them in. There's an obvious candidate: a TV tuner card with a video input. I had one of those in my hands just a day or two ago, but it's now in hiding. Some time later; in the meantime it's time to process what I have.

Back to looking at avidemux2. Jürgen Lock suggested that the latest commit to the port might have fixed the problem with the audio support, so updated the port, but it didn't make any difference. Strangely, though, the message was inaccurate. Yes, I couldn't play the audio with avidemux2, but I could save the output with normal audio. But I wanted more, of course: I wanted to deinterlace the output. For that I had to change the configuration, so chose “MPEG-2 requant” and then “configure”. Bang!


  This should be avidemux2-crash.gif.  Is it missing?
Image title: avidemux2 crash          Dimensions:          949 x 779, 94 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Friday, 19 October 2012, thumbnails          All images taken on Friday, 19 October 2012, small
Diary entry for Friday, 19 October 2012

 

OK, looks like time to learn kdenlive. Spent some time looking at that. The tutorials are barely adequate, but once I get past the learning curve, I think it might do what I want. In the meantime I need to get a feeling for how I should store the images.


Correctly identifying plants
Topic: gardening, opinion, technology Link here

Over the last few days I've discovered a number of errors in plant naming. I've already mentioned the shrub we bought as Cissus, which I still haven't identified. But by chance I've come across a couple of others. The ginger that I have called Hedychium coronarium is in fact Hedychium gardnerianum. Hedychium coronarium looks very similar, but the flowers are white. Here my Hedychium gardnerianum, then Hedychium coronarium from wikimedia:


  This should be Hedychium-gardnerium.jpeg.  Is it missing?
Image title: Hedychium gardnerium          Dimensions:          3024 x 4032, 1088 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 19 February 2012, thumbnails          All images taken on Sunday, 19 February 2012, small
Diary entry for Sunday, 19 February 2012 Complete exposure details

  Hedychium coronarium

In addition, while tidying up today, I found a label for an Iberis sempervirens “Winter glow”, which proves to be what I have been calling Euphorbia “Diamond frost”. I was puzzled that it should be a Euphorbia, but it begs the question where the Euphorbia went.

OK, people can make mistakes. But now I have the problem that I already had with the Buddleja × weyeriana: I have lots of photos on the web, and when I change the names, they'll give 404s. What to do? I suppose the only choice is still to special-case it in my 404 document. What a pain!


DxO Optics: Not supported
Topic: multimedia, opinion, technology Link here

The progress of my bug report about saving defaults with DxO Optics “Pro” was amazing. First it got folded into a different ticket about the problems that DxO has, apparently with CIFS—a completely unrelated issue. Then today I got a response: Microsoft “Windows” 8 isn't supported. Problem: the ticket relates to Microsoft “Windows” XP. And he asked for traces, which I had submitted over a month ago. Clearly a problem with the work flow in support.

But where did he get the information that I'm running (pre-release) “Windows” 8? It's not in the bug report: I wasn't able to select it, so I specified “Windows” 7. I'm left with the feeling that they're not very open to genuine problem analysis.


Saturday, 20 October 2012 Dereel Images for 20 October 2012
Top of page
previous day
next day
last day

GIMP: The solution?
Topic: photography, technology, opinion Link here

Yvonne has been using xv for her photo processing for some time now. It's 20 years old, and by modern standards it's limited. In particular, it doesn't handle EXIF data, because it didn't exist when it was written. So it occurred to me that she might be able to use GIMP instead. She had taken some photos today, so I got her to try them out.

What a pain! She hated it, and I can't blame her. Workflow is terrible. With xv, she simply did:

=== yvonne@lagoon (/dev/pts/9) ~/Photos/20121020 55 -> xv *

xv then presents the photos one by one. She crops them and saves the result with a meaningful name.

So why doesn't that work for GIMP? First, GIMP insists on opening a separate window for each image. Today there were 102 of them, and though Yvonne went off and did something else for a while, it was still at it when she came back over 10 minutes later. So we stopped it and just started without parameters. Then, of course, she had to do a tree-climb to get to the cwd. It suggests all sorts of only marginally useful directories to start from, but the current directory isn't one of them, and entering . gets some unrelated directory, the name of which it doesn't divulge, containing files that locate can't find. What is it? And why?

Once in the directory, she could select a file and process it. That part is easy. GIMP would prefer to save the file by overwriting the original, but you can persuade it not to (ctrl-shift-S). And if you don't tell it anything else (by using a file extension), it will save it in some GIMP-specific format. Type in .jpeg and it does the right thing, but for every image it wants a confirmation screen.

Next image: ctrl-o. It positions the selection on the name of the file just saved. Which was the last one processed? Got to remember that. Go back there (page up several pages) and select it. New window. You need to close the old one manually.

After about 10 of these images (10% of the total), Yvonne was so fed up that she gave up. Yes, GIMP has many more features than xv. But they're presented in such a painful, Microsoft-like fashion that nobody in his right mind would want to use it. Why can't people think in terms of making it easier to use?


Sunday, 21 October 2012 Dereel Images for 21 October 2012
Top of page
previous day
next day
last day

avidemux2: the pain
Topic: multimedia, technology, opinion Link here

More discussion on IRC of the problems I've been having with avidemux2. There is no formal maintainer for the FreeBSD port, but Jürgen Lock has done some work on it recently. Did some more examination and discovered that I needed to install a second port, avidemux2-plugins. Why? One of the advantages of the Ports Collection is that this gets done for you. But it seems that there's an issue with the way newer versions of avidemux2 build, and that makes it incompatible with the Ports Collection. I'm sure there's a solution to that, but at the very least the port should print an appropriate message when it's done.

So: started avidemux2 again, and sure enough, no error message about missing sound support. And no sound. It took some time again to discover that the default audio output is “Dummy”. It needs to be set in Preferences, in my case to “sdl”, whatever that means. Then things work.

And the crashes on configuration? Tried selecting “MPEG-2 requant” and then “configure” again. It still crashes.

Further investigation shows that there are now many more video options. Tried selecting all of them and then configuring. Most worked, only “MPEG-2 requant” and “YV12” crashed. Jürgen was able to reproduce that, so presumably it'll get fixed later.

The other strange issue is a problem with window refresh. In some cases it doesn't happen until the window is moved. All in all, not a prime example of “open source” software.


Monday, 22 October 2012 Dereel Images for 22 October 2012
Top of page
previous day
next day
last day

GIMP: It must be like that
Topic: technology, opinion, photography Link here

Callum Gibson disagreed with my comments on GIMP from a couple of days ago. I've heard them before, both from him and from others. I still disagree. In summary (my comments in italics):

This line of argumentation is widespread. “It's complicated, so it must be difficult to use”. Clearly it's difficult to produce good interfaces for complex software, but as long as you don't even try, there's not much hope. The examples I presented are straightforward and easy to fix. Arguably most of these should be options; presumably died-in-the-wool GIMP users would reject them:

See? That's not difficult, is it? And it has nothing to do with the complexity of the beast. But I don't see it being adopted, so don't expect to see patches any time soon.


Tuesday, 23 October 2012 Dereel Images for 23 October 2012
Top of page
previous day
next day
last day

NiZn batteries: more problems
Topic: technology, opinion Link here

The indoor part of the inside/outside thermometer has again had problems with the Nickel-Zinc batteries. Once again I noticed it because the illumination was weak. And once again the voltage of one of the batteries had dropped to just over 1.0 V. Looking at my records, I see it was the same one I had problems with last time. Here part of my records:

            Before       After
Battery       Date       charge       charge
5       15 October 2012       1.765       1.896
10       15 October 2012       1.007       1.848
5       23 October 2012       1.798       1.867
10       23 October 2012       1.024       1.797

So clearly there's something wrong with battery 10. More importantly, batteries of differing quality really don't mix. I wonder what I can do with a single flaky battery, apart from throw it out. I think it would work OK without being in series with a more powerful one.


Wednesday, 24 October 2012 Dereel Images for 24 October 2012
Top of page
previous day
next day
last day

High definition: a matter of viewpoint
Topic: technology, opinion Link here

I'm still looking for a new video card for my computer. It looks as if the Zotac ZT-60201-10L might be the choice. It seems that it can feed two monitors with up to 2560×1600 dpi. High definition indeed, at least in part. Clearly it hasn't filtered through to the spec sheet:

 
This should be high-definition.gif.  Is it missing?
Image title: high definition
Dimensions: 718 x 84, 32 kB
Dimensions of original: 718 x 84, 32 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Wednesday, 24 October 2012:
thumbnails    small images    diary entry


Saturday, 27 October 2012 Dereel Images for 27 October 2012
Top of page
previous day
next day
last day

Scrambled display on hi-res monitor
Topic: technology Link here

I'm very happy with my new 2560×1440 monitor, but on three occasions now I've had a scrambled display when powering on:


  This should be Monitor.jpeg.  Is it missing?
Image title: Monitor          Dimensions:          4032 x 3024, 1744 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Saturday, 27 October 2012, thumbnails          All images taken on Saturday, 27 October 2012, small
Diary entry for Saturday, 27 October 2012 Complete exposure details

 

The first two cases were shortly after I got it, and the third was today. In each case I powered cycled it and it came up correctly, so I assume this is some kind of power-up race condition.


Sunday, 28 October 2012 Dereel Images for 28 October 2012
Top of page
previous day
next day
last day

DxO support: all your fault
Topic: photography, technology, opinion Link here

My interaction with DxO support continues to be frustrating. They don't read the reports, and they continually blame the problems on my configuration that “just meets the minimum requirements”. They won't tell me why this is a problem with accessing files via SMB. Indeed, they don't know what that is:

Please advise specifically what your issues are with access to shared (CIFS/SMB) file systems. Also please enlighten me as to the characteristics of these file systems, there are so many and I am personally unfamiliar with this specific terminology.

The issues are described in detail in the problem reports, of course, not to mention this diary, which shows that this has been going on for nearly 2 months. But a support person for a Microsoft-based product doesn't know what SMB is? Is that normal? So I told him, and got the even more surprising response:

If you are having errors with standard internet protocols, it is most likely due to your just meets minimum requirements computer. We do not troubleshoot Internet connectivity of customer machines nor does the DxO Optics Pro Software (not even the new Version 8.0).

And then there are issues with a new “feature” that they introduced recently: displaying a second set of thumbnails of the original images during processing, out of order. They're unnecessary in the first place, but the out of order display is particularly irritating. And I had to try three times before I even got a response to this point:

If these screenshots were indeed obtained under a supported OS, this function has been retained in the new DxO Optics Pro 8.0. They show processing progress on your computer. Which as I recall just meets minimum specifications to run DxO Optics Pro.

I had deliberately included the window decorations to show that this was Microsoft “Windows” XP. And not a word about the out-of-order display.

It's been so long since I purchased any Microsoft-space software that I really don't know: is this the level of support you should expect from third-party software vendors nowadays? Doubtless part of their inability to read what I write is because of their insistence on reverse order note-keeping:

From: Support & Assistance <support@dxolabs.zendesk.com>
To: Greg Lehey <groggyhimself@lemis.com>
Subject: #3490 [Support & Assistance] Request n°3490

##- Please type your reply above this line -##

#3490 [Support & Assistance] Request n°3490

Your request #3490 has been updated. Please respond directly to this email or follow the link below :
http://support.dxo.com/...

In any case, they're bringing out a new version, and they'll want more money for that, without any indication that the problems will be solved. I'm sure it'll be just as glacially slow as before. Time to try a different product?


Monday, 29 October 2012 Dereel
Top of page
previous day
next day
last day

Finding an alternative to DxO
Topic: photography, technology, opinion Link here

So far my experiences with DxO Optics “Pro” have been very frustrating. It's slower than anything I've seen, full of bugs, and the support people do everything they can to avoid fixing them. Now I can install a new version and pay more money, and the only mention of fixes is that the display bug I reported (they call it a feature) will not be fixed.

So: what are the alternatives? The obvious (and free) one is Olympus Viewer 2. After a bit of investigation, discovered that I first needed to install a version 6 months old and then use that to install the latest version. Installed the viewer and tried the update—“Your Olympus Viewer 2 is up to date”:

 
This should be up-to-date.gif.  Is it missing?
Image title: up to date
Dimensions: 629 x 342, 36 kB
Dimensions of original: 629 x 342, 36 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Tuesday, 30 October 2012:
thumbnails    small images    diary entry

It wasn't, but the differences weren't important. But why does all this software have so many bugs?

So: fired it up. I remember this product as having a particularly emetic interface, but I seem to be getting used to the Microsoft Way, and it wasn't too bad. But I couldn't find the photo file system in the silly tree on the left-hand side. But now I can enter path names (“Address”) directly in a window at the top, rather like in a web browser. Did that and got a message saying that the path was invalid. So I had to copy the files to the local file system—exactly the same kind of problem I had with DxO, just worse. Is there some general issue with SMB file systems under Microsoft?

Finally got round to processing the images. Clearly I didn't have the DxO presets at hand, so I tried as best I could. Yes, it corrects for distortion based on its knowledge of the lens, and also for chromatic aberration—without any lens profile. Still, this was for purposes of comparison only, so I let it run. Surprise, surprise: it's just as slow as DxO. And the results? Nowhere near as good. I had taken one of the photos from Dunnstown House as an example: it seems that the first time I processed them, I forgot to re-set all the settings that DxO Optics “Pro” had forgotten, and got a surprising amount of chromatic aberration from my Zuiko Digital ED 12-60mm F2.8-4.0 SWD lens. So I had a three-way test: the image processed by DxO without correction for chromatic aberration, processed by DxO with correction for chromatic aberration, and the image processed by Olympus Viewer 2. Here the latter two, with mouseover alternation, first the one processed by DxO, then by Olympus:


  This should be Dunnstown-house-11-2.jpeg.  Is it missing?
Image title: Dunnstown house 11 2          Dimensions:          3024 x 4032, 2496 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Saturday, 27 October 2012, thumbnails          All images taken on Saturday, 27 October 2012, small
Diary entry for Saturday, 27 October 2012 Complete exposure details

 
  This should be Dunnstown-house-11-2-Oly.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 Oly          Dimensions:          3024 x 4032, 3216 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Saturday, 27 October 2012, thumbnails          All images taken on Saturday, 27 October 2012, small
Diary entry for Saturday, 27 October 2012 Complete exposure details

 

Clearly the gradation is different, but more important, so is the distortion correction. It's not clear in this case which is more correct; I suppose I should try it on geometric shapes. Chromatic aberration is not obvious at this magnification, but it is on a crop, here of the top left-hand corner. Again there is mouseover alternation with the following image. These images are at native resolution, but the differences are clearer if you click on them to get double the size: first DxO without CA correction, then DxO with CA correction, then Olympus:

 
This should be Dunnstown-house-11-2-CA-top-left.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 CA top left
Complete exposure details
Dimensions: 300 x 225, 58 kB
Dimensions of original: 300 x 225, 58 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Saturday, 27 October 2012:
thumbnails    small images    diary entry
 
This should be Dunnstown-house-11-2-top-left.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 top left
Complete exposure details
Dimensions: 300 x 225, 54 kB
Dimensions of original: 300 x 225, 54 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Saturday, 27 October 2012:
thumbnails    small images    diary entry
 
This should be Dunnstown-house-11-2-Oly-top-left.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 Oly top left
Complete exposure details
Dimensions: 300 x 225, 40 kB
Dimensions of original: 300 x 225, 40 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Saturday, 27 October 2012:
thumbnails    small images    diary entry

Clearly DxO does the best job there. It's beginning to look as if I will have to put up with its bugs.

Another thing that I have noticed before: Ashampoo Photo Optimizer does not like the output of Olympus Viewer. Here's what it made of this image:


  This should be Dunnstown-house-11-2-Oly.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 Oly          Dimensions:          3024 x 4032, 3216 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Saturday, 27 October 2012, thumbnails          All images taken on Saturday, 27 October 2012, small
Diary entry for Saturday, 27 October 2012 Complete exposure details

 
  This should be Dunnstown-house-11-2-Oly-shampooed.jpeg.  Is it missing?
Image title: Dunnstown house 11 2 Oly shampooed          Dimensions:          3024 x 4032, 3104 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Saturday, 27 October 2012, thumbnails          All images taken on Saturday, 27 October 2012, small
Diary entry for Saturday, 27 October 2012 Complete exposure details

 


Network disconnect insights
Topic: technology, opinion Link here

After yesterday's power failure, I noticed that my wireless Internet connection was no longer doing any cell hopping, to the point that I started looking at my reporting software. It took over 24 hours before it started again:

Oct 28 09:02:51 nerd-gw ppp[1679]: tun0: IPCP: myaddr 118.209.12.68 hisaddr = 10.1.0.1
...
Oct 29 09:14:52 nerd-gw fstats: +CGREG  1  81E3  8FC8F2E

And then, of course, I had another remote disconnect:

Oct 29 16:52:14 nerd-gw ppp[1679]: tun0: LCP: deflink: RecvTerminateReq(3) state = Opened
Oct 29 16:52:14 nerd-gw ppp[1679]: tun0: LCP: deflink: LayerDown
Oct 29 16:52:14 nerd-gw ppp[1679]: tun0: LCP: deflink: SendTerminateAck(3) state = Opened
Oct 29 16:52:14 nerd-gw ppp[1679]: tun0: LCP: deflink: State change Opened --> Stopping

Roll on the radiation tower! It must be time for VCAT to deal with Wendy's complaint.


Tuesday, 30 October 2012 Dereel Images for 30 October 2012
Top of page
previous day
next day
last day

DxO 8: first impressions
Topic: photography, technology, opinion Link here

DxO Optics “Pro” release 8 is now available, so I downloaded it to try it out. In brief: it works, and so far it seems that the problems I have seen in the past haven't shown up. But I haven't finished my checks yet. Instead, revisited some comparisons I did 3½ years ago, before I started using DxO. At the time I had two views that caused significant problems. Today I tried—not for the first time—to process them with DxO, and this time I completed the task. Here are the comparisons with the base image, the best I got at the time, and what I got today with DxO. Again, each image has mouseover alternation with the next:


  This should be Centre-weighted-from-camera.jpeg.  Is it missing?
Image title: Centre weighted from camera          Dimensions:          1024 x 768, 180 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 
  This should be Centre-weighted-ufraw-frobbed.jpeg.  Is it missing?
Image title: Centre weighted ufraw frobbed          Dimensions:          3720 x 2800, 2768 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 
  This should be Centre-weighted-DxO-HDR.jpeg.  Is it missing?
Image title: Centre weighted DxO HDR          Dimensions:          3648 x 2736, 2832 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 

There's really no comparison.

The other comparison was supposed to be about the camera settings (“picture mode” “muted” and “vivid”). That didn't work because this is an idea in the mind of the camera-generated JPEG, but the comparison of the images is still interesting. Again, first the best from my last comparisons and then the DxO image:


  This should be Optimized-vivid-ufraw-frobbed.jpeg.  Is it missing?
Image title: Optimized vivid ufraw frobbed          Dimensions:          3720 x 2800, 2064 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 
  This should be vivid-DxO-HDR.jpeg.  Is it missing?
Image title: vivid DxO HDR          Dimensions:          3648 x 2736, 2528 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 


Trying Capture One
Topic: photography, technology, opinion Link here

By coincidence, also received mail from Phase One, advertising their new (I think) release of Capture One “Pro” 7, which does many of the same things that DxO Optics “Pro” does, though in this case the “Pro” is really in contrast to a non-“Pro” version. Again I get a free trial, this time 60 days, so I downloaded it and tried it out.

Where's the documentation? There's a user guide for release 6, but all I can find for 7 is a “Getting Started” guide. A bit more searching found an online guide with precious few images, whose rendering upsets firefox, but which with a bit of effort explains what you have to do.

The first thing is to create a Catalog! I can't just process files. It's happy enough with SMB file systems, but it doesn't want to do anything until there's a catalog.

About here I decided to give up, but after a while I reconsidered and went back and created a catalog, and then tried to access my files. No, sir, you can't do that. First they need to be “imported”. We can't have your photos hanging around on any old file system now, can we? Instead, it copied all the files to its own hierarchy:

 
This should be file-copies.gif.  Is it missing?
Image title: file copies
Dimensions: 640 x 135, 6 kB
Dimensions of original: 640 x 135, 6 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Tuesday, 30 October 2012:
thumbnails    small images    diary entry

Why do people do this? Potentially you can find a way around it, though I couldn't in the time I was playing with it. In this case there are only 5 files, but on Saturdays I have up to 300, which makes for gigabytes of duplication, not to mention the time that the unnecessary copying takes.

Still, the important thing is the quality of the conversion. Tried the same images as earlier in the day. Capture One “Pro” also has tools to lighten shadows, so tried that. It's fast enough that you can move sliders to lighten the shadows and also darken the highlights. The results in the preview window didn't look bad at all:


  This should be photo-1-preview.gif.  Is it missing?
Image title: photo 1 preview          Dimensions:          1098 x 839, 752 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Tuesday, 30 October 2012, thumbnails          All images taken on Tuesday, 30 October 2012, small
Diary entry for Tuesday, 30 October 2012

 

So I “exported” the images, which it happily did to the SMB file system, but I couldn't find a way to tell it to do it in JPEG. Instead it created TIFF files. So I used ImageMagick to convert them; convert complained bitterly:

=== grog@eureka (/dev/pts/8) /Photos/00-Oly 125 -> convert P4127387.tif P4127387.jpeg
00-Oly: Unknown field with tag 306 (0x132) encountered. `TIFFReadCustomDirectory' @ warning/tiff.c/TIFFWarnings/768.
00-Oly: Wrong data type 3 for "PixelXDimension"; tag ignored. `TIFFReadCustomDirectory' @ warning/tiff.c/TIFFWarnings/768.
00-Oly: Wrong data type 3 for "PixelYDimension"; tag ignored. `TIFFReadCustomDirectory' @ warning/tiff.c/TIFFWarnings/768.
00-Oly: Incompatible type for "FileSource"; tag ignored. `TIFFFetchNormalTag' @ warning/tiff.c/TIFFWarnings/768.
00-Oly: Incompatible type for "SceneType"; tag ignored. `TIFFFetchNormalTag' @ warning/tiff.c/TIFFWarnings/768.

And the results? Nothing like the preview. Here the results from Capture One, then the same image processed by DxO. Again, each image has mouseover alternation with the other:


  This should be Centre-weighted-CO.jpeg.  Is it missing?
Image title: Centre weighted CO          Dimensions:          3648 x 2736, 3616 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 
  This should be Centre-weighted-DxO-HDR.jpeg.  Is it missing?
Image title: Centre weighted DxO HDR          Dimensions:          3648 x 2736, 2832 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Sunday, 12 April 2009, thumbnails          All images taken on Sunday, 12 April 2009, small
Diary entry for Sunday, 12 April 2009 Complete exposure details

 

But why the difference in saturation? I don't know. I wondered whether it could have been the conversion to JPEG, but xv didn't want to know about the TIFF files: it complained transiently about various format errors and refused to display it.

Still, the image did look good, probably better than the one created by DxO. These two images show the top left corner of each at natural resolution, first Capture One, then DxO. The blue shadows in the DxO image have almost completely disappeared.

 
This should be Centre-weighted-CO-top-left.jpeg.  Is it missing?
Image title: Centre weighted CO top left
Complete exposure details
Dimensions: 300 x 225, 54 kB
Dimensions of original: 300 x 225, 54 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Sunday, 12 April 2009:
thumbnails    small images    diary entry
 
This should be Centre-weighted-DxO-HDR-top-left.jpeg.  Is it missing?
Image title: Centre weighted DxO HDR top left
Complete exposure details
Dimensions: 300 x 225, 16 kB
Dimensions of original: 300 x 225, 16 kB
Display this image:
thumbnail    hidden   alone on page
Display all images on this page as:
thumbnails    this size
Show for Sunday, 12 April 2009:
thumbnails    small images    diary entry

One thing's clear from the image comparison above, though: the shape of the image is different. DxO has compensated for lens distortion, but though Capture One “Pro” offers distortion correction for some lenses, none are Olympus SLR lenses, and the cheaper non-“Pro” version doesn't offer it at all. And neither of them have lens-specific chromatic aberration correction. I'll look at what I can do about that tomorrow, but this looks like yet another reason to reject it.

Apart from that, though, and this stupid import/export business, it doesn't look too bad. But some things show how different the approach is. You can create a web page with “contact prints”, something that I've found useful and done myself. But my version shows reasonable sizes, and you can select them to get them in full size, and you can enter names for them:


  This should be contacts.gif.  Is it missing?
Image title: contacts          Dimensions:          998 x 547, 122 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Tuesday, 30 October 2012, thumbnails          All images taken on Tuesday, 30 October 2012, small
Diary entry for Tuesday, 30 October 2012

 
  This should be gregs-contacts.gif.  Is it missing?
Image title: gregs contacts          Dimensions:          2535 x 747, 608 kB
Make a single page with this image Hide this image
Make this image a thumbnail Make thumbnails of all images on this page
Make this image small again Display small version of all images on this page
All images taken on Tuesday, 30 October 2012, thumbnails          All images taken on Tuesday, 30 October 2012, small
Diary entry for Tuesday, 30 October 2012

 

The original sizes of these displays are 998×547 and 2535×747 (I trimmed mine, which was really full screen on the 2560×1440 monitor). My contact images are 300×400 pixels; the ones in Capture One's web page are roughly 108×144, and they can't be enlarged. So a nice idea proves to be less useful than what I have already.


Wednesday, 31 October 2012 Dereel Images for 31 October 2012
Top of page
previous day

Still more photo processing
Topic: photography, technology, opinion Link here

I had intended to play around more with Capture One “Pro” 7 today, but somehow I didn't get round to it. Instead spent some time looking at DxO Optics “Pro” release 8, in particular with regard to the problems I have had with release 7. In summary:

And what else? It's always the misfeatures that get you first, of course. They have this new feature that I can no longer find on their web site, that it remembers what you were doing last time and displays the images when restarted—even if they're no longer there! In my case, I removed the images and replaced them, and it displayed two copies (“virtual copies”) of each image! What a pain! They need to be explicitly removed, which involves first sorting the display by virtual copy number, selecting all the virtual copies and removing them. I wonder what they think this is good for.

And the processing speed? I tried processing all the images I took on 20 October 2012, all 216 of them. After 45 of them (72 minutes, 35 seconds) I aborted the conversion. That's an average of 1.6 minutes per file, where I had been getting only a little over 30 seconds with release 7. But I've already noted that there's something strange about the processing speed. Tried again with release 7.5.5, processing the first 10 images and a JPEG image accidentally left in the directory: 7.97 minutes for 11 images, or 44 seconds per image. Tried the same 10 images (irritatingly without the JPEG) with release 8 and it took 7.12 minutes, or 43 seconds per image.

Why the discrepancy? Is there some performance issue that makes it slower when you have a lot of files to process? That's a possible interpretation of this statement in one of my tickets:

It will run very slowly given such a large batch run. Reduce your batch size if you wish better processing speed or alternatively use a more capable computer.

In any case, things look marginally better now. Spent a lot of time reading the manual, which has also been reworked and now looks optically much better.


Top of page Previous month Greg's home page Today's diary entry Next month Greg's photos Copyright information

Valid XHTML 1.0!

$Id: diary-oct2012.php,v 1.53 2013/02/10 04:04:36 grog Exp grog $