Reflections on life at “De Witte Wand”…

Category: Computers and Internet

  • Soldiering On

    I see that Paul Thurrott, in an article published on his Supersite for Windows, has done a U-turn and is now betting on Windows Home Server 2011. Back in October 2010, when he was first told by the current WHS team that they would be removing the Drive Extender technology from WHS 2011, his first reaction was that:

    “Removing Drive Extender was the equivalent of driving a dagger right through the heart of the product”.

    Indeed, that was my first reaction on hearing the news when it became public a month later, and the reaction of many, if not most, of us who had bought the original version of Windows Home Server.

    Despite the outcry (for example, there are currently 5,581 votes in favour of retaining the DE technology in WHS 2011 versus 73 against over at the Microsoft Connect site – tagline: your feedback improving Microsoft products), the technology will not be put back into the final WHS 2011 product. (Addendum: on the 12 March 2011, Microsoft removed all the suggestions that had been posted by WHS 2011 beta testers in the connect forum, including this one. An act that reminded me of the Soviet’s airbrushing ex-politicos out of photographs. One way of removing embarrassing facts, I suppose)

    So now, Paul Thurrott has put his sense of disappointment behind him, and written that:

    So yes, I’m disappointed about Drive Extender, I really am. And yes, I’ve sweated this decision for months. But when the final version of Windows Home Server 2011 appears in the months ahead, I’m switching. And I’ll let you know how it goes, of course. But I can tell you now that Microsoft’s home server solution is still the best game in town, even with the removal of Drive Extender. And if you could stop crying into your beer, I think you’ll admit the same.

    Well, perhaps. But what I find most telling about this whole debacle has been the way that it has been (mis)handled by Microsoft. It seems clear, from Thurrott’s own account, that the current WHS team did not have a clue, at least in the beginning, that the decision to remove DE would have such a negative reaction.

    In effect, the team had just torn up the guiding principles for the product developed by Charlie Kindel and the original WHS V1 team – but they don’t seem to have appreciated that fact, or the likely reaction from customers who had bought V1 on the strength of those principles.

    The team then soldiered on with the decision – and I have to give them credit for their brass necks – and very probably have weathered the storm. But I really could have done without the disingenous posts on their blog telling us that they were only following feedback from their customers:

    “When weighing up the future direction of storage in the consumer and SMB market, the team felt the Drive Extender technology was not meeting our customer needs”.

    There are some good things remaining in WHS 2011, but the heart of WHS V1 – its provision of consumer-friendly storage – has been surgically removed.

    The die has been cast – we’ll see what happens.

  • Making a Silk Purse out of a Sow’s Ear – Not

    Oh dearie me, Microsoft has just unleashed the Release Candidate of Windows Home Server 2011 upon the world. And as they had promised, they have surgically removed the one unique selling point that WHS version 1 had – the drive extender technology.

    Frankly, this confirms to me that Microsoft has totally lost the plot when it comes to crafting consumer technology that ordinary people – as opposed to IT experts – actually feel comfortable about having.

    They are, of course, putting their spin on how WHS 2011 will be wonderful, but it all has the air of them trying to make a silk purse out of a sow’s ear, and failing miserably. Take, for example, this YouTube video that they put up to show us how to manage our storage in WHS 2011. With WHS version 1, when your storage was getting full, you could just add another drive and carry on. Now, as this video painfully points out, you have to worry about whether you need to move your folders around to rebalance your storage across your discs.

    Hello, Microsoft, wake up – Mr or Ms average consumer doesn’t want to think like an IT support person.

    I, for one, will be carrying on with WHS version 1 for as long as I possibly can. WHS 2011, with the removal of Drive Extender, has nothing to offer.

  • A Tale of Two Markets

    Following on from the previous post on Android 3.0 (Honeycomb), I see that Google also announced, and have opened, a web presence for Android applications: the Android Market.

    I found it quite instructive to compare using Google’s Android Market with the Microsoft equivalent, the Zune Marketplace.

    The first thing to note is that, in the Android Market, it is possible to browse and purchase applications for your Android devices directly via the web site. The Zune web site, on the other hand, does not allow you to browse applications for your Windows Phone directly. Instead, when you click on the “Browse Zune Marketplace” link, it fires up the Zune client application on your PC, which accesses the applications for Windows Phone 7 available in your location. And there’s the rub: the Android Market seems to be a single global marketplace, accessible to everyone, while the Zune Marketplace is heavily fragmented, and not open in all countries. I’ve written about this Microsoft Marketplace disaster before, but to see it laid bare by comparing the user experience with Android Market is very revealing.

    Microsoft really should open up a web site to allow global access to WP7 applications along the same lines as Google’s Android Market. If they don’t, then they will continue to be on the back foot in the Smartphone market.

  • Honeycomb Looks Sweet

    Google presented the latest version of their Android operating system yesterday, which is codenamed Honeycomb. The presentation has been posted on YouTube.

    I must admit that there were some nice touches in the User Interface of Android 3.0, particularly the use of hardware accelerated graphics. The UI is finger-driven, of course, and watching the demo really drives home the point that a Windows Tablet just isn’t designed for fingers. If Microsoft still haven’t grasped that fundamental point, and continue to insist that Windows Tablets, in their current form, can compete against Android and iPad tablets, then they will fail miserably.

    Watching the presentation also drove home another couple of points to me. First, how much I loathe and detest marketing-speak. I’m afraid watching people with false smiles saying how excited they are to be here today to tell you all about their “cool” and “awesome” products has never been one of my favourite pastimes. Secondly, I am so clearly not in the target markets. I might just as well be from another planet. I think that was exemplified by the gentleman from Disney Mobile gushing excitedly about something called Tap Tap Revenge, which has probably earned the Disney Corporation more money than the GDP of most small countries.

    And then there was the team from CNN showing their news application for the Android tablets. Quite apart from the fact that quality journalism is already a threatened species, CNN seem to be wanting to drive it further into extinction by introducing something called iReport. Essentially, CNN want to fool us into submitting news reports to them, for free, and my bet is that the rights subsequently belong to CNN, and not to the originator. I suspect that the quality of the majority of the stories will merely underline the veracity of Sturgeon’s Law. For example, on the page of news stories being demonstrated was one concerned with the fact that the iReporter’s miniature dachshund was caught in a recent snowfall. 

    I was left with the feeling that if Sturgeon were to redefine his Law today, he would probably revise the estimate of 90% (of everything being crud) to a number that would be considerably higher.

    Still, looking beyond the fact that I am an old curmudgeon, it will be interesting to see how the Tablet market develops. This challenge from Google with Android 3.0 looks to be a good one.

  • The Dream Machine

    I’ve always had a soft spot for Adventure games, ever since the original Myst. I much prefer this genre of game over the first-person shooter type, which, frankly, I find appalling.

    After Myst, and its various sequels, there were a series of rather sub-standard knock-offs of the same idea. It wasn’t until Benoit Sokal’s Syberia arrived that I thought that the same standard had been achieved. That was followed by Syberia II that managed to reduce me to tears at a climatic moment in the game (for all the right reasons!). Although a Syberia III has been talked of, there’s still no sign of it appearing on the market.

    In the meantime, there’s the Dream Machine, an online game using clay and cardboard models (I recall The Neverhood with fond memories!) that is surprisingly involving and immersive. You can play the first chapter for free, the subsequent chapters can be unlocked for less than €5 each.

    The puzzles are not as mind-bending as in Myst, but it has a charm that I really liked. It’s the product of two Swedish nerds,  Erik Zaring and Anders Gustafsson, with help from others. It has the potential to become a classic. Try it.

  • Am I a Microsoft Fanboi?

    I think the answer has to be “no”.

    Honestly, I do care about what Microsoft does. After all, I rely on its products to power my computing infrastructure. I use Windows 7 on our Home Theater PC, our PCs and Tablets, and Windows Home Server for our media storage and computer backup.

    And yet, I find myself increasingly griping about the directions that Microsoft is taking. If it’s not the shortcomings of Windows Live, it’s the idiocy of the Windows Marketplace, or it’s the brain-dead decision to remove Drive Extender from Windows Home Server.

    What on earth is going on?

  • Microsoft’s Marketplace Merry-go-round

    My mobile phone is an ancient (in mobile phone terms) Nokia 6310i. I bought it for myself back in 2002. It still functions perfectly well as a phone, but in these days of Smartphones, it’s positively primitive.

    Thus far, I’ve successfully resisted the lure of replacing it with a Smartphone. I certainly don’t want to buy an iPhone, I’m not convinced by smartphones based on Google’s Android operating system, and the Windows Mobile operating system always struck me as unbearably clunky. Now, however, Microsoft has introduced a completely new smartphone operating system into the market: Windows Phone 7. My impression, from the reviews is that it’s pretty good as a first version of a completely new system. So I’ve been casting envious glances at the WP7 phones that are available and wondering if I should take the plunge. Here in the Netherlands, that means that, at the moment, I have a choice of three handsets: The Samsung Omnia 7, the HTC 7 Trophy and the LG Optimus 7. Of the three, the LG Optimus 7 would be the one I would go for. But should I do it? Apart from the cost (even though it’s a good deal less than the eye-watering price tags on Apple’s iPhones), when looking further into it, there are some flies in the ointment that rather temper my enthusiasm.

    The thing is, like other smartphones, a Windows Phone 7 device lives in an ecosystem that makes material such as music, video and applications available. For Windows Phone 7 devices, that means Microsoft’s Windows Phone Marketplace, and I’ve discovered a problem with it.

    The marketplace is built on the same back-end infrastructure used by Microsoft’s Xbox Live Marketplace and the Zune Marketplace. This infrastructure is country-aware, that is, the products and services that are offered through the marketplaces may vary from country to country. Here, for example, are two screenshots of the Zune software on my PC displaying the marketplace. The first is taken with my PC with its location set to the US, while the second has the PC location set to The Netherlands.

    Zune 1

    Zune 3

    As you can see, the range of products available in the US is much broader (music, videos, podcasts, channels and applications for both the Zune and Windows Phone 7) than the current miserable selection available to us Dutch. We only get to be able to rent videos.

    The Zune device is not officially available here in The Netherlands (or indeed lots of other countries), but many people buy one from the US. Then, in order to gain access to the wider range of products and services, they create an account for themselves in the US.

    However, somewhere along the line, a design decision was taken within Microsoft regarding how to register the country of residence of marketplace users that now makes the whole marketplace ecosystem unworkable for some of us. The issue is that, once you have registered a country of residence, you can neither change it nor even delete your account. In addition, you’ll find that, if you try and register a credit card to pay for marketplace purchases, the card must have a country billing address that matches the one registered in the marketplace.

    So those people who have created an account in a different country from where they now live are stuck. This not only applies to people who have bought grey imports of the Zune device, but innocents who have bought their device in the US when they lived there, but who now live and work elsewhere.

    It also applies to me. I don’t own an Xbox, a Zune device or a Windows Phone. However, I made the mistake of downloading and playing with the Zune software about a year ago to compare it with Windows Media Player (that’s another story). Along the way, I created a Zune account using my Windows Live ID, just to try out the experience, not realising that the country of residence would be hardwired to the US without any possibility of change or deletion. At the time, I just shrugged my shoulders and thought no more about it. However, now that the Windows Phone 7 is available in The Netherlands, that means that I can’t actually buy any applications through the marketplace, either in the US or in the Netherlands. In effect, I find myself in limbo, along with probably thousands of others.

    The issue is recognised by Microsoft, there have been many threads about it in both the Zune and the Windows Phone 7 forums. Jessica Zahn, a Senior Program Manager for Zune, has written in one of these threads:

    Like I said, it’s not about what your Live ID itself says – it’s about what country you chose when you first joined Zune with that Live ID. You can change your Live ID country at account.live.com, I think – it’s the Zune country that can’t be changed. Here’s an example of why it’s complicated:

    You live in France. You sign up for Zune and you say you’re in the US so you can use the Zune software and Marketplace. You buy lots of music, and we love you for that.

    When Zune offers a Marketplace in France, you decide it’s time to switch over so you can read everything in your native language and get access to music that’s only available in the marketplace for France, etc. BUT what happens to the music you already bought, that we don’t have rights to sell in France?

    Do we take it away from you? Not let you re-download .wmas or video? What will the content owners say if they find out we were selling content to people in regions where we’re not allowed to sell?

    I can tell you we’re working through those questions now and figuring out how to allow people to move countries, etc – but it’s not easy, and those of you who have said this has been a problem for Xbox for a long time are correct – and we use the same infrastructure as Xbox.

    There’s a couple of things about that. The first is her reference to “music [that] you already bought”. The thing is, according to the terms and conditions, we don’t “buy” music (or indeed any other content offered through the Marketplaces) – we only license it. Section 8:

    Marketplace is the online store for the service.  All content made available through the Marketplace is licensed, not sold, to you.

    And further, the terms and conditions spell out very clearly in section 3 that:

    We may change, delete, modify or discontinue, temporarily or permanently, the service, any functions, features or content of the service, at any time and for any reason, in any country, in our sole discretion.

    Due to contractual or other limitations, some content available in the service may from time to time become unavailable. Consequently, you may not be able to re-download or re-stream certain content that you have purchased.  For music and video content, to the extent we receive information from the content owners indicating the date their content will be unavailable, we will endeavor to share this information with you.

    Your ability to access the service and obtain certain content is restricted to your territory. If you change your account to a different territory, you may not be able to re-download or re-stream content that was available to you in your previous territory. In your new territory, you may be required to purchase and pay for content even if you have already paid for that content in the previous territory.

    So professing concerns about “taking your music away from you” seems a little disingenuous – it’s been quite clear from day one in the terms and conditions that this was always on the cards. It’s interesting, though, that the terms and conditions cover the case where the country (territory) is changed, even though this is not currently possible.

    Ms. Zahn’s solution to this conundrum is for users caught in this trap to create another Windows Live ID. That is both simplistic and doesn’t really address the problem. I’ve been using my Windows Live ID for a long time – it’s tied to my primary email address (which I’ve had since the early 1990s). Setting up a new Windows Live ID for a Windows Phone that is not using that email address doesn’t help.

    However, it does appear that Microsoft are thinking about the issue, so perhaps I’ll be able to change or delete my current Zune account (which I have never used) in readiness for the Dutch Windows Phone 7 marketplace when it finally gets launched in mid-2011. Nonetheless, knowing my luck, and on past experiences with Microsoft, my betting is that the Dutch Marketplace will only offer applications in Dutch. As a Dutch user vents in the same thread:

    I may be Dutch and live in the Netherlands, but can it please be my own decision what language I speak? I speak English at home and I speak English at work and I have never ever installed a non-English piece of software on my PC. But Microsoft doesn’t want to open the windows Phone market place for me to download free apps to my phone, because I am Dutch. It is so frustrating, I can’t even put it into words. I just got my nice Samsung phone and I have never felt so much frustration with a new gadget.

    It looks as though if I were to buy a Windows Phone 7 device today, I would have a device that has had a lobotomy forced upon it by Microsoft’s Marketplace missteps. I think I’ll stick with my trusty Nokia for a while longer.

  • Windows Live Photo Gallery 2011 – Status Report 2

    Just over a week ago, I gave a status report on the issues that I was having with Windows Live Photo Gallery 2011. In summary, there are three major issues that I’m concerned with at the moment:

    1. Unwanted, and often inaccurate, GPS coordinates being inserted by WLPG 2011 into the Exif of images that have IPTC location metadata present, but no GPS coordinates currently set.
    2. Corruption of Makernotes in the Exif section of JPEG image files by WLPG.
    3. Unwanted compression of the file, even if only metadata is being changed by WLPG 2011.

    Microsoft acknowledged issue (1), and have now produced a fix. If you go to the Download page of the Windows Live Essentials software, and re-download, you’ll get the updated version. The build number of the WLPG 2011 that was released on the 30th September was 15.4.3502.922. The updated version is now 15.4.3508.1109.

    In summary, Microsoft have told me the changes are:

    • GPS coordinates on a file are read-only inside of WLPG.  WLPG will never add, change or delete the GPS coordinates.
    • If a file contains GPS coordinates when it’s brought in to WLPG, reverse geocoding will be triggered and location strings are displayed in the info pane, users can rename or remove the strings but GPS coordinates won’t be touched. Users may Rename a location but it will then leave a mismatch between the coordinates and the string since the coordinates are read-only.
    • If a file does not contain GPS coordinates, users will be able to geotag by adding a string (that gets validated against Bing as it does today) but no GPS coordinates are added to the file.  The user can remove the string or rename it.
    • If the file contains a geo name only, there will be no GPS coordinates calculated for it.

    I’ve done a few quick tests, and I think I can point to a couple of additional behaviours:

    • If a file contains IPTC Location metadata when it’s brought into WLPG, then WLPG will behave in a similar fashion to the second point above. That is, WLPG will use the IPTC Location data to set the location strings in the geotag field of the info pane. If the geotag is deleted or changed in WLPG, then there will be a mismatch between the IPTC Location metadata and the geotag because the IPTC Location metadata will be left untouched.
    • Changing a geotag in WLPG, while it leaves the IPTC Location metadata untouched, will also cause WLPG to write out the contents of the geotag as IPTC Extension LocationCreated metadata. In other words, the file will now contain different location metadata in two places: the original location recorded in the IPTC Location metadata elements, and the new location now recorded in the IPTC Extension LocationCreated metadata elements.

    So as far as I can see, I can use this latest version of WLPG 2011 safely, provided that I do all my geotagging and geocoding work outside of WLPG 2011. That way, WLPG 2011 is only ever reading GPS and IPTC Location information, and it will never write out GPS or geocodes into my files.

    Microsoft acknowledge that there’s room for improvement here in future versions of WLPG and will be revisiting this feature. For example, I think that if they were to provide a mapping interface within WLPG itself, then users could check or modify the GPS coordinates and use WLPG to write them out into the files.

    So long as WLPG 2011 never writes out any metadata to my files, then I won’t get hit by issue 2 (Makernotes corruption) or issue 3 (file compression).

    What’s the current status of those issues?

    Well, Microsoft also acknowledge issue (2), but currently treat this as a lower priority. I see that today the issue has been escalated, so perhaps they’ve begun to work on it. Until it’s resolved, I personally don’t want to use WLPG 2011 to do any tagging (e.g. people or descriptive tags), because then metadata gets written out to the files, and that will trigger the Makernotes corruption.

    As I noted in my last status report, issue (3) is interesting, because not everybody is being affected by this. As I reported last time, it does seem to be caused by some kind of interaction between WLPG 2011, the Windows Imaging Component library in Windows itself and third-party Codecs that some of us need to install to handle non-JEPG image formats.

    I’ve been doing some more investigation, and I think I have a workaround for my particular case.

    I’m using the FastPictureViewer Codec Pack, because the codecs handle a wide range of image formats, which Windows and WLPG cannot do by themselves. One of the codecs is designed to handle auto-rotate of JPEG images. It looks as though that if this is installed into the WLPG/WIC/Codec pipeline, then I get the unwanted file compression. So my workaround is to de-install this particular codec in the FastPictureViewer Codec Pack. Hopefully, this issue will get resolved in a more robust fashion in the future.

    So, of the three major issues that I started with, the first has been satisfactorily resolved (with room for future improvement), the second is being worked on, and the third has been identified and perhaps Microsoft and the third-party Codec developers will come to some sort of resolution in the future.

    This all means that while I won’t be using WLPG 2011 to do any tagging work, It can safely be used as an easy-to-use photo browser by family members. And it can also be used by family members to edit photos, since the original files get preserved. It’s a major step forwards from the geotag disaster that hit me back in August. My thanks to the WLPG team for their work in addressing the issue.

    Addendum, 12 July 2011: Last week, a new version of WLPG 2011 was released; build number 15.4.3538.0513. However, even though Microsoft acknowledged the MakerNotes corruption bug back in December 2010, this new build of WLPG still has the bug. Sigh.

  • Open Mouth, Change Feet

    There seems to be something in the water at the campus at Redmond. That must be the reason why I cannot fathom some of the decisions being made in Microsoft at the moment.

    The latest is today’s announcement from the Windows Home Server team that they will be dropping the Drive Extender technology for the next version of Windows Home Server (codenamed Vail) due to be released in 2011.

    I just don’t understand the rationale behind this. As far as I’m concerned, it’s been a brilliant piece of technology that just worked, and has been the underpinning of why I bought version 1 of WHS in the first place. If a drive failed, I could just slot in a new one, and the system would automatically recover. The drives didn’t all have to be the same size (as in a RAID setup).

    And now, Microsoft announce that they are dropping this for Vail, and claim that customers don’t want or need it. Hello, I’m a customer, and I want it… It was, and is, one of the major selling points of WHS.

    Is the world going mad? Or is it just Microsoft?

    Update 24 November 2010

    Well there’s been quite an outcry from WHS users since yesterday’s announcement. So much so that the unfortunate Michael Leworthy felt it necessary to issue a second statement . Reading the two together merely underlines the title of my post, and serves to point out the disingenuousness of Mr. Leworthy.

    Yesterday, for example, his reason for announcing the dropping of the Driver Extender technology was:

    When weighing up the future direction of storage in the consumer and SMB market, the team felt the Drive Extender technology was not meeting our customer needs.

    Yet today, clearly somewhat shocked, and yet knowing that the reaction was only to be expected he says:

    Hi, it is a rough day for Vail, and I have been dreading today for a while as an avid Vail user myself. We know this is popular feature in regards to our home server product, and as such all expected that it would have created this type of outreach from our community.

    Meanwhile, Paul Thurrot, over at his blog, probably reveals the real reason behind the dropping of the technology:

    In a briefing last month, I was told that Microsoft and its partners discovered problems with Drive Extender once they began typical server loads (i.e. server applications) on the system. This came about because Drive Extender was being moved from a simple system, WHS, to a more complex, server-like OS )(SBS “Aurora”) that would in fact be used to run true server applications. And these applications were causing problems.

    In addition, the Windows Home Server group now finds itself lumped in organisationally with the big boys: the Business Server group. So the business scenarios where the Driver Extender technology is showing shortcomings is overriding the simple fact that for home use by ordinary consumers, the technology works well and unobtrusively. Just which customers was Mr. Leworthy talking about when he claimed the “technology was not meeting our customer needs”?

    I suppose that the writing has been on the wall for Windows Home Server since last week, when HP suddenly announced that it would be selling Drobo servers – a clear rival to HP’s own MediaSmart servers based on WHS. What’s the betting that HP will shortly announce the dropping of the MediaSmart Server line entirely?

    (Update 1 December: well, that was an easy bet – HP has announced the dropping of the line, and the Windows Home Server team do their best “Crisis? What crisis?” impression)

    I think it’s worth quoting a chunk from the post over at We Got Served:

    Back in August 2008, Charlie Kindel, then General Manager for Windows Home Server at Microsoft outlined the guiding principles of Drive Extender, the spirit of which runs right across the platform “as a server designed for ordinary people”:

    Windows Home Server storage system design requirements

    • Must be extremely simple to use.Must not add any new concepts or terminology average consumers would not understand. Simple operations should be simple and there should not be any complex operations.
    • Must be infinitely & transparently extendible.Users should be able to just plug in more hard drives and the amount of storage available should just grow accordingly. There should be no arbitrary limits to the kinds of hard drives used. Users should be able to plug in any number of drives.  Different brands, sizes, and technologies should be able to be mixed without the user having to worry about details.
    • All storage must be accessible using a single namespace. In other words, no drive letters.  Drive letters are a 1970′s anachronism and must be squashed out of existence!
    • The storage namespace must be prescriptive.In other words, our research told us that consumers want guidance on where to store stuff. Our storage system needs to be able to tell users where photos go. Where music goes. Etc…
    • Must be redundant & reliable. There are two components in every modern computer that are guaranteedto fail: fans and hard drives. Because they have moving parts,  Windows Home Server must be resilient to the failure of one or more hard drives.
    • Must be compatible.Compatible with existing software, devices, disk drives, etc…
    • Must have great performance.
    • Must be secure.
    • Must enable future innovation. Both the amount of storage consumers are using, and capacity/$ are growing at Moore’s Law like rates (while nothing else really is). This creates a discontinuity in the industry and an opportunity for innovation. The storage system must operate at a higher level of abstraction to enable rich software innovation (file level vs. block level).

    These guiding principles remain as valid today as when they were coined. Unfortunately, with yesterday’s announcement, Microsoft has simply torn them up.

    Update 25 November 2010

    The outcry continues. However, every now and then, someone comments that Microsoft are doing the right thing, because all we need is RAID in place of the Drive Extender technology. Clearly, not only are such people techies who simply don’t appreciate that Windows Home Server is intended for the home, to be used by non-techie consumers, but they haven’t appreciated the very real advantages that DE technology has over RAID.

    To illustrate these, it’s worth quoting in full the comment by LarryA from the MediaSmartServer.Net blog:

    After reading all the comments on this subject, I’m beginning to wonder if some of the people suggesting that RAID is a good replacement for WHS or how WHS isn’t reliable have ever used WHS. I have used WHS from the very first day it was available from Amazon and have never had a corrupted file. Also there are some features of WHS that RAID doesn’t provide. A few examples:

    WHS backs up only one copy of identical files from multiple PCs. This saves a ton of space and backup time.

    WHS backs up only those sectors that have changed. Again a savings of a ton of space and time. After the first backup of a PC, the daily backup for my 5 PCs is less than 10 minutes each.

    Because of the first two automatic features I mentioned, I have about 20 terabytes of backups stored in only 2.6 terabytes of disk space. I have about 17 backups of each of my 5 PCs.

    I can choose to duplicate a folder for extra security by a single click. I can undo duplication with a single click.

    My WHS started with a single 500-GB drive and now contains drives ranging in size from 500-GB to 1.5-TB for a total of 4.78-TB of space available.

    I can start a backup prior to installation of new software with two clicks and have to wait for less than 10 minutes for it to complete. On at least 2 occasions I’ve had to restore a PC because of a bad installation.

    I don’t have to do anything to manage any of these features. Installation could not be simpler and my HP WHS takes up a tiny little bit of space under my desk.

    I don’t know of any existing system, RAID or otherwise, that has all these features. If anyone knows of one I would like to hear about it.

    And oh yea, I will never store my data or backups in the cloud!!! I’ve been a programmer in the financial industry for more than 35 years. So I have lots of experience with the internet, clouds and networks, all of which have been hacked.

    Without DE WHS is a dead product. Microsoft take your cloud and RAID solutions and stuff’um!! Screwed by Microsoft again!!

    Amen.

    Oh, and one other thing. I see lots of comments in the blogs from people thinking that the Drobo FS product is a replacement for WHS. As far as I can see, it is no such thing. It’s primarily intended as a data store, not as the complete systems store concept of WHS. Yes, it does give you the storage pool concept of WHS, but that’s the end of it. It will not:

    • back up only one copy of identical files from multiple PCs. Instead, you will end up with multiple copies of the same file, one for each PC.
    • back up only those sectors that have changed in a file. Instead, even if only one bit has changed in the file, the whole file must be backed up. No intelligent storage here.
    • be able to roll back to a complete backup snapshot taken earlier in time, without the need to take up additional storage space to actually hold all those multiple backups.
    • be able to restore a PC with a working image with one click, if the PC has a failure.
    • act as a DLNA media server out of the box. You have to add a third party application for this.

    Update 27 November 2010

    I can’t resist just pointing out that over at the Microsoft Connect (tagline “your feedback improving Microsoft products”) forum devoted to Windows Home Server, the responses from those of us asking Microsoft to put the DE technology back into the next version of WHS versus those who are saying that Microsoft should not is running at approximately 80-1 90-1 93-1 95-1 97-1 in favour of restoring DE to WHS. At the moment, it’s 3273 3602 3908 4088 4281 votes in favour of the restoration versus 44 against (as of 2 December).

    Nonetheless, I wouldn’t mind betting that Microsoft will simply go ahead and ignore this.

    I was watching the presentation that the unfortunate Mr. Leworthy gave at the recent TechEd conference held in Berlin earlier this month (i.e. just before the news broke about the removal of DE). Two things struck me:

    • He didn’t mention the automatic duplication of selected data across drives at all – whereas in previous TechEd presentations, this point (which depends on DE) would have been highlighted.
    • He made the point that the most requested feature for the next version of WHS was the inclusion of Media Center functionality. However, he said, it wasn’t going to happen, despite the requests.

    So I take from that that despite the outcry over the dropping of DE from the next version of WHS, Microsoft will almost certainly blithely ignore it and carry on as if nothing has happened. Which rather gives the “your feedback improving Microsoft products” a cynical air worthy of typical marketing-speak. What a surprise.

  • Price and Value

    I read in today’s Guardian that there was an auction today of Alan Turing’s papers. While I was pleased to see that Google had donated $100,000 to the bid of Bletchley Park to keep the papers for the nation, I couldn’t help but feel disheartened by the thought that Turing’s papers could potentially disappear into a private collection, to be gazed upon by a single, wealthy individual, quite possibly hailing from Silicon Valley.

    Turing was an important individual in the history of not only computing, but in the fact that Nazi Germany was eventually defeated by the Allies. And Britain repaid that debt by persecuting him because he was gay, with the result that Turing committed suicide by eating an apple laced with cyanide.

    I can’t help feeling that Turing’s papers should have been acquired for the nation and humanity at large. Once again, we seem to understand only the price of everything and the value of nothing.

    Perhaps all is not lost; if the new owner will arrange for the papers to be made available online, then something may come out of this. Perhaps the Complete Works of Charles Darwin Online can serve as a model here.

  • Windows Live Photo Gallery 2011 – A Status Report

    In view of the issues I’ve been having with WLPG 2011, I thought that it would be worthwhile to report that Microsoft are listening to those of us who are reporting tales of woe caused by using WLPG 2011. I’ve had a number of emails from the lead Project Manager of the WLPG team on the subject.

    It seems to me that there are three major issues being reported at the moment:

    1. Unwanted, and often inaccurate, GPS coordinates being inserted by WLPG 2011 into the Exif of images that have IPTC location metadata present, but no GPS coordinates currently set.
    2. Corruption of Makernotes in the Exif section of JPEG image files by WLPG.
    3. Unwanted compression of the file, even if only metadata is being changed by WLPG 2011.

    Microsoft have acknowledged issue (1), and are working on a fix. I’ve been told that they hope to roll out an update soon for WLPG 2011 that may resolve the issue going forward.

    Microsoft also acknowledge issue (2), but currently treat this as a lower priority. I think that’s understandable, because unlike the case for RAW files, Makernotes are not vital for JPEG files.

    Issue (3) is interesting, because not everybody, it seems, is being affected by this. Some people are reporting that no compression occurs, whereas others of us are plainly seeing it. Indeed, I had an email from Microsoft stating that this reported compression was of utmost concern to them, but expressing confusion that they also weren’t seeing compression in their tests.

    After thinking about this, it seems to me that one possible hypothesis to account for the difference is that those of us who are seeing file compression are using third-party codecs.

    Most professional photographers (and many keen amateurs) are probably taking their digital photos in a RAW format. Windows and WLPG will not display such images out of the box; they require a codec to be installed to do this. Codecs are available from either the camera manufacturers or other third parties.

    Now, it just so happens that I have a number of photos held in RAW or DNG formats in my collection, so I need to have a codec installed to view these in Windows and WLPG. I’m using the FastPictureViewer codec to do this, because it handles a wide range of image formats, which Windows and WLPG cannot do by themselves.

    I noticed a thread in the PC Talk forum on the Digital Photography Review site where the original poster reported that he was also seeing this compression of files with WLPG 2011. Interestingly, there’s a number of contributions to the thread by Axel Rietschin, the developer of the FastPictureViewer codec. He claims that the Windows Imaging Components (WIC) library and Microsoft’s own JPEG codec use private and undocumented interfaces that are not available to any third party codec:

    The underlying problem is that lossless transcoding, where a file is reconstructed to make room for new metadata, is not possible with the normal Windows Imaging Components codec interfaces: there is nothing that would allow anyone to retrieve the packed data, only pixels. Microsoft implemented this feature in their own JPEG codec using an undocumented interface called IMILCJpegDecoderFrame that WIC uses internally, but no 3rd-party JPEG codec (or 3rd-party codec for any other lossy formats) is able to provide this functionality.

    And in a later message on the same thread:

    Just to clarify: Microsoft worked around the limitation of the(ir own) API by implementing a private interface in their JPEG codec that presumably let them read/write the pixel data without decompressing it, and as a result both Windows and WLPG are able to perform lossless metadata updates and rotations on JPEG files when using the stock codec.

    The problem starts only when replacing the default codec with a 3rd-party one which cannot possibly implement the internal (and undocumented) interface they use privately.

    I think that this is what must be happening. Because I need to have a third party codec installed to handle my RAW and DNG images, this is also being used by WIC for JPEG images, and hence I’m seeing the file compression. Those people who only use JPEG formatted images have no cause to install an additional codec, so they are not seeing the compression.

    This compression will only occur when WLPG 2011 touches an image file to write back information into it.

    To date, I’ve been pretty lucky – I use IDimager to do my cataloguing and metadata work, and this does not use WIC. So all the image data is left untouched in the file, even though the metadata may have been edited. This is as it should be. (Note: IDimager is no longer available. Its successor is Photo Supreme, which I am now using)

    Previous versions of WLPG I’ve been using were (mostly) just reading these files to capture the metadata for their internal databases. I say “mostly”, because I’ve seen some earlier files that have had Microsoft-specific metadata written into them, and some of them have been compressed. Those that weren’t would have been written before the time that I got a digital camera capable of using RAW format – so the built-in Microsoft codec with its undocumented private interfaces would have been used. Those that are compressed will be examples done after I had installed the third-party codec to handle RAW formats on my PC. There aren’t many of them, because it was rare that I used WLPG directly to edit metadata.

    However, with the advent of WLPG 2011, and its current habit of writing GPS and IPTC Extension metadata into files (issue 1 above), then I’ve had a deluge of files that have been compressed, because when WLPG writes out the metadata, the file gets compressed.

    In one sense, of the three issues, only issue (1) can be laid squarely at the door of WLPG 2011. Issue (2) is probably down to the implementation of WIC itself, and is independent of any application such as WLPG calling it.

    However, issue (3) is somewhat more messy. It would seem to be caused by the architecture of WIC, and the fact that there are private interfaces being used by Microsoft that are not available to third party codec developers. It also has the result of making WLPG 2011 lie to the user whenever third-party codecs are installed. If the user sets WLPG to have no compression, then WLPG assumes that WIC will follow suit, but it doesn’t, and file compression will still result.

    This leads me to a concern about the possible solution Microsoft are working on for issue (1). Originally, I had suggested that a simple solution would be to offer the user a way of turning off the writing of GPS coordinates into the Exif of a file. But now I realise that that is not sufficient. If WLPG 2011 goes ahead and constructs a geotag because it finds IPTC Location metadata in a file, then it will also use WIC to write out new IPTC Extension “LocationCreated” metadata into the file as part of its geotagging/geocoding function. And if a third-party codec is installed, the file will be compressed.

    So really, the only immediate solution is to be able to turn off geotagging/geocoding entirely, otherwise metadata gets written, and the file gets compressed.

    It’s the same with the face recognition features of WLPG 2011. I can’t use them, otherwise when the metadata gets written, WIC will compress the file. As far as I can see, the bottom line is that whenever WLPG writes out metadata into the file, it uses WIC, and if there’s a third party codec installed, the file will be compressed.

    The only real solution, it seems to me, is for Microsoft to document the currently private interfaces of WIC, so that they can be used by third-party codec developers. In the meantime, it looks as though my only option is to install the Windows XP version of Windows Live Essentials. That way I’ll get a version of WLPG which will only ever read my image files and never be used to write to them.

    Update 24 November 2010

    I’ve just been using my laptop as a test system to see if I can reproduce the conditions under which issue (3) (the file compression) will occur. I think I can convincingly show that it is, as I suspected, the combination of WIC and the third-party codec.

    First, on the laptop, I uninstalled the third-party codec (FastPictureViewer) that I had on there, and also, for the sake of completeness, Picasa 3.8.

    The system was then Windows 7 Home Premium, with WLPG 2011 (build 15.4.3502.922), together with the built-in codecs of windows.

    I then copied a folder of photos taken in May 2007 across from my Windows Home Server into the My Pictures folder of the laptop. These are the photos that are showing in the screenshots of the “24 Hours Later” section of this post. I also chose these photos to test, because one of them I had included in a batch sent to Microsoft to test. When Microsoft checked the size before and after the images had been geotagged, they found little or no difference in size:

    Microsoft test1

    Microsoft test2

    Yet when I had done the same thing on my PC, I got a reduction in size of about 50%.

    So I repeated the test on the laptop (which remember now has no third-party codecs installed).

    I first used Geosetter to examine the metadata and size of the files. The files had IPTC Location metadata and the particular file illustrated above (20070524-1234-56) was 3.10MB in size.

    Then I opened WLPG 2011, and let it discover the new folder of files. I waited a few minutes, and then went back to Geosetter to examine the files, and the above file in particular.

    As expected, all the files now had GPS metadata added to them (this is issue (1) in action), but the interesting thing was that, just as Microsoft had found, the file sizes were very little different than they had been. This seems to suggest that, with the built-in codecs, no compression will occur.

    Now I deleted the test folder, waited for this to be registered in WLPG and then installed the FastPictureViewer codecs. I then got a fresh copy of the folder from my Windows Home Server and repeated the test. This time, once WLPG 2011 had added the GPS coordinates, I found that the files had been shrunk by about 50%.

    So it definitely seems to be a combination of the third party codec and WIC that triggers the file size reduction. One further interesting thing: since all the pictures are JPEGs before and after, then really only the built-in Windows JPEG codec should be used. There is a FastPictureViewer codec that handles JPEG rotation, but I wasn’t doing this, just adding metadata. So why is there a file size reduction?

    Update 2 December 2010

    There’s an update to WLPG 2011 that addresses the geotagging issue. See here for more information.

  • What Lies Beneath

    As you may be aware, I’m not very happy with the current version of Windows Live Photo Gallery at the moment. I believe strongly that it has problems that desperately need to be fixed.

    There are other, less pressing, issues with WLPG 2011 as well. These include the fact that slideshow quality is degraded in comparison to earlier versions. Another is the fact that people are finding that their workflow performance has taken a nose-dive since upgrading to WLPG 2011.

    However, apart from all that, there are other things that niggle. These days most people are unaware of how much of their identity is available online. That almost certainly includes me, even though I think I’m being careful. Thus, here’s another example from WLPG 2011. It has automatic face recognition in it. People are probably happily tagging (identifying) their friends in photos using WLPG 2011, which in turn is squirreling away metadata containing this information into the photos. If these photos are subsequently uploaded to online sites where they can be viewed by anyone, then this metadata is often equally available to all.

    And what is this metadata? Well, it is at minimum, the names of the people in the photos. But if those people are also known to you as email contacts, or have a Windows Live identity, then this information is also included as metadata in the uploaded photos. True, the metadata will not spell out their email addresses for all to see – they are at least encrypted. However, after reading this comment, (from a Microsoft employee) I do wonder about the Windows Live ID:

    PersonLiveCID is the unique ID generated for everyone with a Windows Live ID, it might be possible to use this and I’ll be playing with some of the Azure Services sometime to see if you can resolve this to a contact. That could create some very interesting possibilities.

    That would be “interesting” in the Chinese sense, I think.

  • More Problems With Windows Live Photo Gallery 2011

    Yes, I know that I’ve said before that Windows Live Photo Gallery 2011 is a disaster, but more problems caused by using it just keep crawling out of the woodwork.

    The first problem I stumbled across was that if you are a photographer who uses IPTC metadata to record information about where your photos were taken, then WLPG 2011 will write false GPS data into your photos without telling you that it is doing so.

    I, and others, have reported this issue to Microsoft, and I understand that they are looking into ways of correcting it. Meanwhile, I’ve become aware of another issue with WLPG 2011. It also screws up the Exif section of the metadata in images.

    While trying to scrub my images clean of the false GPS data inserted by WLPG 2011, I noticed ExifTool was reporting that many of my images had problems with their Exif metadata. Often it was a simple warning that the Makernotes in the Exif section have been damaged. This is a warning from ExifTool that another utility has written to the Exif section and damaged the structure in some way.

    In many cases, however, ExifTool is reporting that more serious damage has occurred and some of the data written into the original Exif section by the camera that took the image has been corrupted.

    Here’s a screenshot that shows an example of an image exhibiting both types of issue (warnings and corruption). The screenshot is of Geosetter, and the highlighted image shows errors being reported by ExifTool (Geosetter uses ExifTool under the covers to do all the heavy lifting). Click on the image to open it full sized in a new window.

    Exif errors 1

    You’ll notice that the thumbnail, and some of the others, have a dark blue marker pin in the top left corner. That indicates that the image contains GPS information. But the interesting thing is that, for that particular image, I did not supply GPS data; WLPG 2011 has inserted it by itself.

    Now here’s a screenshot of one of the other thumbnails that Geosetter is indicating have GPS information. For these thumbnails, I explicitly inserted GPS information myself, in other words, WLPG 2011 has not had cause to write anything out to the files. Notice that for this thumbnail, ExifTool is not reporting any errors or warnings. That’s the case for all the images where I have explicitly added GPS information.

    Exif errors 2

    By the way, even though these two shots were taken at the same place, the GPS inserted (without my knowledge) by WLPG 2011 is wrong, and is located 500 metres distant.

    I’m now going back through my images, and as far as I can see, all those which are being reported by ExifTool as having problems with their Exif metadata are ones that have had GPS information inserted by WLPG 2011.

    The really irritating thing about this discovery is that WLPG has a track record of not dealing correctly with Exif metadata. Previous versions of WLPG have been reported as corrupting the Makernotes (data written by the camera manufacturer) in Exif.

    It would appear that nothing has been done with WLPG 2011 to address this issue. So not only does it insert gratuitous, and false, GPS data into your images, it will also screw up their Exif metadata.

    I repeat, this is a disaster.

    24 Hours Later

    So, I’ve been looking into this a bit more, but the more I look, the more I think: OMFG. The damage that has been done appears to be quite extensive, and will take some time to repair.

    Today, for example, I decided to examine just one folder of photos and compare the contents with the contents of the same folder as it was in a backup taken on the 1st June 2010 – a date chosen because it was before any of the betas of WLPG 2011 had been released to the public. On that date, I would have had the previous version of WLPG installed and running. The first beta of WLPG 2011 wasn’t available to the public until the 24th June.

    I looked for a folder that had photos containing entries in the IPTC Extension “Location Created” metadata fields. These fields are used by WLPG 2011 to store textual information for a location (e.g. the street address, city, state and country) in the image files. I don’t use these fields; I use the older IPTC Core “Location” fields for this purpose. So if I find an image file that contains IPTC Extension “Location Created” metadata, then I know it has been touched by WLPG 2011.

    I chose a folder containing 24 photos that had been taken back in 2007, and which had IPTC Extension metadata present. I then got the same folder from the 1st June backup to compare the two side by side.

    Here’s a screenshot of the folder, as it was on the 1st June, being displayed in Geosetter, with the metadata of the selected photo being shown (click on the screenshot to see it full-size in a new window):

    Exif errors 7

    Now here’s a screenshot of the same folder as it currently exists in my computer. The same image file has been selected to show its image metadata:

    Exif errors 6

    I’ve expanded some of the more interesting metadata sections. As you can see, the metadata has changed substantially. Let me list the ways:

    1. ExifTool is now listing a warning about a possibly incorrect Maker notes offset, together with three warnings about invalid camera data in the Exif section.
    2. While the original (backup) file had 98 elements of camera maker data in Exif, the current file has now only 11 left.
    3. The current file now has GPS metadata present in the Exif. This has been inserted by WLPG 2011, not by me. You will note from the other thumbnails in the second screenshot, that all the other files are also showing that they now have GPS data in them. None of the original files had GPS data. By the way, the GPS data is also incorrect by 300 metres.
    4. The original file had its Exif byte order in little-endian fashion; in the current file it is big-endian. According to the guidelines of the Metadata Working Group (of which Microsoft is a founding member), the “endianness” should be preserved, not reversed.
    5. The original file had a filesize of 3.1 MB; the current file has shrunk to a mere 1,553 KB.
    6. The current file now contains a JFIF block, which is not present in the original file. It also has changed YCbCr values, possibly as a result of this.
    7. The current file now contains an IPTC Extension metadata section, which lists textual information for the “Location Created”. This section is not present in the original file.
    8. The original file is showing that it was last modified on the 27th November 2009. The current file is showing that it was last modified on the 30th September 2010, which also happens to be the date of the final release of WLPG 2011. This is not a coincidence.

    There may be other, more subtle, differences between the original and current versions of the files, but I’m already disheartened enough by the above list, particularly by the Exif corruption and by the fact that my JPEGs have been compressed in size without my knowledge or permission.

    I suppose I can cut my losses by doing a full restore of the photo folders from the backup taken on the 1st June, but this will still not take account of new files that have been created since that time, or of older files that I have been working on.

    What a mess. Thanks, WLPG 2011.

    48 Hours Later

    Oh gawd, it just keeps getting worse… I had hoped that WLPG 2011 was only corrupting Exif metadata when it actually changed the metadata, for example when it added (false) GPS coordinates to the Exif section.

    After further examination of files today, I have discovered that WLPG 2011 will merrily corrupt Exif metadata even when it doesn’t need to change any of the Exif content.

    You see, one of the new features of WLPG 2011 is automatic face recognition. When it discovers what it thinks is a face in a photograph, it will ask the user to confirm the person’s name. Once it gets confirmation, it will then write XMP metadata into the image file. This XMP metadata is structured according to Microsoft’s People Tag. However, when WLPG 2011 writes this XMP metadata out to the file it will also (a) corrupt the Exif metadata section and (b ) compress the JPEG image.

    I’m afraid that I’ve been confirming face tags suggested by WLPG 2011. And now, every single one of those images that contain face tags has also had its Exif corrupted.

    What a f*cking mess. Thanks, WLPG 2011.

    Update 23 November 2010

    I thought that it would be worthwhile to report that Microsoft are listening to those of us who are reporting tales of woe caused by using WLPG 2011. Please see here for a status report on where I think we are…

    Update 2 December 2010

    There’s an update to WLPG 2011 that addresses the geotagging issue. See here for more information.

  • Decision Time

    If you’ve been following my blog, you will know that I originally started it on Windows Live Spaces over five years ago. Then in June this year, Microsoft suddenly switched off some features in Windows Live Spaces without warning, and I decided to jump ship to another blogging platform.

    As far as I was concerned, there were two primary contenders for my future blogging platform: Blogger and WordPress. In the end, I decided to go with Blogger, primarily because there I could use a couple of widgets that I rather liked (the widgets use Javascript, which isn’t permitted on WordPress.com).

    Then a couple of months after I had made the decision, Microsoft eventually decided to come clean and announced that they would be pulling the plug on Windows Live Spaces. Fortunately, they also announced a migration path that would enable users to preserve their existing blog content by moving it over to the replacement blogging platform. Unfortunately, this replacement platform was WordPress, rather than Blogger.

    So I found myself in the situation where all my historical blog content was now sitting on the WordPress platform, while I was blogging new content on the Blogger platform. I also found myself duplicating many of the new entries on WordPress, In addition, in the past few months I have been able to compare the statistics features of both platforms directly, and, currently at least, WordPress is far superior to Blogger in this respect.

    This straddling of two platforms does not strike me as particularly elegant. So I have two options:

    1. Stop using Blogger, and continue to build my blog on WordPress
    2. Stop using WordPress, and manually migrate all my old posts over to Blogger.

    Option (1) means that I lose my dynamic LibraryThing widget that displays a rolling selection of books from my library (see image 1) and instead have a static, textual selection that only gets refreshed when the whole web page is refreshed (image 2). On the plus side, I get access to a better statistics feature that keeps me informed as to how my blog is being read.                               

    LibraryThing

    Image 1
    LibraryThing

    Image 2

    Option (2) means that I get to keep my LibraryThing eye-candy. But on the downside, the blog statistics are not very useful, and there will also be a large amount of work to migrate five years of past entries over to Blogger before I switch off the WordPress blog.

    After weighing up the pros and cons, I think, on balance, that the best way forward is to stop using Blogger, and concentrate on just using WordPress from this point on.

    So, what was called my “Old” Blog on WordPress now gets renamed to be just “Geoff Coupe’s Blog”; and what was my “New” blog on Blogger now gets frozen and will no longer be added to.

    You are now on the current blog where both the historical and current content is to be found…

  • NUI vs. GUI

    Here’s Bill Buxton, Principal Researcher at Microsoft Research giving a terrific presentation on Natural User Interfaces, and the fact that many of the “new” technologies have been around for many years. Well worth watching.

    He’s the same age as I am, and like him, I remember many of those technologies that appeared back in the 1970s and 1980s, but which have all but been forgotten by the younger generation of engineers and designers. Those who forget history are condemned to repeat it…

  • Photoshop Elements 9

    I see that Adobe has recently released Photoshop Elements 9. I last used Photoshop Elements when it was at version 4, and stopped using it because the Organizer part of the package had too many limitations for me. I did like the features of the Photoshop Editor, but I hated the Organizer with a passion.

    Still, time passes and now we’ve arrived at version 9, so I thought I’d just take it out for a test drive and downloaded the trial version.

    Since the Organizer was the weak point the last time around as far as I was concerned, I fired that up first to take a look at it. I imported a subset of photos taken this year and started kicking the tyres.

    The first thing I noticed was that the Organizer had successfully imported the IPTC Keyword metadata from the files and used this to create Keyword Tags. However, it did not, unlike Windows Live Photo Gallery, recognise that these were hierarchical tags and create the Keyword Tag hierarchy automatically. Take a look at this screenshot (click on the image to open a larger version in a new window):

    PE9 1

    You can see the imported Tags under the “Imported Keyword Tags” category, but notice how the Organizer has simply imported them all as a flat list – it has not grouped them into a hierarchy. Also notice how a Tag with multiple levels is too long to be displayed properly.

    Now, it is possible for the Organizer to have a Keyword Tag hierarchy, you can see the start of one in the screenshot above, with the first levels being “People”, “Places”, “Events”, “Other” and the “Imported Keyword Tags”. So, having imported all my tags as a flat list, I would have to manually, and laboriously, re-create my tag hierarchy in Organizer to match the hierarchy described in my files’ metadata. This would not be a quick job…

    The next question would be, having got a tag hierarchy created in Organizer, what happens when I write out Tags into files as metadata? Does it store them in a hierarchical manner?

    To test that, I created a simple hierarchy under People (People/Family/Test level 1/Test level 2/Family member 1) and assigned that tag to a test image in the Organizer:

    PE9 4

    Here is a screenshot of what the Organizer tells me about the IPTC metadata of this image before I applied the tag:

    PE9 3

    You can see that there are two hierarchical Keywords already present in the file’s metadata. Here’s what the file’s metadata becomes after I tell Organizer to write out the Tags to the file:

    PE9 5

    Not good. Although the Tag “Family member 1” is in a hierarchy in the Organizer, it’s just been written out as a flat, single level, tag to the IPTC metadata.

    From this I conclude that the Organizer does not support hierarchical tags in file metadata. That was the case back with version 4. It’s disappointing that it’s still this way.

    One other thing I looked at with the Organizer is how well it plays in a multi-tool workflow. Like many digital photographers, I have a number of different applications that I use for different purposes. It’s extremely important that these will all play together, and do it as transparently as possible, with little or no effort on my part.

    So, for example, what happens if the metadata of a file gets changed by another tool outside of Photoshop Elements 9?

    I tested this by first importing some image files into the Organizer. I then added a tag to a selection of the files using another tool (IDimager). Both Picasa and Windows Live Photo Gallery will pick this change up and update their Tag list to reflect the new one and the files that contain it. Not the Organizer, though. It just sat there and insisted that the tags associated with the files in question were as originally imported, and nothing had changed.

    I thought I’d try and reimport the files to see if Organizer would then realise that a new tag had been added. Not a bit of it – it simply insisted that it already knew about these files and did not realise that the metadata had changed:

    PE9 2

    As far as I’m concerned, this is a showstopper. The Organizer in Photoshop Elements 9 just doesn’t play at all well in a multi-tool digital workflow. It was the same back in the days of version 4. Plus ça change

    And just in case you think I’m being unnecessarily hard on the Organizer here, which is intended for ordinary mortals rather than professional photographers, just consider this… If you have a family and you have a number of computers in your household, then you had better make sure that just one computer is devoted to cataloguing your photo collection. These limitations of the Organizer mean that you can’t have Photoshop Elements installed on multiple computers, and expect the metadata and Keyword Tag hierarchies automatically synchronised between the family PCs. That is one of the plus points about Picasa and Windows Live Photo Gallery. I do all the heavy lifting of cataloguing and Keyword maintenance on my main computer using IDimager, and all the other computers in the household running Picasa or WLPG pick up the changes automatically. That will not be the case with Photoshop Elements. It may export the Tags as metadata, but it doesn’t export the tag hierarchy.

    Oh, one other disappointing thing about the Organizer: geotagging. It uses Yahoo Maps in the geotag interface. The satellite coverage of Yahoo maps in comparison to Google or Bing Maps is but a pale shadow. For the majority of my photographs, I get a plaintive “imagery not available” message if I try to place a geotag accurately.

    After all this, I haven’t had a chance to look at the editor in Photoshop Elements 9. I’m sure it will be powerful, but frankly, my dears, I don’t give a damn… On the odd occasion when I need more capability than my usual tools give, I can always fire up the editor from Photoshop Elements 4. I see no reason to upgrade to version 9.

  • One Step Forward, Two Steps Back…

    This is a bit of a rant. This is a bit of a rant about Microsoft software. This is a bit of a rant about Windows Live Essentials 2011.

    Windows Live Essentials (WLE) is a suite of utilities from Microsoft that began life back in 2006. WLE 2011 is the fourth major iteration of the suite, and was released in its final version on 30th September 2010. It now contains a number of utilities:

    Of these eight utilities, I really only made extensive use of four of them (Mail, Messenger, Photo Gallery and Writer). With the release of WLE 2011, and the acquisition of a camera that can shoot HD video in addition to photos, I had expected to start making use of Movie Maker.

    Instead, I’ve found that the 2011 versions of both Movie Maker and Photo Gallery have surprising limitations that represent a step backwards from earlier versions. Worse still, Windows Live Photo Gallery 2011 has a showstopper of an issue that means that I cannot use it until it is resolved in a satisfactory manner by Microsoft.

    Windows Live Movie Maker

    Windows Live Movie Maker (WLMM) is a complete re-write of an earlier effort by Microsoft: Windows Movie Maker (WMM). Unfortunately, in the rewrite, Microsoft’s desire to make easy-to-use software has resulted in the dumbing-down of the software to the point where functionality has been removed.

    Windows Movie Maker had both a “storyboard” view and a “timeline” view for editing and assembling videos. Windows Live Movie Maker 2011, on the other hand, has dropped the timeline view and only offers a storyboard view for editing. That’s a great pity, because having the timeline view makes some operations very easy to do, and they can only be done with difficulty, if at all, in the storyboard view. For example, in WMM’s timeline view, you could edit the audio of a video clip. You simply can’t do this in WLMM’s storyboard.

    Limitation number two is that, as far as Microsoft is concerned, we all live in either North America or a few other places. That’s because when you produce your finished video, WLMM will produce it in the NSTC standard. Much of the world (over 120 countries and territories) uses the PAL standard, but Microsoft does not support this in WLMM by default. You can cook up your own custom settings, but this is not always straightforward. Take a look at this discussion on the WLMM Help Forum to get an idea of some of the issues involved.

    One would think that since Microsoft is apparently trying to make easy-to-use software that they would offer a simple “NTSC or PAL” switch in WLMM, just as practically every other video editing software does, but no; for some reason they have concluded not to do it, leaving us to hunt for information as to how to set it up for ourselves. Two steps back…

    Windows Live Photo Gallery

    Windows Live Photo Gallery (WLPG) has had more functionality added to it in each of the major releases. WLPG 2011, for example, now has automatic face recognition, geotagging, and a “photo fuse” feature added to it over the features that were in WLPG 2010.

    However, there is at least one limitation that I’ve found in comparison with WLPG 2010, so it’s not just a simple move forward. WLPG 2010 had a slideshow function – select your photos, click on the Slideshow button, and you got an instant slideshow of your selected photos. WLPG 2011 seems to offer the same functionality, but when you click on its Slideshow button, what is actually happening is that it passes the job over to Windows Live Movie Maker 2011 to do the work of producing and running the slideshow. And here’s the limitation: the quality of the slideshow produced by WLMM 2011 is noticeably poorer than that which was produced by WLPG 2010.

    When I raised this issue in the WLPG Help Forum, the first response back from Microsoft was to deny that anything had changed between WLPG 2010 and WLPG 2011. They then conceded that things had in fact been changed and that “photo quality in slide shows in Windows Live Photo Gallery Beta is indeed a bit degraded when compared to the original file source”. The reason given was that “since videos have been incorporated to the feature, high definition photos in the slide show are forced to level with the resolution capacity of a video format”.

    While Microsoft may think that slideshow quality has been “a bit degraded”, I see it as noticeably degraded – to the point where I consider it unacceptable in quality, and a step backwards from what was available in WLPG 2010.

    And then we come to the showstopper in WLPG 2011: geotagging.

    Unlike every other application I’ve seen (IDimager, Picasa, PhotoShop Elements, Lightroom, Microsoft Pro Photo Tools, Geosetter) that offers geotagging either directly or via a plug-in, WLPG 2011 does not offer a map-based interface to position geotags. Instead, it uses a text-driven database to assign geotags. The problem with this, as I’ve pointed out here and here, is that this is very prone to errors of interpretation.  If Microsoft had left it at simply a textual description of a geotag, I could have lived with it. But no, they go a step further: they also write out GPS coordinates into the Exif metadata of the image. In effect, WLPG 2011 is guessing the GPS coordinates based on text contained in the contents of the IPTC metadata fields that deal with information about location. Microsoft are really doing geocoding, rather than geotagging. The problem is that very often, these guesses turn out to be wildly wrong. Even that I could live with, if WLPG 2011 had given me an option to stop it writing out these GPS coordinates into my images; but it doesn’t, and that is an unforgivable showstopper in my book. WLPG 2011 has entered false GPS data into thousands of my images.

    It’s really odd, the automatic face recognition feature of WLPG 2011 asks the user to confirm its guesses as to who the person in a photo is each and every time. Yet the geotagging feature is making guesses about GPS coordinates and writing these out to image metadata without even notifying the user that it is doing this.

    I, and others, have raised the issue in the WLPG Help Forum here and here. The worrying thing is that so far, while the issue has been acknowledged by Microsoft, the manner of their replies are, to my eyes at least, rather along the lines of “it’s not a bug, but a feature…” Sorry, Microsoft, it’s not a feature, it’s a disaster. One that could have easily been avoided if they had given us the option to turn off the writing of GPS coordinates into image metadata. And if they had given us a map-based interface, like any decent geotagging application, then users could have checked WLPG’s guesses, confirmed those that were correct, and rejected the false ones.

    WLPG 2011, despite the fact that it uses the term “geotag” in the application, is actually doing geocoding, rather than geotagging if you follow the strict definition of the terms. There’s probably a reason that everyone else does geotagging in their applications, and that is probably because it isn’t so prone to horrible errors as Microsoft’s geocoding approach has turned out to be.

    This issue makes WLPG 2011 not so much two steps back in comparison to WLPG 2010, but more of a step off the cliff…

    Update 2 December 2010

    There’s an update to WLPG 2011 that addresses the geotagging issue. See here for more information.

  • Undecided

    You may have noticed that some of my blog entries are appearing on both what I nominally call my “old” blog over at WordPress.com and on my “new” blog over at Blogger… That’s because I’m torn on where to settle and continue blogging forthwith. Both have their pros and cons.

    Ah, decisions, decisions…

  • Windows Live Essentials 2011

    So the final version of Windows Live Essentials was released today. I see from this blog post by Chris Jones that apparently 95% of the bugs that were present in the beta version have been addressed by this final release.

    I suppose it was inevitable that I would find myself continuing to be bitten by one of the remaining 5% of bugs.

    Windows Live Photo Gallery still continues to write false GPS coordinates into my images.

    This is unacceptable behaviour as far as I’m concerned. I can’t afford to have it running on my computers and introducing garbage into my image metadata.