My role in adding Sentiment Analysis capability to IBM's Smarter Cities offerings

Earlier this year I announced that I was changing jobs again to incubation team leader. In this role I am supposed to lead innovative projects to introduce experimental new features in our products. The nature of these innovations means that there is bound to be some risk of failure, but I am delighted to be able to say that the first project to develop a city sentiment dashboard was an even bigger success than expected. In order to ensure were meeting real customer needs, we developed it in conjunction with a large European City who gave us very specific requirements. The end result was so well received that this week the software was formally upgraded from a customised solution into a fully supported IBM product.

Our solution uses Cognos Consumer Insight (CCI) to analyse sentiment being expressed about the themes that the city is interested in. CCI provides really excellent analysis capabilities, but the user interface can be daunting for non-experts to use.  Hence, the software we developed pulls the key information into a single easy to understand dashboard that is part of the Intelligent Operations Centre (IOC). Our dashboard was released in the form of an update to the IOC. Customers will typically deploy this software as part of a Smarter Cities project. If you are interested you should get in touch with your IBM sales representative or if you don't have an existing relationship with IBM leave a comment here and I will arrange for someone to get in touch.

Since IOC has many features, the information about the new sentiment analysis feature is buried deep on the product page. The screenshot below shows the dashboard we developed. I deliberately blurred the text in the screenshot because I don't think that I am at liberty to reveal what city we were working with or what topics they wanted to track. However, I think you can get a feel for how we managed to squeeze all of the sentiment data onto a single easy to understand screen:

• On the left there is a hierarchical list of the themes that the customer specified that they are interested in tracking sentiment about. For each theme there is a thumbs up or thumbs up icon to give a quick indication of whether we found more positive or negative expressions of sentiment about the theme in question.
• If you click on a theme, we will display details about the sentiment we discovered for this theme. We have pie charts showing the overall distribution of sentiment observed as well as a more detailed breakdown of the sentiment for each type of site (e.g. we might have observed radically different sentiment in newspapers, blogs and twitter).
• On the bottom we have a trend chart showing how the sentiment statistics varied over time and finally on the right hand side we show you a few samples of positive and negative snippets that we found. Clicking on these snippets will bring you directly to the original source of the sentiment so you can read the snippet in context.

It is amazing what can be achieved by a small agile team in 6 months. Hopefully we will be equally successful with our next projects (which have not yet been decided).

Hackday X is coming and I registered my project

Time flies by and it is now just over a week until the IBM company wide Hackday that Ginni Romety announced earlier in the year. This morning I met with some of my colleagues in the IBM Dublin lab and decided on what we would be doing locally to promote participation in the Hackday and ensure it is a fun day for everyone.

Since this is an IBM internal event, I can't reveal too many details of the project on my public blog. However, I will say that it relates to my earlier post about using automation to make it easy to keep active on several social networks and it extends the idea by allowing information to flow through the company firewall.

I think that this project idea fits well with the theme of this Hackday which is transforming IBM into a more social business. Any reader who works in IBM will be able to read more about the project on the Hackday site and hopefully there will be a working prototype ready next week.

Playing podcasts of music through a Bluetooth Headset on Android

I like to listen to many podcasts on my Android phone. When running or on my bike I tend to listen through headphones. However, it feels strange to plug in headphones while driving in my car. I bought a lead which allows me to connect my phone to the sound system in my car via a cable plugged into the headphone socket on my phone.

This arrangement worked reasonably well until recently when the cable connection started to get loose and crackly. Rather than buy a replacement cable I thought it should be easier to use the Bluetooth hands-free unit to connect  my phone to the car's sound system, but I searched in vain to find a system setting on my phone which would allow me to direct the Bluetooth connection.

After a bit of searching on Google, I found the BTmono application which adds this simple feature. This application is very simple, but effective. When the application is running audio which is normally directed to the headphones (e.g. music or podcasts) is instead sent to the connected Bluetooth device. This means that I can now listen to my podcasts in the car via the sound system or even use a Bluetooth   headset to entertain me while running.

I think this is a clear example of why the Android open model is better than the close system run by Apple for their iPhones. I am guessing that this application would probably not have been allowed into the Apple AppStore.

Is it safe to listen with headphones while cycling?

One of the hotly debated issues about cycling is whether or not it is safe to cycle while listening to something through headphones. I can certainly understand the view that it is important to be able to hear what is happening around you as you cycle. I personally like to use the time I spend on my bike to catch up on podcast episodes and/or music. However, I would like to do so safely.

I tried using the Around Sound application which is a cool application fro Android devices which measures the ambient sound and automatically pauses your music/podcast whenever the ambient noise exceeds a threshold. The intended use of this application is when you might be listening to music while working in a quiet office environment, but when your colleague comes up behind and asks you a question you would like your music player to temporarily pause to allow you to hear him/her. However, I found that I could not find a suitable volume threshold setting that worked well while cycling. Instead I use a low-tech solution of only attaching one of the earphones while leaving the other ear free for listening to traffic. In order to protect my ears from any potential long-term damage from earphone use I constantly switch ears.

Research shows that the biggest factor in determining the risk of using a mobile phone while driving is the content of the conversation. Apparently you are at much less risk of crashing while having an idle gossip with the phone held to your ear than if you were conducting a stressful interview through a hands free device. Using a similar logic I choose to make sure I am not overly concerned if I actually hear all of the items I listen to while cycling (e.g. I listen to a general chat about the news of the day rather than trying to take an on-line course which would require me to pay close attention - therefore if the traffic situation requires my close concentration, I am not worried about missing part of what is said on  the podcast.

Triathlon Report

Glynn-O'Donovan Triathlon Team 

As you may have noticed, I have been doing a lot of talking recently about my triathlon preparation. The big day finally arrived on Sunday and I was quite nervous when I got up, especially when I looked out over the lake and saw that there was a strong wind blowing and hence the lake was quite rough. My worries only increased when the rain started to fall shortly afterwards. However, I had committed myself to completing the triathlon in such a public way that I couldn't back out and so I proceeded to the start point.

Luckily the weather began to improve as the day went on and when I saw the under-age competitors (starting with the under 8 event) I began to gain in confidence. When the rest of the family team arrived along with a vocal group of supporters I even began to change my focus from competing the event towards achieving a good time. The wind also died down and the lake was quite calm.

When the swim started I hung back near the back of the group to avoid getting crowded. Unfortunately many of the swimmers at the back were doing breaststroke rather than crawl and hence were taking up more room and it seemed to be equally crowded. At one stage I decided to put my head down and swim hard, when I lifted my head to look around a canoe based marshal was shouting at me "turn right you are off course". Although this detour added to the distance I had to swim, it was probably a good move overall since I was then separated from the crowd and able to swim in peace from then on.

When I got out from the swim I got a big cheer from my extended family and so my spirits were lifted. I struggled getting out of my wet suit, but when I got on my bike I saw that it was only 24 minutes from the start so I was ahead of my schedule. I cycled steadily and I managed to complete the cycle leg in slightly over 40 minutes. I almost got a penalty as I  went through the second transition because I thought I was allowed unclip my helmet  immediately after dismounting - luckily the marshal knew that it was an honest mistake and so he let me off with a warning.

The began to fall towards the end of the cycle, but this didn't really interfere with my progress because it was only light and helped keep me cool. I struggled on the running phase, but just concentrated on keeping moving rather than trying to keep a fast pace. The full results are now available on-line and I have been credited with a time of one hour 35 minutes and 4 seconds which seems a respectable time for a beginner.

Overall I was delighted to have taken part and even began to discuss about possibly coming back again next year. My father told me that he ran his first marathon when he was about the same age as I am now. I think staying active has worked out well for him and I would be very happy if I am as healthy as him in the decades ahead.

Triathlon Plan

It is now just under 4 days to go to the triathlon, so I am taking the advice that I should stop training to ensure I am fully rested on the day. I have never done a triathlon before so it is hard for me to judge what would be a reasonable time goal, but I am going to aim for 1:50 minutes in total. I am allocating my time as follows:

• Swimming 750m in 30 minutes: In the gym I normally complete my 750 meter swim under 25 minutes (in fact often below 20 minutes), but I think that 30 minutes will be a challenging goal for swimming in a lake.
• Cycling 20 km in 50 minutes: Based upon my training times, I think that this should be quite achievable. In fact this is where I will try to get ahead of schedule if possible.
• Running 5km in 30 minutes: I normally aim to complete a 10km fun run slightly below the hour mark. In theory I should be capable of doing a faster pace over 5km, but the fact that this will be the last leg of the triathlon will mean that it will be quite tough to even reach this pace.

I used to think that when people spoke about their Triathlon nutrition plan they were wondering what they should eat before and after the Triathlon, but it seems that it is also important for me to plan what I should eat and drink during the race itself. My current plan is:

• I will have porridge for breakfast the morning of the Triathlon since the slow release of energy from the Oats tends to keep me going. I will also indulge myself with a few espressos to top up my caffeine level.
• I will have a bottle of plan water attached to my bike for consumption during the cycle. I also plan to have two power bars stored in the pocket of my cycling jersey so that I can consume as much of them as I feel able for during the cycle. During training I found that it was almost impossible to open the wrappers while cycling at pace, so I will have the wrappers partly removed before I start.
• I don't think that I will need to eat any more during the running plase, but I will store a bottle of GatorAde in the transition area to bring woith me for the run. I think I might needs a more sugary drink at that stage of the event, I had experimented with the idea of bringing along Lucozade tablets and adding them to my water bottle, but again this is messay when I am getting tired so the bottle of GatorAde is plrobably more feasible.
• After the race I think I will replenish my fluids with Guinness the national drink especially while watching Galway beat Kilkenny for the second time this year in the All Ireland Hurling championship.

P.S. I found out why I was accidentally posting supersonic swimming times to DailyMile. I use the Tracks2Miles application and I had set my default distance units to be Km because this makes sense for running and cycling. When I entered details about a practice swim I would enter 750 in the distance field and then click on the drop down selection box to change my distance units to meters. What I didn't realise was that the application was trying to be helpful by automatically converting the distance I entered into 750000 meters (I didn't notice this  because I wasn't paying full attention, but also because the application automatically advanced focus to the comments field and hence the distance field was no longer visible).

Triathlon Training Update

Some of the equipment I need to bring
when going for a swim in the Gym

I was pleasantly surprised by the amount of positive reaction I got when I announced that I was going to complete a triathlon to celebrate my passing the half century mark. Lots  of people have been giving be advice and encouragement. The triathlon I signed up for is now only a week away so I thought it might be nice to share an update on how my preparations are progressing.

I am amazed at how much equipment is needed to complete a triathlon. I know that not all of the equipment I purchased is absolutely essential, but I want to ensure that I don't fail due to lack of the proper gear. In any case it is part of the fun to get kitted out like a professional athlete. One of my main worries is that I will forget to bring along some of my new gear on the day of the event. I have been told that bringing along a bulging kit bag is a sure sign of a rookie - the experienced athletes will bring along just a few essential items.

• Initially I was most worried about the swimming. I still think this will be my weakest link of the 3 events, but I have now swam the distance several times and I am confident that I will be able to complete the swim even if my time is not too fast.
• Since cycling is my normal mode of commuting I am confident of my abilities on this event. Since I started triathlon preparation, I switched from my normal commuting bike to my racer so that I become comfortable with it. Unless I am running late for work, I typically divert through some of the back roads of county Meath on the way to work each morning so that I can get a real training cycle in. 
• The main area that I still need to work on is my running. I have been neglecting this a little since I thought 5km is not a very long distance, but I suspect that it will seem a lot tougher when I go straight from swimming and cycling into my run.

I didn't realize when I entered the race that it would be on the same day as Galway's first appearance in the All-Ireland Hurling final in 20 years. However, the organizers have kindly arranged a big screen at the event so that all athletes will be able to watch the match as soon as they complete their event. I suppose this will provide additional motivation not to do a slow time and miss seeing the match.

What should be free and what should I expect to pay for

One of the strange things about internet culture is the fact that people expect to pay for leisure materials such as music, movies and games - but they are very reluctant to pay for tools that they use to run their business.

The entertainment industry has been very vigilant in trying to ensure that people continue to expect to pay for their music. In Ireland the recording industry association managed to persuade artists to stop allowing their music be used on the free CDs distributed with Sunday newspapers. Although the newspapers were paying royalties, the association feared that the fact that the consumer was not explicitly paying for the music would create an expectation that music should be free.

In fact they were so successful in pushing the idea that music must be paid for, that many people are reluctant to download music from sites like the Free Music Archive because they fear that there must be  something dodgy about a site that allows free music downloads. Until recently there was a Russian company which undercut iTunes by offering tracks for 39 cents each rather than 99 cents - consumers who would never dream of pirating music were reassured by the fact that they had paid for the tracks, but it seems that the company was not passing on any royalties and simply pocketed all the money.

The market for office productivity tools is significantly different. You might expect that people would be willing to pay for these since they are typically used only in a business context, but the fact that some of the leading suites of productivity tools like Libre Office are available for free download leads consumers to expect that they don't need to pay for such products. I don't normally feel sorry for Microsoft, but it is very unlucky for them that not only do they loose market share to open source competitors, but the fact that these are available free of charge apparently makes people feel less guilty about pirating copies of Microsoft Office.

A sad day for sport

Like many other people all over the world I was shocked to hear that Lance Armstrong is admitting defeat in his battle to prove that he has not breached the rules in relation to the use of drugs in cycling. I am not totally naive and so I would not be shocked to read that someone had definite proof that Lance Armstrong was using drugs. However, one feature of Lance's life to date is that he has been determined to continue battling even when the odds seems to be stacked against him and so it surprising that he is giving up on  this battle.

In his life, Lance has faced a long series of battles:

• He was born to a teenage single-mother. Although he has great praise for the way his mother raised him, it can't have been a very easy life. His mother did have a few boyfriends and subsequently got married, but none of these proved to be a positive father figure for Lance.
• When Lance initially took up cycling it was not a very well known sport in his native Texas and very few people were even aware that the Tour de France was taking place. This also meant that English speakers were not so common on the tour at that time and apparently not particularly welcomed by the representatives of the more established cycling nations.
• Lance was struck with testicular cancer in his mid-20s. Initially the prognosis was not positive and the disease was expected to be fatal. However, he made a recovery and amazed everyone when eventually returned to the sport and performed even better than before.
• As Lance became the most successful competitor ever in the Tour de France it was not surprising that many other competitors regarded him as the one to beat. Lance relished adversity and continued battling when many other people would have retired gracefully and enjoyed the fruits of his success.

Lance has been hounded for many years by allegations of drug use, mainly because people are reluctant to believe that someone could perform so strongly without artificial aids. This is similar to the way the Irish swimmer Michelle Smith de Bruin was treated. The evidence of her drug use was eventually quite strong, but initially the suspicions were only based upon her results. It is becoming ridiculous if athletes can't perform too well for fear of facing accusations.

I think that the time has come to examine the fundamentals of the rules about drug use in sport. In many ways the debate on drug use in sport is similar to the debate on professionalism a few years ago. At that time amateur sportsmen seemed noble, but with the benefit of hindsight it looks like an elitist system that gave an unfair advantage to upper class athletes who could afford to take time off work to train.

I know that the analogy is not perfect, because drug use is dangerous. No athlete will die because he/she gets paid too much, but as we have sadly found out, it is entirely possible for athletes to kill themselves by over indulging in performance enhancing drugs. However, the rules should be adapted to focus on athlete safety rather than on the complete elimination of performance enhancing drugs.

Lance has plenty of experience of dealing with dangerous drugs. As he stated in his excellent autobiography many of the chemotherapy drugs used to fight his testicular cancer were a much more dangerous than EPO (he commented on the fact that the nurses injecting the drugs into his vein wore protective gear to ensure that none of the drugs accidentally spashed onto their skin).

I know it is a radical idea, but we would have a fair playing field if athletes were allowed to use safe doses of certain performance enhancing drugs under carefully controlled conditions.

Is Julian Assange a hero?

In recent times Julian Assange has been making headlines all over the world. Many people (including Julian) would like us to believe that we have a choice between supporting him and all of his actions or supporting the actions of the US secret service and their allies. However, the reality is a little bit more complex than that.

I feel sorry for Julian. But the reason I feel sorry for him is mostly because of his dysfunctional upbringing rather than because he has been unfortunate enough to become a target for reactionary forces within the US military and their allies.

First let me state clearly that I think it is a good thing that the wikileaks site has uncovered many unsavoury actions undertaken by the western powers during their so called war on terror. This is clearly a situation where the response to the alleged threat of terrorism was in many instances much worse than what it was supposed to be preventing.

However, the credit for making this information public must go to Bradley Manning, the brave soldier who made the information public and not to Julian Assange whose only role was to design the process which was supposed to assure Bradley and similar whistle-blowers of anonymity. In fact the process which Julian designed failed  badly in this case and a a result Bradley Manning is currently held in solitary confinement due to the failure to protect his identity and has no prospect of ever addressing the world's media though the window of the Ecuadorian embassy.

Julian is currently facing extradition from UK to Sweden to face charges that have nothing at all to do with his involvement with WikiLeaks. It is true that the laws on sexual assault in Sweden are much more favourable to the victim than in the UK, but this is not necessarily a bad thing. In any case, I am sure that he would get a fair trial in Sweden if he returned there. He claims that he fears that the Swedish government might turn him over to the Americans, but in fact that UK government would be much more likely to do that than the Swedes.

I think that part of Julian's problems are that he has an inflated view of his own importance. The current outpouring of sympathy for his position is only making this situation worse.