An Easy mashup of ETL and DQ

Today I saw how easy it can be to make a mashup from ETL and DataQuality tools. More and more ETL vendors see the need to not only extract, transform and load data, but at the same time also enhance the data by hand with data quality tools. Most of them stick to so-called tick mark data quality – main stream easy to get enhancements. These results are mostly experienced as disappointing or at max average. Building ETL solutions is another ball-game than building data quality solutions. You need to mash these worlds together.
Together with Pentaho we as Human Inference are creating a mashup with their Kettle ETL tool and our HIquality Data Quality solutions. The nice thing is that the data quality solutions can be used both in the cloud as well as on-premise.
It’s almost finished now and as a teaser I just want to show you a hot screenshot of it. Soon available as add-on from our easyDQ website, followed by an inclusion in the coming Pentaho release. If you need it right away, please contact us directly.

Business is changing its agenda….


Yesterday, I attended the Capgemini Cloud Computing Conference in Utrecht and I had the opportunity to listen to Andy Mulholland, their Global CTO. His presentation was by far the most visionary of the program and I would like to share some of the remarks that struck me as interesting. Andy set out to explain how business is changing its agenda. The traditional inside-out approach is changing to an outside-in approach: From opportunity to business intelligence and not the other way around.

He further stated that the ability to make money in the cloud is vastly larger than the ability to save money. I liked this statement, because I’ve heard the “cost saving argument” with regard to cloud computing far too often. Or, as he comments in his book Enterprise Cloud Computing: “The WOW about cloud computing isn’t about on-demand information technology….. It’s about on-demand business innovation”. Of course, Andy did not give all the answers in his presentation , but he’s trying to find way to to resolve the true potential of this new means of delivering IT-resources.

The part I especially liked, was when he said that new business is about creating opportunity by supporting the development of people and expertise. Good stuff! I’m definitely going to read his book…..

Stop using Customer Relationship Management systems – and learn about possibilities to make dealing with customer information easier


Have you ever tried to get contact details in and out of a CRM system, and ended up with a bigger mess? I have. The concept is easy: store all information about prospects and customers in one system, allowing you to have your communication efforts streamlined.

Reality, however, is harder: contact details entered on your website should be fed to the system automatically. Sending your periodic newsletter should be based on the details in your CRM system. Not to mention dealing with information on bounces. Integrating your CRM system(s) with mass mailing, campaign management and self service portals is helpful, but for some reason the major means of transporting lead and customer information still seems to be Excel… Leaving you with the necessity to mass import results, new contacts and changed information. Continue reading ‘Stop using Customer Relationship Management systems – and learn about possibilities to make dealing with customer information easier’

Adieu Marcel …..

french-waiter 3

Everybody who has ever been on holiday in France has probably had a neighbour named Gaston, Jacques, Louis, Claire or Françoise . We are used to those first names, they evocate the “France profonde”, sleepy villages at the end of a road, films of Pagnol or Rohmer. Walks along the Seine in de shadow of “Notre Dame” in the spring. Coffee at a terrace of the Boulevard Saint-Germain where an obsequious garçon, named Marcel, is looking at your girl friend or wife in a way you dot not really appreciate. This particular image of France is in danger. In a few years our total frame of reference could have disappeared.

Nowadays French parents let their imagination go freely when they are choosing first names for their children. Looking at recent entries in the civil registry, you will find rather unusual first names like Bulle, Héribert, Loeva, Hermès, Evolène, and Argan.
These first names have all kind of origins. For example, they can be a combination of first names (Timéo, which is derived from Timothée and Théo),or they are different writing forms of known first names (Lilou becomes Lee-Lou). We can also find names from Greek or Celtic mythology or even from literature, like Arwen, a character from the novel Lord of the Rings. Continue reading ‘Adieu Marcel …..’

Data Cleansing with intelligent identification


In many cases an inductive method of data cleansing is the way to go. With the right tools and expertise you can inspect, transform and cleanse entities in a database and reach high levels of data quality without the need to use external reference data. In some cases, however, only working with the internal data and inductively identifying and fixing data patterns is not sufficient. Let’s take a practical example: a bank needs to report on a particular segment of its clients to German bank supervisor BaFin – the Federal Financial Supervisory Authority aka Bundesanstalt für Finanzdienstleistungsaufsicht. The bank apparently has done its homework and has created a central database containing all entities needed for the compliance check. Moreover, the bank has worked out a rather complex set of rules how data must be processed and corrected. One of the most important anchor points in this specific framework is the separation between B2C and B2B entities and for the latter the exact identification of the correct legal form. But what if you cannot trust this identification? Continue reading ‘Data Cleansing with intelligent identification’

WOA – SOA is not a disease anymore!

top104Number 7 in Gartner’s top 10 Strategic Technologies for 2009 is Web Oriented Architecture. With Data Value in your mind you could argue that this might be a typo and that we would expect here SOA – Service Oriented Architecture.

The term SOA is introduced already many years ago by Roy Schulte and Yefim Natis – also from Gartner. And even at the time of the introduction of SOA one could start a dispute about the differences between SOA and CBD – Component Based Development. And there are similarities between that dispute and the dispute between WOA and SOA. My take on it is that already from the beginning of ICT or software engineering one is trying to conquer complexity and still remain the benefits of flexibility or agility. The more the technology becomes mature, the more we are able to tackle this paradox. Continue reading ‘WOA – SOA is not a disease anymore!’