Haven’t posted here in a while as my spare time has been soaked up programing, well actually refactoring would be more exact. My xLite “SQLite empowered Excel” codebase has grown over the years and required a serious makeover to get rid of stuff I no longer use and to generally make it more robust. I [...]
Archive for the ‘BI’ Category
Spending time on Excel-SQLite, C, VBA Callbacks & Twitter
Posted in BI, ETL, Palo, SQLite, VBA, Web2.0, excel, xLite, tagged c#, Twitter on November 20, 2008 | No Comments »
I’ll give up Excel Pivot Tables when you take ‘em from my cold, dead hands
Posted in BI, Palo, excel, olap, tagged essbase, MDX, Mondrian, ODBO, XMLA on October 10, 2008 | 11 Comments »
Jedox, the company behind the open source MOLAP server Palo, has just announced an MDX/XMLA driver. This means that it’s now possible to access Palo cubes using Excel Pivot Tables or indeed any tool that supports ODBO or XMLA. This is excellent news, as MOLAP to most Excel users IS a Pivot Table, and somewhat like [...]
Twitter - the penny drops!
Posted in BI, Web2.0, data, tagged Ambiance Awareness, harvest web data, OutWit, Quantivo, Twitter, Yammer on September 12, 2008 | 4 Comments »
I’m a fan of most things Web2.0, not just for personal use but as business tools. Over the last four years or so I’ve enthusiastically embraced Wikis, IM (Google Talk), RSS Readers et al. I could see the benefit and attraction of social network sites such as Facebook even if I’ve not partaken as such. [...]
Cloudy skies, cloudy apps…
Posted in BI, ETL, Ireland, Palo, Web2.0, cloud, data, excel, news, olap, tagged Freiburg, Jedox, WaveMaker, Worksheet Server on August 28, 2008 | 4 Comments »
Just back from a break in Clifden, Connemara, summer is nearly over, the kids return to school today, back to work.
Counties Galway and Mayo were like the rest of the country last week, a tad wet, but unlike the developed east of the island, flooding was not a problem; a problematic drainage area is called [...]
Talend + SQLite + Groovy the new Oracle …
Posted in BI, EC2, ETL, Groovy, Palo, SQLite, Talend, data, excel, olap, tagged Oracle, Oracle 10g Express on August 2, 2008 | 5 Comments »
… well, at least for me. Let me explain.
For most of my datasmithing career, I’ve had access to corporate Oracle databases and now with the availability of Oracle10g Express I can even run my own Oracle instances at home or on EC2. The combination of a powerful SQL engine, expressive scripting language (PL/SQL) ,OS independence, [...]
OLAP Cube as a Mind Map
Posted in BI, Palo, excel, olap, tagged FreeMind, mind maps, mindmaps on July 30, 2008 | No Comments »
If you’ve worked with OLAP technologies for any length of time you’ll undoubtedly have been in the situation where you’ve had to explain the concept of an OLAP Cube to a “newbie”. If the person in question has come across Excel pivot-tables, then you can probably short-circuit the conversation some what, explaining that a pivot [...]
Palo OLAP and sparse dimensions.
Posted in BI, ETL, Palo, excel, tagged Add new tag, drill-through, drill-thru, essbase, ETL-Server, Palo 2.5, pivot, sparse dimension on May 26, 2008 | 9 Comments »
Last week I tried out both the latest Palo 2.5 release and its sister product, ETL-Server. Although I’ve not done any proper benchmarks, 2.5 does appear to be faster than the previous release and the Excel add-in also behaves better when co-habiting with other add-ins and macros (the previous release’s use of, and response to, [...]
Palo ETL Server - Not for me …
Posted in BI, ETL, Palo, SQLite, excel, tagged MOLAP, Pivot Table on May 1, 2008 | 2 Comments »
Jedox have just released V1.0 of their Palo-centric ETL Server. I had been looking forward to this, not so much for its ETL ability (which is somewhat limited when compared to the likes of Pentaho PDI or Talend) but for the drill-through capability it would add to Palo. Alas, there’s a catch, you [...]
Python the new VBA ?
Posted in BI, ETL, Palo, Ruby, SQLite, Web2.0, data, excel, news, tagged appengine, AWK, Perl, Picalo, Resolver on April 11, 2008 | 6 Comments »
These last two weeks, Python has been on my mind. First off, last week I decided to make time to fully investigate Picalo, an open-source Python-based data analysis tool, and then, this week, Google announced their long awaited cloud-computing offering, Google Apps Engine, with the language at its core.
Python was the first of [...]
Postgres Plus Cloud Edition is boring …
Posted in AmazonAWS, BI, EC2, ETL, S3, SQLite, SimpleDB, olap, tagged Elastra, EnterpriseDB, Oracle, PostgreSQL on March 27, 2008 | 2 Comments »
… and that’s good. That’s how I like my databases, boring, reliable, consistent, easy to use.
SimpleDB on the other hand is not boring, it’s an exciting new shiny thing that opens up a myriad of new possibilities; but first, I and the rest of the developer community, need to tool up and cast aside [...]
Dublin Bus and PALO ETL - the connection!
Posted in AmazonAWS, BI, ETL, Palo, S3, SQLite, SimpleDB, Talend, VBA, excel, kettle, olap, tagged Dublin, Dublin Bus, hmac, sha1, sha1hmac on January 26, 2008 | 5 Comments »
Dublin buses, as is the norm with most road-based public transport systems in our increasingly car-choked cities, tend to operate on the basis of “no sign of a bus for ages, then two or three arrive at the same time”. Palo MOLAP ETL options appear to be following the same pattern; we’ve been waiting for [...]
New ETL platform for PALO OLAP
Posted in BI, ETL, Palo, Talend, kettle, olap, tagged Jedox, Drill-down, drill-back, Mondrian on November 28, 2007 | No Comments »
Jedox have announced that they intend to ship a Palo centric ETL open source server product early next year. This is excellent news and is on top of the new rules engine that was added to Palo this summer. Open source MOLAP has suddenly taken off the training wheels and is getting ready [...]
Amazon EC2: S, L and XL - now we’re sucking diesel..
Posted in BI, EC2, ETL, RSSBus, Web2.0, tagged in-memory, new instances, on-demand on October 16, 2007 | No Comments »
As of today, Amazon EC2 now supports two new Instance Types..
… a “Large” and an “Extra Large” instance type to complement the original instance type and provide more flexibility for EC2 users. The new instance types provide more memory, CPU, and instance storage, and are based on 64bit technology. EC2 users can now [...]
BI governance - push or pull, carrot or stick?
Posted in BI on September 17, 2007 | No Comments »
Timo Elliott discusses the perennial problem surrounding BI, the great centralised-data-warehouse versus departmental-data-marts debate; who owns what and who decides what to build, corporate IT or individual business units? He suggests a good compromise, a pull model, with individual business units owning, commissioning and paying for BI projects but with a centralised BI competency [...]
CouchDB - document centric ODS
Posted in BI, ETL, S3, SQLite, data, tagged CouchDb, google, REST on September 14, 2007 | 3 Comments »
While the potential of column-oriented DBMSs within BI projects is obvious given the popularity of MOLAP ( a form of column-oriented data store) the potential for the other new kid on the block, the document-oriented database, is less so. One such DBMS,CouchDb, is the latest wunderkid to bubble to the surface, helped by the [...]
SQLite as a Column Oriented Database
Posted in BI, ETL, Palo, SQLite, data on September 7, 2007 | 1 Comment »
According to Michael Stonebraker , one of the pioneers of relational database technology, the future of DBMSs lies with column-oriented databases such as C-Store or Google’s BigTable. In the BI sphere, MOLAP column-oriented data-stores are increasingly the norm. But the fact table implementations of most ROLAP star-schemas tend to favour a row-oriented “wide [...]
Google Spreadsheets - ETL tool
Posted in BI, ETL, GoogleApps, RSSBus, Ruby, SQLite, Talend, VBA, Web2.0, excel, kettle, tagged google on September 6, 2007 | 1 Comment »
Although I’m a total Excel fanboy, I most admit I rarely use it any longer for personal stuff such as home budgets, tax calculations, what-ifs, to-do lists etc.; I now tend to use Google Spreadsheets. Likewise, personal notes, drafts and useful bits of code are stored using Google Docs rather than MS Word. [...]
In Memory OLAP
Posted in BI, ETL, Palo, SQLite, VBA, data, excel, olap, xLite on September 5, 2007 | 4 Comments »
The consolidation within the BI market continues, this time with the purchase of Applix by Cognos. As Timo Elliott points out, the interesting bit is the Applix TM1 memory-centric OLAP product. For the vast majority of OLAP users (i.e. the millions of Excel Pivot table jockeys) in-memory OLAP is nothing new, but traditionally [...]
Moved to blog.gobansaor.com
Posted in BI, ETL, Web2.0, data, excel, tagged blogging, gobansaor on September 3, 2007 | 1 Comment »
Over the weekend I transferred this blog over to my own sub-domain, http://blog.gobansaor.com. The blog continues to be hosted by WordPress.com and the old http://gobansaor.wordpress.com addresses will continue to work. Most RSS readers will also gracefully (I hope) handle the transfer of the RSS feed, but if not, you may wish to [...]
SQLite Star Query Part II
Posted in BI, ETL, Palo, SQLite, VBA, excel, olap, xLite on August 31, 2007 | No Comments »
In my previous post I looked at simulating a bitmap-join in SQLite using a sub-query and the INTERSECT command. The problem is of course, this is a simulation, SQLite lacks bitmap indices and although the sub-query will read only the fact table’s index B-trees (avoiding accessing the fact table proper) and should be [...]