<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: Palo OLAP and sparse dimensions.</title>
	<atom:link href="http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/</link>
	<description>A country datasmith.</description>
	<lastBuildDate>Fri, 10 Feb 2012 11:24:31 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: Tom Gleeson</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4802</link>
		<dc:creator><![CDATA[Tom Gleeson]]></dc:creator>
		<pubDate>Tue, 25 Nov 2008 13:09:34 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4802</guid>
		<description><![CDATA[@Jason

Excellent.

When I first came across Palo, I was quite happy to see it a &quot;good enough&quot; alternative to the established OLAP tools. Sort of like the dog who can ride a bike, not so much how well the dog could ride but that the dog could ride at all. 

No more. Palo is now a serious contender and from what I understand of future plans for the product, going to get even more capable.

We just need more people out there evangelising it, it&#039;s undoubtedly the best kept secret in BI today.

Tom]]></description>
		<content:encoded><![CDATA[<p>@Jason</p>
<p>Excellent.</p>
<p>When I first came across Palo, I was quite happy to see it a &#8220;good enough&#8221; alternative to the established OLAP tools. Sort of like the dog who can ride a bike, not so much how well the dog could ride but that the dog could ride at all. </p>
<p>No more. Palo is now a serious contender and from what I understand of future plans for the product, going to get even more capable.</p>
<p>We just need more people out there evangelising it, it&#8217;s undoubtedly the best kept secret in BI today.</p>
<p>Tom</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jason</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4801</link>
		<dc:creator><![CDATA[Jason]]></dc:creator>
		<pubDate>Tue, 25 Nov 2008 10:26:18 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4801</guid>
		<description><![CDATA[@Tom.

Thanks again, I&#039;ll do some more playing.
Last night I re-built Biker in TM1 9.4 (for interest 81,092,880,394,240 cells with &lt;150,000 data points - nice and sparse) for a quick sparsity test.

A simple Currency calc (as above) would easily kill a bad sparsity handling OLAP but Palo and TM1 performed equally well - sub second response for a top level roll-up of the calculated member.

Next I&#039;ll extend the TM1 model to try and get the response times to something I can actually measure and try the same with Palo - suggestions welcome!

Jason.]]></description>
		<content:encoded><![CDATA[<p>@Tom.</p>
<p>Thanks again, I&#8217;ll do some more playing.<br />
Last night I re-built Biker in TM1 9.4 (for interest 81,092,880,394,240 cells with &lt;150,000 data points &#8211; nice and sparse) for a quick sparsity test.</p>
<p>A simple Currency calc (as above) would easily kill a bad sparsity handling OLAP but Palo and TM1 performed equally well &#8211; sub second response for a top level roll-up of the calculated member.</p>
<p>Next I&#8217;ll extend the TM1 model to try and get the response times to something I can actually measure and try the same with Palo &#8211; suggestions welcome!</p>
<p>Jason.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tom Gleeson</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4800</link>
		<dc:creator><![CDATA[Tom Gleeson]]></dc:creator>
		<pubDate>Mon, 24 Nov 2008 16:22:28 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4800</guid>
		<description><![CDATA[@Jason

For that you&#039;ll need the PALO.MARKER function

[&#039;EuroValue&#039;] = N: PALO.MARKER (”Cube1″..) * PALO.DATA (”Currency”..)

..you can also mark PALO.DATA expressions by appending  @PALO.MARKER.  You&#039;ll need this if source dimensions require functional modification (like SUBSTR for example) as MARKER parameters can only be static constants or variables ...

[&#039;EuroValue&#039;] = N: PALO.DATA (”Cube1″..)@PALO.MARKER (”Cube1″..)* PALO.DATA (”Currency”..)

Tom]]></description>
		<content:encoded><![CDATA[<p>@Jason</p>
<p>For that you&#8217;ll need the PALO.MARKER function</p>
<p>['EuroValue'] = N: PALO.MARKER (”Cube1″..) * PALO.DATA (”Currency”..)</p>
<p>..you can also mark PALO.DATA expressions by appending  @PALO.MARKER.  You&#8217;ll need this if source dimensions require functional modification (like SUBSTR for example) as MARKER parameters can only be static constants or variables &#8230;</p>
<p>['EuroValue'] = N: PALO.DATA (”Cube1″..)@PALO.MARKER (”Cube1″..)* PALO.DATA (”Currency”..)</p>
<p>Tom</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jason</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4799</link>
		<dc:creator><![CDATA[Jason]]></dc:creator>
		<pubDate>Mon, 24 Nov 2008 14:18:51 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4799</guid>
		<description><![CDATA[@Tom, thanks for that. As it happens I found that bit out - I like it, simple.
The next question was how to do this from another cube - where I&#039;m using a PALO.DATA() reference that needs to be the a &#039;marker&#039;.

I.E. [&#039;EuroValue&#039;] = N: PALO.DATA (&quot;Cube1&quot;..) * PALO.DATA (&quot;Currency&quot;..)

It&#039;s possible that this isn&#039;t the best way to build in Palo, but I&#039;m comparing to TM1 where &#039;feeders&#039; are often pushed from a source cube to a calculation cube.]]></description>
		<content:encoded><![CDATA[<p>@Tom, thanks for that. As it happens I found that bit out &#8211; I like it, simple.<br />
The next question was how to do this from another cube &#8211; where I&#8217;m using a PALO.DATA() reference that needs to be the a &#8216;marker&#8217;.</p>
<p>I.E. ['EuroValue'] = N: PALO.DATA (&#8220;Cube1&#8243;..) * PALO.DATA (&#8220;Currency&#8221;..)</p>
<p>It&#8217;s possible that this isn&#8217;t the best way to build in Palo, but I&#8217;m comparing to TM1 where &#8216;feeders&#8217; are often pushed from a source cube to a calculation cube.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tom Gleeson</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4798</link>
		<dc:creator><![CDATA[Tom Gleeson]]></dc:creator>
		<pubDate>Fri, 21 Nov 2008 17:08:51 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4798</guid>
		<description><![CDATA[@Jason

Make sure you use &quot;markers&quot; otherwise it will result in a mass calculation.

i.e.

rather than

[&#039;EuroValue&#039;] = N:[&#039;Units&#039;] * [&#039;EuroRate&#039;]

use.

[&#039;EuroValue&#039;] = N:[[&#039;Units&#039;]] * [&#039;EuroRate&#039;]

this will only calculate where Units are set.

Tom]]></description>
		<content:encoded><![CDATA[<p>@Jason</p>
<p>Make sure you use &#8220;markers&#8221; otherwise it will result in a mass calculation.</p>
<p>i.e.</p>
<p>rather than</p>
<p>['EuroValue'] = N:['Units'] * ['EuroRate']</p>
<p>use.</p>
<p>['EuroValue'] = N:[['Units']] * ['EuroRate']</p>
<p>this will only calculate where Units are set.</p>
<p>Tom</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jason</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4797</link>
		<dc:creator><![CDATA[Jason]]></dc:creator>
		<pubDate>Fri, 21 Nov 2008 16:46:40 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4797</guid>
		<description><![CDATA[Hi, interesting as sparsity handling is key to OLAP models - it&#039;s what makes Cognos&#039;s TM1 so good.

In my case, what I&#039;m evaluating in Palo is the handling of sparse data and rules/calcs.

I&#039;ve added a duplicate cube in &#039;Biker&#039; to the orders cube that multiplies the Units measure (at N:) by a notional currency value - simulating a currency translation. This -could- result in a mass calculation of every cell in the cube unless the sparsity is handled and it only calcs those cells with data in.

I&#039;m waiting for the results as I read this, but it&#039;s looking slow so far...]]></description>
		<content:encoded><![CDATA[<p>Hi, interesting as sparsity handling is key to OLAP models &#8211; it&#8217;s what makes Cognos&#8217;s TM1 so good.</p>
<p>In my case, what I&#8217;m evaluating in Palo is the handling of sparse data and rules/calcs.</p>
<p>I&#8217;ve added a duplicate cube in &#8216;Biker&#8217; to the orders cube that multiplies the Units measure (at N:) by a notional currency value &#8211; simulating a currency translation. This -could- result in a mass calculation of every cell in the cube unless the sparsity is handled and it only calcs those cells with data in.</p>
<p>I&#8217;m waiting for the results as I read this, but it&#8217;s looking slow so far&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: gobansaor</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4624</link>
		<dc:creator><![CDATA[gobansaor]]></dc:creator>
		<pubDate>Thu, 19 Jun 2008 08:55:32 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4624</guid>
		<description><![CDATA[@Vladislav

Excellent news, looking forward to June 25th.

@Andreas

I&#039;ve seen it, I&#039;m the &quot;gleesoto&quot; who raised the question ;-)

I still think you are going to have to allow for drill-through from consolidated coordinates, forcing users (who undoubtedly will be comparing the experience to Excel Pivot tables) to drill down to the base level of every single dimension is (a) unnecessary and (b) a huge inconvenience to the user.

Yes, such a drill-through might occasionally return a result-set of 100s of thousands, but that could be protected against. The argument that the required indexes on the drill-through &quot;fact table&quot; would slow down the load process could be addressed by using a faster database (SQLite!!!) and/or using an intermediate temp table during load (good idea anyway, allow for ETL process to happen, while drill-through functionality continues), then transfer to a &quot;latest version&quot; table, batch build indexes, finally point users to latest version. (This would also of course require Palo database versioning as well).

Nevertheless, as I&#039;ve said before, the ETL Server is impressive.  Keep up the good work.

Tom]]></description>
		<content:encoded><![CDATA[<p>@Vladislav</p>
<p>Excellent news, looking forward to June 25th.</p>
<p>@Andreas</p>
<p>I&#8217;ve seen it, I&#8217;m the &#8220;gleesoto&#8221; who raised the question <img src='http://s1.wp.com/wp-includes/images/smilies/icon_wink.gif' alt=';-)' class='wp-smiley' /> </p>
<p>I still think you are going to have to allow for drill-through from consolidated coordinates, forcing users (who undoubtedly will be comparing the experience to Excel Pivot tables) to drill down to the base level of every single dimension is (a) unnecessary and (b) a huge inconvenience to the user.</p>
<p>Yes, such a drill-through might occasionally return a result-set of 100s of thousands, but that could be protected against. The argument that the required indexes on the drill-through &#8220;fact table&#8221; would slow down the load process could be addressed by using a faster database (SQLite!!!) and/or using an intermediate temp table during load (good idea anyway, allow for ETL process to happen, while drill-through functionality continues), then transfer to a &#8220;latest version&#8221; table, batch build indexes, finally point users to latest version. (This would also of course require Palo database versioning as well).</p>
<p>Nevertheless, as I&#8217;ve said before, the ETL Server is impressive.  Keep up the good work.</p>
<p>Tom</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Andreas Fröhlich</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4623</link>
		<dc:creator><![CDATA[Andreas Fröhlich]]></dc:creator>
		<pubDate>Wed, 18 Jun 2008 09:05:05 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4623</guid>
		<description><![CDATA[Hello,
concerning the Drill-through, take a look at this topic on the Palo-Forum: 
http://forum.palo.net/thread.php?threadid=1046

Andreas,
Palo Team]]></description>
		<content:encoded><![CDATA[<p>Hello,<br />
concerning the Drill-through, take a look at this topic on the Palo-Forum:<br />
<a href="http://forum.palo.net/thread.php?threadid=1046" rel="nofollow">http://forum.palo.net/thread.php?threadid=1046</a></p>
<p>Andreas,<br />
Palo Team</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Vladislav Malicevic</title>
		<link>http://blog.gobansaor.com/2008/05/26/palo-olap-and-sparse-dimensions/#comment-4622</link>
		<dc:creator><![CDATA[Vladislav Malicevic]]></dc:creator>
		<pubDate>Wed, 18 Jun 2008 08:34:24 +0000</pubDate>
		<guid isPermaLink="false">http://gobansaor.wordpress.com/?p=367#comment-4622</guid>
		<description><![CDATA[Hi!
We will address this memory consumption issue in our next release (comming out on June 25th). The problem lies in the way and the amount of data we transfer between our core client library (libpalo_ng) and the .NET Excel frontend. There are some issues with the garbage collector in .NET that we try to workaround.

Vlado,
Palo Team]]></description>
		<content:encoded><![CDATA[<p>Hi!<br />
We will address this memory consumption issue in our next release (comming out on June 25th). The problem lies in the way and the amount of data we transfer between our core client library (libpalo_ng) and the .NET Excel frontend. There are some issues with the garbage collector in .NET that we try to workaround.</p>
<p>Vlado,<br />
Palo Team</p>
]]></content:encoded>
	</item>
</channel>
</rss>

