Hi guys,
In DAX 2009, for the real data type, just want to ask the following?
(1) what is the effective precision/scale for real data type? When I create a new field with real data type, it creates the field in SQL server 2008 as numeric (28,12). Why was it created this with this precision (28) and scale (12)? Is it default in DAX ? Can you override it?
(2) I created an EDT for real with the NoOfDecimals = 12.
I opened table browser and tried to input this data :
1.123456789012 - OK
1234.123456789012 - OK
12345.123456789012 - not ok. The last decimal digit was rounded off.. resulting to 12345.123456789010. Why is this so? I did not expect the round off since it still meets the NoOfDecimals value set. It seems it is always rounding off to the 17th digit. Is this standard behavior, as well ?
Thanks.