ZD

Connecting to Microsoft CRM 2011 Online from Java?

2011-03-03T04:36:00.000-08:00

Are you interested in connecting to the Microsoft Dynamics from Java?

Here is the Java code example that shows the invocation of the RetrievePolicy, RetrieveCrmTicket, RetrieveMultiple and other MS CRM 4.0 web services over SOAP:

* SOAP message templates

* Java Stub

* Simple SOAP Executor

* Few utility classes

Rotavirus hits our House

2010-11-21T05:41:00.001-08:00

Puke, diarrhea, high fevers.

Doc says, cold water, showers, clean up the mess and wait. No fun at all. :(

GoodData Filters: WITHOUT PARENT FILTER Clause

2010-02-11T02:39:00.001-08:00

I have recently noticed some confusion regarding how the advanced filters work in the GoodData platform. Some of our users don't realize that all report filters automatically propagate to all report metrics and filters. Let me demonstrate this on a simple example.

I created a simple report that shows the Q1/2010 planned sales by current opportunity stages. The report contains the Closed Date Quarter attribute on top and the Stage attribute on left. There is one simple metric Amount [Sum] that aggregates the expected revenue.

The report above shows expected revenue for all regions. Lets say that we want to see only the revenue for the West region. We will get the numbers for the West by adding a simple line filter on the Region attribute.

Please note that some of the stages have disappeared. This is fine as there are no opportunities in the West region that are in the Cultivate and Qualify stages and are expected to close in the Q1/2010.

Now, we want to compute the percentage of the expected revenue in the West to the total expected revenue in all regions. We need to divide the West expected revenue by the total expected revenue in all regions. We already have the West revenue. How can we compute the total revenue for all regions in the same report? The answer is the WITHOUT PARENT FILTER clause that we can put into the metric that computes the total revenue for all regions. The clause simply ignores all report filters in the all regions metric. So the definition of the all regions total is:

Amount [All Regions] : SELECT Amount [Sum] WITHOUT PARENT FILTER

Compare the report with the WITHOUT PARENT FILTER clause with the report without the region filter (the first one in this article). You're right, these are the same. The report filter is ignored and the Cultivate and Qualify stages are back.

Now lets compute the percentage:

SELECT Amount [Sum] / Amount [All Regions]

And here is the final percentage report:

Let me quickly summarize. The GoodData platform automatically propagates all report filters are to all underlying metrics. If you need to override this behavior, you need to use the WITHOUT PARENT FILTER clause.

Easy or difficult? Do you need more? Let me know!

You Calc. We Analyze ;-)

2009-06-25T00:48:00.000-07:00

The LucidEra demise brought me to this article. Rasmus compares Good Data with YouCalc. He claims that the key benefit of YouCalc is that it is directly accessing SalesForce, HighRise or Google data instead uploading them to a syndicated storage. The YouCalc approach is called REPORTING. It is not good or bad, it is just different from what we do. Rasmus should rather compare his company to BIRT, JasperSoft or others. The comparison with LucidEra, PivotLink or Good Data just doesn't stick.

Let me explain why on a simple example. We found that trending is one of the most interesting analyses (not only in the CRM area). Pipeline keeps changing. Average sales rep tends to be optimistic the first month of each quarter. The optimism is going down as the end of quarter approaches. To analyze the attitude of individual salesman or a sales team, analytical vendor needs to collect data snapshots on regular basis and analyze the pipeline changes in between these snapshots. Reporting applications like YouCalc can't do trending analysis (unless very few cases when the original data provider has decided to snapshot their data and give YouCalc access to the snapshots) as well as many others.

Rasmus is right, the direct access to data is something what differentiates Good Data from YouCalc. This is what puts Good Data to analysis and YouCalc to reporting categories. I'm sure that the primary reason why LucidEra is gone is very different.

The MLB 2008 Strikeout Leaders

2009-05-29T03:42:00.001-07:00

Is baseball your passion? If yes, you'll love our MLB project. See the embedded report below as a preview what you can discover there. Note that the report is interactive! You can right click on values, sort etc.

Click on the link below the report and enter your e-mail address if you want to slice & dice the long-term MLB stats and create your own reports!

Play it again Sam!

2009-05-22T00:06:00.000-07:00

Our marketing has scored few home-runs in April.

Success or failure come way faster in our world. I would never dream about that we are going to have more unique visitors at our site than Microstrategy or QlikView who have spent millions of dollars on marketing. This is proof that few dollars can beat millions if we spent them right.

Play it again in May, Sam! :-)

CloudExpo Slides

2009-05-19T08:54:00.000-07:00

Here are the slides that I presented together with Jakub on the CloudExpo Europe.

Good Data hits TechCrunch homepage!

2009-04-24T06:18:00.000-07:00

The article comments are very interesting! We are getting huge attention from the whole world. This feels great !

All Girls are the Same

2009-03-28T15:56:00.000-07:00

I recently talked to our neighbor's three years old son. Not expecting much from the conversation, I asked him about girls in the kindergarten he had recently started attending. Here is his answer: "They are all the same. They just have different heads." I have been thinking about his answer since then. Most men need three times more time and couple of divorces to get to the same conclusion.

Good Data App Redressed!

2009-03-06T07:48:00.000-08:00

Our app has got a new sexy outfit. Check it out.

Trying to Walk

2009-02-27T22:23:00.000-08:00

I almost forgot how hard it is to learn things :-) My poor daughter in law.

This is how it looks like when one of your Flickr photos makes it :-)

2009-02-26T08:01:00.000-08:00

3295 views in one day :-)

Czech Phrases You Might Need

2009-01-28T02:35:00.000-08:00

How romantic ;-)

"Oranzova vznikne kdyz se nachcije do rudy."

2009-01-27T12:02:00.000-08:00

Czech proverb very pertinent to the current Czech Democratic party leaders - dr. Rath & mr. Paroubek (not your average Obama). They are recalling Hitler's way to get out of the economic crisis. Unbelievable! I feel really ashamed for them and only hope that Czechs can't be so stupid to let them back to our government.

P.S.: I still can't believe I blogged Czech politics.

Setting Amazon S3 ACLs Programatically

2009-01-27T03:23:00.000-08:00

I recently wrote a simple Python script for setting Amazon S3 ACLs. You might find it useful.

Usage:

setS3acl.py -a $AWS_ACCESS_KEY -s $AWS_SECURE_KEY -b "myBucket" -f myfile.txt -o $OWNER_AWS_ID "$USR1_AWS_ID:FULL_CONTROL" "$USR2_AWS_ID:READ"

Options

-a - your AWS access key
-s - your AWS secure access key
-b - AWS bucket name (no s3:// nor any other slashes)
-f - file name (no s3:// nor bucket prefixes, just the filename)
-o file owner (AWS ID)

Parameters:

[AWS_ID:FULL_CONTROL|READ|WRITE]

You'll need to use the AWS IDs to identify the user (the long and ugly Amazon account identifiers - e.g. a382d287d4d58222758254ddebac103f70e6f5b).

There are two Python files that you'll need:

* setS3acl.py
* S3.py

Look at the URL to find out where I store the scripts ($0.15 / GB / month) ;-)

Enjoy!

Collaborative Analytics - An Emerging Practice

2009-01-21T02:37:00.000-08:00

Dave Wells published Collaborative Analytics - An Emerging Practice article. I like the data/analysis/action loops (collaboration layers).

And he mentions Good Data as leader in the emerging space.

California Immigration

2008-12-18T00:17:00.000-08:00

I've uploaded the Census US demographic data to Good Data and I can't stop wondering. For example, would you believe that good one fourth of California population are immigrants? More precisely 26.2% Californians were born outside of US.

Do you want start wondering too? Let me know ( zd at gooddata.com) and I'll invite you to this analytic project.

My Good Data Web Expo Slides

2008-11-05T03:02:00.000-08:00

See the slides that I presented on the WebExpo conference.

Good Data REST API

2008-11-05T00:51:00.000-08:00

The Good Data BI platform is accessible through the stateless REST API. This HTTP-based API can be simply used from any 3rd party application as well as from a plain browser. The API provides the full power of our platform (we actually use it as the backend for our web frontend).

In fact the Good Data application consists of a handful types of services. Instances of these services can be dynamically added or removed (via simple HTTP load-balancing) on as needed basis. Add the Amazon EC2 cloud that allows us to add or remove a new machine and only pay for the CPU ticks that we really use. The net result is the great flexibility, scalability and cost efficiency.

The demo video below points at the fundamental architecture differences between our approach and some other on-demand BI vendors who simply deployed an existing BI package (e.g. Pentaho or MS Analytics) on the web (which unfortunately does not prevent their marketing from using the multi-tenant, SaaS mambo jumbo).

This video might help you to better understand the Good Data architecture. I apologize for no audio. Hopefully the simple step-by-step description below helps:

1. The /gdc suffix in the GDC BI platform URL shows the list of the REST API services that the platform provides.

2. Then we navigate to the metadata services that manage metadata for a selected BI project (the FoodMartDemo in our case).

3. We first show the FULL-TEXT SEARCH service. We specify the search term ("sales") directly in the service's URL. The list of matching results is shown.

4. We select one of the reports from the search result to inspect the report's definition. We can spit out the definition in many formats (e.g. JSON, YAML, ATOM, or XML). We use YAML as the default.

5. Then we demonstrate the metadata QUERY service. We list all reports in the FoodMartDemo project. We again inspect one of the reports: Salary by Year and State.

6. Then we are going to demonstrate the using service that shows us all dependencies (metadata objects that the selected report references) of the report. For example the report depends on it's definition (reportDefinition) object. We copy and paste the link of the report definition to the browser URL bar to inspect the report definition object structure. It contains all attributes and metrics that the report displays (all inner objects have their URLs too, so we could continue investigating them).

7. Then we navigate to the XTAB service. The XTAB can execute and cross-tabulate (or pivot if you like) the report's definition. We supply the report definition URL and it spits out the representation of the report result (you can see the the machine representation of the report's data). Notice the asynchronous processing here.

8. Then we go back to the original report Salary by Year and State. The report contains a reference to it's result.

9. We will copy and paste the result's URL to the EXPORTER service that returns (again asynchronously) the report result's data in MS Excel format.

If you have the Good Data platform demo account, you can try this script yourself at http://demo.gooddata.com/gdc (hint - you'll need to take a look at the LOGIN service).

New Good Data Website!

2008-11-05T00:42:00.000-08:00

Check out the new Good Data website.

Deadly iPhone screen

2008-10-09T00:22:00.000-07:00

Now I know why one would want to set up multiple wake-up alarms for a single night. My "beloved" iPhone is the only device that we currently have at home capable of doing this. So it's Marimba, diapers, milk, burp. Twice every three hours. :-(

Ray has entered blogosphere!

2008-10-09T00:19:00.000-07:00

Ray Light, the guy who sits next to me in Good Data has started blogging. I know that he will be damn good at it. You can start following him at http://www.collaborativeanalytics.com/.

Cloud Transparency

2008-09-29T23:36:00.000-07:00

Radovan wrote a comment on Werner's article about cloud transparency. I agree that operators need monitoring and developers want to optimize their apps. However I don't understand how these needs relate to (location) transparency. I think that this is rather about functionality (e.g. OOTB performance and right management tools) that the cloud offers.

I see a little schizophrenia in the AWS messaging. "We (AWS) want developers to play with all nuts and bolts, optimize, monitor, and trace at the network packet level. And when the code jumps into our queuing, simple db, payment or whatever other high-level service then forget all transparency, close your eyes and cross your fingers." :-)

I think that different developers have different needs in terms of the right transparency level. IMO AWS is heavily used by web developers. I believe that particularly web developers will lean towards higher transparency, packaged high-level services and easy deployment.

Radovan, what do you think about the Google AppEngine?

Ema & Anna

2008-09-29T00:22:00.000-07:00

Erika gave birth to Ema and Anna last Thursday. You can see few very bad quality (iPhone) photos of our newborns on my Flickr.

The Good Data Public Beta is Out!

2008-07-29T14:50:00.001-07:00

Go to or website and sign up. And please remember, that we would love to hear from you via our GetSatisfaction forum. Please let us know what you think and help us to create vital community around our product. Thanks!

Good Data Beta is Close!

2008-07-24T09:23:00.000-07:00

I just noticed this article. The UI screenshots are a bit outdated. Yep, 3 months are deep history in SaaS. :-)

Stay tuned, we are close to our first public beta release. Hopefully we will release the public beta next week. If you can't wait and promise me tons of feedback, let me know at zd at gooddata.com. Perhaps I can let you in sooner ;-)

Does SAAS-BI make sense?

2008-06-06T05:50:00.000-07:00

I recently came across this interesting article on the poeticcode blog. In short, it's author claims that BI as service (SAAS-BI) does not make sense because of the difficulties with incremental data loading and higher network bandwidth requirements.

I do not want to dispute here the difficulty of the incremental data warehouse loading. It is difficult in certain situations. It is not that difficult in others where the nature of data help solving it in elegant ways. Moreover the incremental loads are necessary for many BI applications no matter if these are deployed in house or as a hosted service. This integration "baseline" (from the labor and cost standpoint) is the same for both in-house and SAAS. SAAS then removes the labor and costs associated with the data warehouse and analytical stack implementation/maintenance. The multi-tenancy leads to improved HW utilization. Only these two factors lead to huge savings and far better return of investment.

The Internet network connection bandwidth argument is ridiculous: "Not to mention, all the extra network bandwidth needed to encrypt and transfer the data from your data center to the SAAS-BI data center. That also means factoring your internet pipes for much more peak-bandwidth else your potential customers visiting your corporate website might have network problems and worse, you might lose sales and loyal customers."

This argument does not even apply to my naively and quickly implemented FAN (Family Area Network). :-)

Summary: It is certainly good to know about the data integration issues associated with the (SAAS) BI. You should not overlook them. However, I do not believe that these issues are the key decision points like cost of ownership, risk management, return on investment, implementation time etc.

Gooddata Architecture

2008-05-20T02:18:00.000-07:00

Take a look at the Gooddata BI platform architecture here.

See Gooddata live!

2008-04-11T00:16:00.000-07:00

We posted the first Gooddata product video on our website. Please bear in mind that we are sharing it early. It is not even alpha. Check it out and let us know what you think.

Just-in-Time vs. Just-in-Case BI Costs

2008-03-19T22:16:00.000-07:00

Do you know how much power your BI really needs? More precisely, how much power it needs today at 9 AM, next weekend, and at the last day of the quarter or year? Have you bought the ultra-super-duper machine that handles even the highest usage spikes with ease? Or have you decided to sacrifice performance during these peak hours? Do you wait or waste?

Gooddata approach to this dilemma can be described with two keywords: Stateless & Virtualized.

The Stateless is about our architecture. Our product relies on six generic stateless services. The stateless is important for scalability. We can dynamically add any of the six generic service instances as we need to increase throughput of our BI platform.

Virtualized is how these services are deployed. Virtualization allows us to flexibly add hardware nodes to our computing cloud. We have images of different virtual nodes on hand. We can create a new node and dynamically add it to our computing cloud. The beauty is that this all can happen in just few minutes. And the decommissioning of such node is even faster.

We (and you, as our customer) pay for CPU ticks and storage, so the Stateless & Virtual gives you unmatched cost efficiency. Gooddata offers you access to unlimited computing resources. You can get as much of CPU, storage and network bandwidth as you need. And you pay only for what you are really consuming.

Pay for your BI project on Just-in-Time not on Just-in-Case basis.

Gooddata Collaborative Analytics

2008-03-14T21:44:00.000-07:00

US dollar exchange rate goes steadily down for more than 5 years. This works for us who buy our gadgets in the US. We use the "Zasilkova Sluzba" service to deliver stuff to our doorstep in Czech Republic.

However, the declining dollar doesn't make us happy as entrepreneurs. It makes all resources that we buy in Europe more expensive. We sell our products for dollars and buy our resources mostly for Czech crowns and getting less and less bang for one dollar. I mean 100% less bang since 2002.

Fortunately we are the "analytics guys" so we can predict the future and actively hedge ourselves against the declining US currency. Our latest research shows that US dollar reaches zero sometimes around 6/18/2012.

Knowing this, we can optimize our financial operations and get the most out of it. Tons of gadgets plus nice access to local resources.

DOES THIS RING SOME BELL? Have you seen such a "great" analysis before? Numbers are right, their interpretation is absurd. That is why we focus on collaborative analytics. Collaboration works great in such cases. You bet that I'm going to see a bull*it tag and some lampoon comments regarding my brainpower a few seconds after I publish such analysis to the Gooddata platform. The product separates wheat from the chaff using collaboration capabilities like tag rating and commenting .

P.S.: Roman, I apologize for stealing your idea with the dollar analysis. I can't resist. At the end this is also a bit about collaboration. You invented and designed it and just I implemented it. :)

World Wide Telescope

2008-03-11T23:58:00.000-07:00

I always wanted to explore night sky. I'll never forget an August night when I watched falling stars with my father. We lay on a haystack and the million of stars seemed to be so close. I was about seven years old.

Recently I decided to buy a telescope and started talking about this with my friends. One of them told me about the World Wide Telescope project from Microsoft. I was surprised that they haven't started with a World Wide Microscope first but anyway. You can check it out at http://www.worldwidetelescope.org/. The project was recently announced at TED and it is promised to launch in spring 2008. Isn't it spring already? ;)

Gooddata Academy Awards

2008-03-07T21:42:00.000-08:00

Yesterday, Roman showed me his personal AMEX card management application that allows him to download his creditcard transaction history. I started thinking about personal business intelligence at this very moment. One of our first Gooddata project templates should focus on loading these data and analyzing them upside down. Nice help for people who wants a bit more than just few standard charts that they get from AMEX. This one even beats the website log enrichment and analysis project idea that was my favorite until yesterday.

I bet that there are zillions of similar situations and formats. The question is which one is the best theme for the soon-to-be-released Gooddata tutorial? Do you have some nice idea? Send it my way (zd at gooddata dot com). The Gooddata Academy will evaluate your nomination. The cute, little ipod nano is waiting for the winner.

You should definitely participate! You might hate such contests. However, you certainly don't want me to give yet-another ipod nano, pico, video whatever to Roman for the AMEX idea. ;)

RUP vs Agile

2008-03-05T21:21:00.000-08:00

Gooddata is growing. I see new faces in our office every Monday. The Gooddata "legacy" is often under fire. Our new colleagues come from many different environments and bring new ideas and perspectives. That's how we got to the RUP vs Agile discussion.

We practice agile development (scrum) at Gooddata. We have just proudly started our fifth sprint. Our mantra is design, build & re-factor. Iterate quickly until it is done. And suddenly there is a new Yam (yet-another-Martin in our office) who talks about the old good Rational Unified Process. Analysis, design, implementation, deployment. Requirements, use-cases, class and sequence diagrams, logical and physical models etc.

So where is the truth? Where the agile meets RUP? How to marry concepts of these two worlds? I believe that RUP tells us WHAT we need to deliver (use-cases, diagrams, models, schemas, code and deployments) and Agile shows HOW to deliver all the above. The essential pieces that we can't live without need to go to the first iteration of the RUP delivery cycle. All the rest will follow in subsequent iterations. If an iteration crashes because of a new findings, we simply restart it. If we need to dump everything what we have done in an previous iteration we will dump it. If we keep the iterations very short we are not going to regret such loses. And we need to realize that we do not need to go all the way down from use-case to deployment in every iteration. The first iteration can end up with a half-baked command-line script that pretends some functionality rather than fully fledged component with all belts and whistles. We can get to deployment, REST API or whatever it needs later.

I believe that we can have the best from both worlds. Let's blend the proven methodology, useful deliverables and tools from the RUP with the agility, flexibility and efficiency that comes from the Agile. Quickly define the Gooddata way, start using it knowing that we are going to re-factor it million times in the Gooddata future. :)