Blaze your own trail, with deeper insights from more data!

by Doug Dailey

Much Like Thomas Jefferson’s commission to Lewis & Clark for their expeditions, Data Scientists are commissioned by the business to understand the landscape of information across their enterprise, map disparate data sources and identify valuable assets.

By leveraging an assortment of technologies and innovative thinking, Data Scientists utilize every tool possible to glean transformative insights. Now that we can offer a higher level of data access with the new IBM Fluid Query capability, Data Scientists and Business Analysts can partner up (just like Lewis and Clark) to explore data from across the enterprise and discover  business insights from “Systems of Record” and “Systems of Engagement”.

Fluid Query software offers a mechanism to integrate various sources of data for discovery, exploration, reporting and analytics. Day-to-day work is about building common pathways to extract value. Certain use cases call for positioning small sub-sets of data in a simple and efficient manner.

Fluid Query software offers a mechanism to integrate various sources of data for discovery, exploration, reporting and analytics.

Our primary goal with Fluid Query is to deliver seamless access to data regardless of its location, and hand off as much query processing as possible to the system where the data actually sits. Once discovery and exploration result in new golden nuggets of insight, a possible next step is to aggregate and export that data to IBM PureData System for Analytics for deeper insights. This is not a replacement for replication or ETL technologies, but a straight-forward approach to positioning data in the right location, at the right moment, for the most appropriate level of processing.

fluid query platforms
IBM Fluid Query enables deeper insights from more data that is stored on these platforms.

IBM Fluid Query 1.5 delivers opens the field of vision for PureData System for Analytics to Hadoop, Spark and other structured data stores like DB2 for Linux, UNIX and Windows, PureData for Operational Analytics, dashDB (IBM Data warehouse as as Service) and Oracle. In addition it opens “anywhere to anywhere” multi-generational access across currently supported PureData systems. This includes PureData System for Analytics N100x, N2001, N2002 and N3001 systems, our rack mounted N3001-001 system, and our IBM Netezza Platform Development Software running on reference architecture.

IBM Fluid Query is a newly added software component to our Netezza Performance Server Software suite. PureData clients can easily download the component from IBM Fix Central or our Netezza Developer Network. Did I mention that Fluid Query is offered at no charge? No added cost with loads of added value for PureData clients. Can Oracle or Teradata offer this level of out-of-the-box value?

Did I mention that Fluid Query is offered at no charge? No added cost with loads of added value for PureData clients.

Now, let’s get down to brass tacks. Silos of data are bad and openness with varying degrees of access will allow you to easily connect disparate systems. Enterprise warehouses have a strong and well deserved tradition for housing tons of high value data that has been passed through iterations of cleansing, transformation and governance.

IBM’s PureData System for Analytics systems delivers best-in-class in-database analytics, alongside our state-of-the-art AMPP architecture and impressive compute framework to deliver insights at the speed of thought. These insights generate new questions and answers that shape the direction for the business, or result in improved client experience. In turn, this adds new customers, new revenue sources and other forms of opportunity.

Fluid Query helps with response to demands for fluid access to big data and for integrating PureData System for Analytics into the Logical Data Warehouse. We’ve currently delivered against the leading Hadoop distributions, and have recently added connectors that support leading relational databases, such as DB2 and dashDB.

IBM Fluid Query also includes a fast data movement capability that allows you establish queryable archives on target Hadoop distributions, create DR subsets of data for safe keeping, or move seldom-accessed or colder data to Hadoop for secondary processing. Thus, Fluid Query helps offload workloads and open PureData System for Analytics for HOT data with immediate value for the business. You’re in control of what, when, how, and where! Moving data in plain text is a common practice, but why not move the data in proprietary Netezza binary format? With up to 3X+ compression and 3X the speed of standard out-of-the-box Sqoop, it can be stored and queried in either compressed format or plain text after being decompressed. IBM Fluid Query also allows you to control authentication via LDAP, kerberos, SSL, SSL + Secure, local or no SASL.

… Fluid Query helps offload workloads and open PureData System for Analytics for HOT data with immediate value for the business.

Why not leverage IBM Fluid Query to prime Test or Development environments running on dedicated rack configurations, lightweight N3001-001 systems or our software-only edition with sample data? Or, test different data models, apply analytic algorithms or stage beta testing and certification for upcoming production applications.

You get the picture. IBM Fluid Query introduces a new brand of flexibility for your PureData System for Analytics environment that lines up nicely with IBM Fluid Query capabilities delivered in IBM Big SQL through IBM BigInsights, DB2 and PureData for Operational Analytics. After all, this is not just a one-way street, because these other IBM products play the same game.

It’s time to integrate, explore new business opportunities and simply improve your day-to-day operations!

IBM Fluid Query v 1.5 is now generally available as a software addition to PureData System for Analytics clients. To learn more about Fluid Query v 1.5, I invite you to listen to this webinar: IBM Fluid Query – Unifying Data Access Across the Logical Data Warehouse.

About Doug,
Doug Daily
Doug has over 20 years combined technical & management experience in the software industry with emphasis in customer service and more recently product management.He is currently part of a highly motivated product management team that is both inspired by and passionate about the IBM PureData System for Analytics product portfolio.