Three session guides get you started with data warehousing at IBM Insight at World of Watson

Join us October 24 to 27, 2016 in Las Vegas!

by Cindy Russell, IBM Data Warehouse marketing

IBM Insight has been the premiere data management and analytics event for IBM analytics technologies, and 2016 is no exception.  This year, IBM Insight is being hosted along with World of Watson and runs from October 24 to 27, 2016 at the Mandalay Bay in Las Vegas, Nevada.  It includes 1,500 sessions across a range of technologies and features keynotes by IBM President and CEO, Ginni Rometty; Senior Vice President of IBM Analytics, Bob Picciano; and other IBM Analytics and industry leaders.  Every year, we include a little fun as well, and this year the band is Imagine Dragons.

IBM data warehousing sessions will be available across the event as well as in the PureData System for Analytics Enzee Universe (Sunday, October 23).  Below are product-specific quick reference guides that enable you to see at a glance key sessions and activities, then plan your schedule.  Print these guides and take them with you or put the links to them on your phone for reference during the conference.

This year, the Expo floor is called the Cognitive Concourse, and we are located in the Monetizing Data section, Cognitive Cuisine experience area.  We’ll take you on a tour across our data warehousing products and will have some fun as we do it, so please stop by.  There is also a demo room where you can see live demos and engage with our technical experts, as well as a series of hands-on labs that let you experience our products directly.

The IBM Insight at World of Watson main web page is located here.  You can register and then use the agenda builder to create your personalized schedule.

IBM PureData System for Analytics session reference guide

Please find the session quick reference guide for PureData System for Analytics here: ibm.biz/wow_enzee

Enzee Universe is a full day of dedicated PureData System for Analytics / Netezza sessions that is held on Sunday, October 23, 2016.  To register for Enzee Universe, select sessions 3459 and 3461 in the agenda builder tool.  This event is open to any full conference pass holder.

During the regular conference, there are also more than 35 PureData, Netezza, IBM DB2 Analytics Accelerator for z/OS (IDAA) technical sessions across all the conference tracks, as well as hands on labs.  There are several session being presented by IBM clients so you can see how they put PureData System for Analytics to use.  Click the link above to see the details.

IBM dashDB Family session reference guide

Please find the session quick reference guide for the dashDB family here: ibm.biz/wow_dashDB

There are a more than 40 sessions for dashDB, including a “Meet the Family” session that will help you become familiar with new products in this family of modern data management and data warehousing tools.  There is also a “Birds of a Feather” panel discussion on Hybrid Data Warehousing, and one that describes some key use cases for dashDB.  And, you can also see a demo, take in a short theatre session or try out a hands-on lab.

IBM BigInsights, Hadoop and Spark session reference guide

Please find the session quick reference guide for BigInsights, Hadoop and Spark topics here: ibm.biz/wow_biginsights

There are more than 65 sessions related to IBM BigInsights, Hadoop and Spark, with several hands on labs and theatre sessions. There is everything from an Introduction to Data Science to Using Spark for Customer Intelligence Analytics to hybrid cloud data lakes to client stories of how they use these technologies.

Overall, it is an exciting time to be in the data warehousing and analytics space.  This conference represents a great opportunity to build depth on IBM products you already use, learn new data warehousing products, and look across IBM to learn completely new ways to employ analytics—from Watson to Internet of Things and much more.  I hope to see you there.

Get smart on IBM Data Warehousing at IBM Insight 2015

A quick reference guide to IBM Data Warehousing sessions for BLU Acceleration in-memory database, PureData System for Analytics and new IBM Fluid Query

by Cindy Russell, IBM Data Warehouse Marketing

IBM Insight is always educational and fun, and this year is no exception. Many IBM technical experts and IBM clients will be presenting on a range of topics. This is an excellent opportunity to learn more about IBM products you already use, as well as products and technologies that you don’t. Here is a summary view of some keynotes, breakout sessions and events to consider as you plan your schedule.

I have included my “editor’s pick” sessions in boldface type. You can use the Insight session tool to find more detail on the sessions that interest you. And for those of you who have already registered for Insight, build your agenda now by logging into ibmeventconnect.com/insight.  Please note that session schedules are subject to change.

General sessions and Data Warehousing overview sessions

  • Data Management Keynote is Monday October 26, from 1 – 2 PM in the Mandalay Ballroom

Monday breakout sessions

  • DDW-3353: The Evolution of Data Warehousing is “Logical”
  • DDW-3361: Shifts in Data Warehousing and Enabling Self Service to Drive More Agile Analytics
  • DDW-2267: Gartner Perspective on Big Data and Enterprise Analytics

Tuesday breakout sessions

  • DDW-3983: Ford is Changing the Way the World Moves With IBM Big Data and Analytics

Thursday breakout sessions

  • DDW-2675: Which Analytic Model is Right for My Data? A Comparison of Modern Warehouse Architectures
  • DDW-2659: The Data Reservoir: More Than Storage, Optimizing Your Data for Insight
  • DDW-2739: Operational Analytics at the Speed of Thought: The Modern Enterprise Data Warehouse
  • DDW-1951: Model Driven Approaches to Consistently Managing and Governing the Logical Data Warehouse

Expo Hall events and demos

In addition to breakout sessions, there will be some informal talks and opportunities to connect with our experts in the Expo Hall. Here are the sessions that apply to IBM Data Warehousing products. For Expo Hall hours click here.

Monday events and information

  • Expo Hall booth number: 860
  • VAL-4125: AMA: How IBM Fluid Query Solves Your Complex Big Data and Analytics Problems
  • VAL-4126: 20m Talk How IBM Fluid Query Solves Your Complex Big Data and Analytics Problems
  • Demo room: FE-06 Fluid Query, DCM-15 IBM PureData for Analytics (INZA), DCM-17 IBM Industry Data Model, DCM-19 IBM DB2 with BLU Acceleration

Tuesday events and information

  • Expo Hall booth number: 860
  • DDW-4031: Meet the Experts IBM DB2 BLU and dashDB
  • Demo room: FE-06 Fluid Query, DCM-15 IBM PureData for Analytics (INZA), DCM-17 IBM Industry Data Model, CM-19 IBM DB2 with BLU Acceleration

Wednesday events events and information

  • Expo Hall booth number: 860
  • DDW-4013: IBM Fluid Query – Unifying Data Access Across the Logical Data Warehouse
  • DDW-4079: Meet the Experts: IBM PureData System for Analytics (Netezza)
  • Demo room: FE-06 Fluid Query, DCM-15 IBM PureData for Analytics (INZA), DCM-17 IBM Industry Data Model, CM-19 IBM DB2 with BLU Acceleration

DB2 with BLU Acceleration in-memory database

BLU Acceleration is in-memory computing technology in DB2 for Linux, UNIX and Windows. If you are experiencing slow reporting on data in structured databases, then BLU Acceleration can help you deliver results much more quickly. Clients report that queries that used to take hours now process in seconds using BLU Acceleration technology!

Here are some sessions to consider:

Monday breakout sessions

  • DDW-2619: What’s New in BLU Acceleration Tips and Insights on the Latest In Memory Columnar Technologies

Tuesday breakout sessions

  • DDW-1202: Implementing a Data Warehouse and BI Solution with DB2 BLU Acceleration, InfoSphere and Cognos
  • DDW-3916: Revitalize your Data Warehouse: Taking Advantage of the Latest Technologies (client presentation from Blue Cross and Blue Shield of Tennessee)
  •  DDB-3593: Scaling Up BLU Acceleration with Consistent Performance in a High
  • DDB-2815: Advances in Analytics Using DB2 with BLU Acceleration on Intel Architecture

Wednesday breakout sessions

  • DDW-1647: A Comparison Between DB2 with BLU Acceleration and Other In Memory Databases
  • DDW-2436: POWER Systems Running DB2 with BLU Acceleration: Delivering Top Performance

Thursday breakout sessions

  • DDW-3665: Wall Street Success Stories of DB2 with BLU Acceleration
  • DDW-2469: How DB2 with BLU Acceleration Helps a Bank Make Money: A Real World Data Analytics Case Study
  • DDW-2972: Apache Spark and DB2 with BLU Acceleration: Making ‘People Flow’ in Cities Measurable and Analyzable

PureData System for Analytics and IBM Fluid Query

PureData System for Analytics is a data warehousing appliance that delivers data service to today’s demanding analytic applications. It is offers built-in expertise, as well as integrated hardware, software and storage capabilities specifically for high performance data workloads. It simplifies procurement, installation and management so you can focus on other high-value projects. IBM Fluid Query is a new addition to PureData that lets you analyze more data sources such as Hadoop and many others for deeper insights. You can also download the Enzee Conference Guide for a list of ALL sessions with PureData/Netezza content here: ibm.biz/enzeeguideinsight

Monday breakout sessions

  • DDW-3366: PureData for Analytics/Netezza Data Warehouse Appliance – Overview and Update
  • DDW-2663: IBM Fluid Query The “Power” Behind the Data Reservoir/Logical Data Warehouse
  • DDW-3500: How a Digital Media Firm Uses PureData System for Analytics, Cognos, SPSS to Hone Creative Marketing

Tuesday breakout sessions

  • DDW-1909: One Query Drives It All Fluid Hadoop in the Unified Data Warehouse
  • DDW-1150: Performance Optimization With IBM PureData System for Analytics, powered by Netezza
  • DDW-1216: Mattel’s Big Data Ecosystem Journey: Beginning The Integration of Unstructured Data
  • DDW-3588: BB&T and Netezza: Practical and Best Practices for Building an Analytics Platform
  • DDW-3094: N3001 001 Mini Appliance The Most Affordable PureData System for Analytics

Wednesday breakout sessions

  • DDW-1164: Business Outcomes and Implementation Strategy for Enterprise Data Warehouse in Healthcare
  • DDW-2150: Integrating BigInsights and PureData System for Analytics With Query Federation and Data Movement
  • DDW-1213: IBM PureData System for Analytics Successfully Changed How the Blackhawk Network Leverages Data
  • DDW-3073: Werner Implements Netezza and Information Server to Enable Smarter Decision Making
  • DDW-1723: Improving PureData System for Analytics Performance at Kimberly Clark
  • DDW-2145: Experian Case Study Conversion From SQL Server to Netezza
  • DDW-2109: How IBM Fluid Query Solves Your Complex Big Data and Analytics Problems

Thursday breakout sessions

  • DDW-3094: N3001 001 Mini Appliance The Most Affordable PureData System for Analytics
  • DDW-3369: Insight Into Your PureData System for Analytics Appliance Using IBM Netezza Performance Portal Tool
  • DDW-2515: Realizing Solutions with IBM PureData System for Analytics
  • DDW-1708: PureData System for Analytics for regulatory reports, what you need on the top of the top technology

Enzee Universe

Don’t miss Enzee Universe on Sunday, October 25th.  Enzee Universe is a conference within the Insight conference dedicated to a full day of PureData – Netezza technology.  This event is free for all registered Insight attendees. Just add sessions 3967 and 3968 to your agendas!

  • DDW-3967: Enzee Universe Part 1 Technical Sessions and Best Practices
  • DDW-3968: Enzee Universe Part 2 Business Update and Product Strategy

dashDB

IBM dashDB is a fully managed cloud data warehouse service. It offers massive scalability and performance through its MPP architecture, and is compatible with a wide range of business intelligence toolsets and analytics. dashDB’s integrated, in-database analytics let you quickly realize more value from your data. dashDB includes aspects of the Netezza and BLU Acceleration technologies.

Use the session tool to search on the dashDB keyword.

IBM DB2 Analytics Accelerator for z/OS

IBM DB2 Analytics Accelerator for z/OS is a high-performance appliance that integrates the IBM z Systems infrastructure with IBM PureData System for Analytics, powered by IBM Netezza technology. The solution transforms your mainframe into a highly-efficient transactional and analytics processing environment.

Learn more about the sessions for this product here.

 

IBM DB2 Analytics Accelerator: OLTP and OLAP in the same system at last! (Part two)

In my previous post, I introduced IBM DB2 Analytics Accelerator (Accelerator) and explained how it is capable of serving online analytical processing (OLAP) and online transaction processing (OLTP) queries at the same time. Now it is time to go into more detail and explain how it all works.

The DB2 optimizer is the key

The design concept is quite simple. The DB2 for z/OS optimizer is aware of DB2 Analytics Accelerator’s existence in a given environment and can execute a given query either on the DB2 Analytics Accelerator or by using the already well-known access paths within DB2 for z/OS. The DB2 optimizer decides which queries to direct to the Accelerator for hardware-accelerated parallel query processing, thus the Accelerator is essentially transparent to the applications and reporting tools querying DB2 for z/OS.

Deep DB2 Integration with z Systems

So, the DB2 optimizer determines whether a query is best suited to run utilizing symmetric multiprocessing (SMP), leveraging DB2 for z/OS; or the hardware-accelerated massively parallel processing (MPP) architecture delivered by the PureData System for Analytics, powered by Netezza technology. It chooses the best option transparently. There are essentially no changes to the way you query the DB2 system.

Query Execution Process Flow

After defining tables to be accelerated and then loading data into the Accelerator, you essentially have an environment that provides both an SMP and MPP “personality” to the same table. This allows you to leverage the legendary DB2 for z/OS qualities of service and performance for transactional queries, as well as Netezza performance for complex queries.

Complex queries are automatically routed by DB2 for processing by the Asymmetric Massively Parallel Processing (AMPP) engine, an architecture that uses special-purpose hardware accelerators (a multi-engine field-programmable gate array [FPGA]). These accelerators decompress and filter data for relevance to the query before it is loaded into memory and given to the processor for any necessary aggregation and final processing. This entire process is transparent to the application and user. The user only notices an improvement in the speed at which the query is resolved by the system, specifically the analytical ones. The system in general also benefits, because the analytical load is transferred out of DB2, and thus there is more capacity available to serve additional transactional queries. And keep this in mind: once a query is derived to be solved by the Accelerator, its execution does not consume MIPS.

High Performance Storage Saver

Once you have this system installed, you may use it for more than accelerating analytical queries. There are some interesting use cases that will help you obtain more benefits from your hybrid system, such as the High Performance Storage Saver.

High Performance Storage Saver: Store your historical data outside DB2 for z/OS, but maintain high speed analytical access to it.
High Performance Storage Saver: Store your historical data outside DB2 for z/OS,
but maintain high speed analytical access to it.

In this use case, you can save in Total Cost of Ownership (TCO) by using the Accelerator to store historical data to reduce storage costs on z Systems. This way, you are not consuming storage in your IBM z Systems. Instead, you are using the lower cost of storage in the DB2 Analytics Accelerator, while still being able to access that historical data and perform analysis on it. And this is the most interesting point . . . the historical data that you would typically take out of your mainframe due to the cost of storage in that system can now be explored online. You do not need to recover the tapes where you store the historical data to access it.

Simple is still better

Meanwhile, I encourage you to learn more about DB2 Analytics Accelerator, where you are leveraging the “simple is still better” design tenents of PureData System for Analytics And of course, I am more than happy to read about your opinions and see you share your experiences in the comments area below or join me in a conversation on Twitter.

See additional posts

IBM DB2 Analytics Accelerator: OLTP and OLAP in the same system at last! (Part one)

About Isaac,

Isaac Moreno NavarroIsaac is working as a data warehouse and Big Data technical pre-sales professional for IBM, covering customers in Spain and Portugal, where his special focus is on PureData for Analytics. He joined IBM in 2011, through the Netezza acquisition. Before that, he has held several positions in pre-sales and professional services in companies such as Oracle, Sun Microsystems, Netezza and other Spanish companies. During the years previous to working at IBM, he has acquired a diverse experience with different software tools (databases, identity management products, geographical information systems, manufacturing systems…) in a very diverse set of projects. He also holds a Master of Science Degree in Computer Science.

IBM DB2 Analytics Accelerator: OLTP and OLAP in the same system at last! (Part one)

By Isaac Moreno Navarro

With the advent of the data warehouse, the possibility of using the same infrastructure for online transaction processing (OLTP) as well as for online analytical processing (OLAP) has become a controversial subject. You will find that different database vendors have different points of view.

Let’s explore this topic by starting with a brief explanation of OLTP and OLAP.

Online transaction processing (OLTP)

This is the traditional way databases used to work – by placing small queries against a low number of rows and retrieving information. For instance, when you buy an airplane ticket, you check the open seats in a given flight and the price. To achieve this, several small queries are served by the database in a short period of time, and the data involved in the answer is a small set of the data stored.

Online analytical processing (OLAP)

In the case of OLAP, you send very heavy queries that need to process a huge amount of data in comparison to the total size of the database. You send fewer queries to your system, but very heavy ones. In our airline example, if you were working in marketing you might want to know how many people between 20 and 35 years old traveled from New York to Madrid during 2014, grouped by fares and describing how far in advance they purchased their tickets.

So, we have different uses for the same set of data. In this scenario, some database vendors offer a one size fits all solution, suggesting that just one machine is able to address such different workloads at the same time.

IBM Hybrid Approach to Transactional processing and analytics

Through IBM DB2 Analytics Accelerator, IBM supports a different approach. This DB2 Analytics Accelerator, together with DB2 for z/OS, form a self-managing, hybrid workload-optimized database management system that runs each query workload in the most efficient way. With this approach, you avoid the headaches involved with the configuration of a database designed for OLTP that is also trying to serve OLAP workloads. This is the main reason why many data warehouses are difficult to manage, expensive to maintain and require many people to tune them—while still producing frustrated end-users.

IBM DB2 Analytics Accelerator turns DB2 for z/OS into a universal database management system, capable of handling both transactional and analytical workloads.

 IBM DB2 Analytics Accelerator

IBM proposes the use of a hybrid environment where each query workload is executed in the most optimal environment for maximum speed, execution and cost efficiency. This hybrid infrastructure blends the best attributes of symmetric multiprocessing (SMP) leveraging DB2 for z/OS with the best attributes of the hardware-accelerated massively parallel processing (MPP) architecture delivered by Netezza technology.

The hybrid environment is enabled by the addition of the DB2 Analytics Accelerator, a high-performance appliance that integrates the z Systems infrastructure with PureData System for Analytics, powered by IBM Netezza technology.

And yes, it is only for DB2 for z/OS, at least for now.

This solution generally works as if you just added another access path  that is specialized for processing analytic queries to your mainframe. Because it is just like an additional access path, query processing happens transparently so that users and applications can send the very same DB2 query requests to the system, unchanged.

The interface for the end-user does not change at all. And when I talk about an “additional access path”, what I really mean is that we add the DB2 Analytics Accelerator to complement DB2 for z/OS, which is built for transactional workloads. The Accelerator provides a cost-effective high-speed query engine to run complex analytics workload. Therefore, IBM DB2 Analytics Accelerator turns DB2 for z/OS into a universal database management system, capable of handling both transactional and analytical workloads.

IBM DB2 Analytics Accelerator_image
Diagram of DB2 for z/OS and DB2 Analytics Accelerator for z/OS

 

As you can see, there are two different machines, each one solving different workload needs working as one system. As part of its unique design, the DB2 Analytics Accelerator includes breakthrough technologies to reroute complex, data-intensive queries to the integrated IBM PureData System for Analytics appliance. But the key point is that nothing has changed for the end user when compared to their traditional DB2 database, except that suddenly the analytical queries run much faster than before, with MIPS consumption decreasing. So, although you have two machines, they compound into a single system for the end users. And from the point of view of the administrators, there is no added complexity either.

DB2 Analytics Accelerator includes breakthrough technologies to reroute complex, data-intensive queries to the integrated IBM PureData System for Analytics appliance. But the key point is that nothing has changed for the end user when compared to their traditional DB2 database, except that suddenly the analytical queries run much faster than before . . .

In the words of one of our customers: “We are surprised how easy it is to manage such a system, it is really ‘plug-and-play’ and the results are awesome”.
This concludes my introduction. In following posts I’ll explain how DB2 Analytics Accelerator works, as well as real life experiences with it. To learn more, visit the DB2 Analytics Accelerator page on ibm.com.

Meanwhile, you can leave your comments, share your experience or join me on a conversation on Twitter.

See additional posts

IBM DB2 Analytics Accelerator: OLTP and OLAP in the same system at last! (part two)

About Isaac,

Isaac Moreno NavarroIsaac is working as a data warehouse and Big Data technical pre-sales professional for IBM, covering customers in Spain and Portugal, where his special focus is on PureData for Analytics. He joined IBM in 2011, through the Netezza acquisition. Before that, he has held several positions in pre-sales and professional services in companies such as Oracle, Sun Microsystems, Netezza and other Spanish companies. During the years previous to working at IBM, he has acquired a diverse experience with different software tools (databases, identity management products, geographical information systems, manufacturing systems…) in a very diverse set of projects. He also holds a Master of Science Degree in Computer Science.