Apache Ignite Changes SQL Engine
Written by Kay Ewbank   
Thursday, 05 May 2022

Apache Ignite has been updated to use a new SQL engine based on Apache Calcite, and new 'read repair' strategies.

Ignite can be used as a traditional SQL database via JDBC drivers, ODBC drivers, or its own native SQL APIs. By default, it runs purely in-memory, but clusters can be configured to run on a mix of disk and memory. It supports co--located compute in Java, Scala, Kotlin, C#, and C++.

ignite

Apache Calcite is s a dynamic data management framework.It contains many of the pieces that comprise a typical database management system, but omits some key functions: storage of data, algorithms to process data, and a repository for storing metadata. Calcite includes a SQL parser, an API for building expressions in relational algebra, and a query planning engine.

The new experimental SQL engine based on Apache Calcite aims to remove some of the limitations of the existing H2 SQL engine, and to optimize the execution of some queries.

The current H2-based engine has fundamental limitations, including a limit on query splitting to two phases - map subquery and reduce subquery. H2's optimizer is also not written to work in a distributed environment, and the creators of H2 often decline Ignite-specific changes to the H2 code.

The Apache Calcite is a SQL engine with customizable modules, and query requests can be split into more than two phases.

Another improvement to the new version is to the read repair strategies. Read repair refers to the task of repairing inconsistencies between primary and backup copies of data during normal read operations. The new read repair strategies can be set to one of a number of options, including LWW (Last Write Wins), the value from the primary node wins. and values found more often than any other wins. Users can also choose to remove inconsistent entries.

Apache Ignite 2.13 is available now. ignite

More Information

Apache Ignite Website

Apache Calcite Website

Related Articles

Apache Ignite Adds Change Data Capture

Apache Ignite Adds Spark DataFrames Support

Spark 3 Improves Python and SQL Support

Apache Superset Reaches Top Level Project Status

Apache Daffodil Now Top Level Project

Facebook Apollo NoSQL Database 

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


What's New With Spot
22/05/2022

From nuclear environments to construction sites to manufacturing facilities, Boston Robotic's Spot quadruped robot is proving that agile mobile robots can have a useful role in a wide range of applica [ ... ]



Striim Launched On Google Cloud
19/05/2022

A new service that offers Google Cloud customers real-time streaming data integration and analytics has been launched by Striim. Striim Cloud on Google Cloud is claimed to be the fastest way for custo [ ... ]


More News

pythondata

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 05 May 2022 )