Queries | Spark SQL access in Queries

We are excited to announce Spark SQL availability within the Query Editor for Datagrid Administrators and Datagrid Operators. Now, you can write and test Spark SQL directly in Amperity without running several pieces of the platform. Since Spark SQL is used throughout Amperity to process data, the ability to run queries using the same query engine means that you get to see the exact same query results that Amperity will see when running jobs, saving you time and toil.

Presto SQL remains the default engine for querying, but you now have the option of using Spark SQL as your query engine. Using Presto in queries to test SparkSQL was error-prone due to syntax and performance incongruities that were difficult to identify without running and/or failing multiple potentially costly jobs.

To get started, edit any query in the “Queries” tab. You will now have the option to select Spark SQL as your query engine in addition to Presto SQL. To use, simply start a Spark session and begin running Spark queries.