| Parameters | Default | Note |
|---|
| spark.auron.enable | true | Enable/disable auron engine. |
| spark.auron.batchSize | 10000 | Suggested batch size for arrow batches. |
| spark.auron.memoryFraction | 0.6 | Suggested fraction of off-heap memory used in native execution. Actual off-heap memory usage is expected to be spark.executor.memoryOverhead * fraction. |
| spark.auron.tokio.num.worker.threads | 1 | Number of worker threads used in tokio runtime, 0 to use default available parallelism value. For CPUs those support hyperthreading, it is recommended to set this value to the number of available physical cores. |
| spark.auron.enableInputBatchStatistics | true | Enable extra metrics of input batch statistics. |
| spark.auron.partialAggSkipping.enable | true | Enable partial aggregate skipping. (see https://github.com/apache/auron/issues/327) |
| spark.auron.partialAggSkipping.ratio | 0.8 | Partial aggregate skipping ratio. |
| spark.auron.partialAggSkipping.minRows | 20000 | Minimum number of rows to trigger partial aggregate skipping. |
| spark.auron.parquet.enable.pageFiltering | false | Parquet enable page filtering. |
| spark.auron.parquet.enable.bloomFilter | false | Parquet enable bloom filter. |
| spark.auron.forceShuffledHashJoin | false | Replace all sort-merge join to shuffled-hash join, only used for special benchmarking. |
| Parameters | Default | Note |
|---|
| spark.auron.enable.scan | true | Enable/disable auron engine for scan. |
| spark.auron.enable.project | true | Enable/disable converting ProjectExec to NativeProject." |
| spark.auron.enable.filter | true | Enable/disable converting FilterExec to NativeFilter. |
| spark.auron.enable.sort | true | Enable/disable converting SortExec to NativeSort. |
| spark.auron.enable.union | true | Enable/disable converting UnionExec to NativeUnion. |
| spark.auron.enable.smj | true | Enable/disable converting SortMergeJoinExec to NativeSortMergeJoin. |
| spark.auron.enable.shj | true | Enable/disable converting ShuffledHashJoinExec to NativeShuffledHashJoin. |
| spark.auron.enable.bhj | true | Enable/disable converting BroadcastHashJoinExec to NativeBroadcastHashJoin. |
| spark.auron.enable.bnlj | true | Enable/disable converting BroadcastNestedLoopJoinExec to NativeBroadcastNestedLoopJoin. |
| spark.auron.enable.local.limit | true | Enable/disable converting LocalLimitExec to NativeLocalLimit. |
| spark.auron.enable.global.limit | true | Enable/disable converting GlobalLimitExec to NativeGlobalLimit. |
| spark.auron.enable.take.ordered.and.project | true | Enable/disable converting TakeOrderedAndProjectExec to NativeTakeOrderedAndProject. |
| spark.auron.enable.aggr | true | Enable/disable converting HashAggregateExec/ObjectHashAggregateExec/SortAggregateExec to NativeAggregate. |
| spark.auron.enable.expand | true | Enable/disable converting ExpandExec to NativeExpand. |
| spark.auron.enable.window | true | Enable/disable converting WindowExec to NativeWindow. |
| spark.auron.enable.generate | true | Enable/disable converting GenerateExec to NativeGenerate. |
| spark.auron.enable.local.table.scan | true | Enable/disable converting LocalTableScanExec to NativeLocalTableScan. |
| spark.auron.enable.data.writing | false | Enable/disable converting DataWritingCommandExec to NativeDataWritingCommand. |
