Turi Create  4.0
turi::query_eval::opt_merge_all_same_sarrays Class Reference

#include <core/storage/query_engine/planning/optimizations/source_transforms.hpp>

Detailed Description

This optimization scans the entire graph for duplicate sarrays, including inside of sframes, and then merges them, using projects to keep things consistent.

THis works by:

  1. If it's the tip node of the tree to be optimized, it goes through and makes a list of all source nodes. sframe sources are assumed to be a collection of sarray sources.
  2. Identical sarrays are merged. If they are part of sframes, the two sframes are merged together, with a project transform following them for each of the outputs.
  3. Other identical source nodes (e.g. range nodes) are merged.

Definition at line 38 of file source_transforms.hpp.


The documentation for this class was generated from the following file: