[AUDIT] [SPARK-50229] change allattributes from lazy val to def #11861
Labels
audit
General label for audit related tasks
bug
Something isn't working
Spark 4.0+
Spark 4.0+ issues
Describe the bug
[SPARK-50229] Reduce memory usage on driver for wide schemas by reducing the lifetime of AttributeReference objects created during logical planning apache/spark@4771638b3a6
In the above Spark commit, the
allAttributes
inQueryPlan
to be adef
instead of alazy val
. This affects the implementation of the expressions on the Plugin side.For example
spark-rapids/sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuAggregateExec.scala
Line 2016 in b471bd7
lazy val
.We need to fix that definition to match Spark4.0
The text was updated successfully, but these errors were encountered: