== Physical Plan ==
CollectLimit (8)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (7)
+- * Generate (6)
+- * Project (5)
+- * Filter (4)
+- * Scan ExistingRDD (3)
(1) InMemoryTableScan
Output: []
(2) InMemoryRelation
Arguments: [shardId#6607381, worklistShardItemId#6607390L], StorageLevel(disk, memory, 2 replicas)
(3) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#6607381, orderProposalId#6607382L, items#6607383, optimizationGroups#6607384, isOptimal#6607385, lastModified#6607386, optimizationInsights#6607387]
Arguments: [shardId#6607381, orderProposalId#6607382L, items#6607383, optimizationGroups#6607384, isOptimal#6607385, lastModified#6607386, optimizationInsights#6607387], MapPartitionsRDD[467677] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(4) Filter [codegen id : 1]
Input [7]: [shardId#6607381, orderProposalId#6607382L, items#6607383, optimizationGroups#6607384, isOptimal#6607385, lastModified#6607386, optimizationInsights#6607387]
Condition : ((isnotnull(shardId#6607381) AND ((shardId#6607381 = 0_1_10000002290) AND (isOptimal#6607385 <=> false))) AND ((size(items#6607383.worklistShardItemId, true) > 0) AND isnotnull(items#6607383.worklistShardItemId)))
(5) Project [codegen id : 1]
Output [2]: [shardId#6607381, items#6607383.worklistShardItemId AS _extract_worklistShardItemId#6607393]
Input [7]: [shardId#6607381, orderProposalId#6607382L, items#6607383, optimizationGroups#6607384, isOptimal#6607385, lastModified#6607386, optimizationInsights#6607387]
(6) Generate [codegen id : 1]
Input [2]: [shardId#6607381, _extract_worklistShardItemId#6607393]
Arguments: explode(_extract_worklistShardItemId#6607393), [shardId#6607381], false, [item#6607389L]
(7) Project [codegen id : 1]
Output [2]: [shardId#6607381, item#6607389L AS worklistShardItemId#6607390L]
Input [2]: [shardId#6607381, item#6607389L]
(8) CollectLimit
Input: []
Arguments: 1