== Physical Plan ==
CollectLimit (8)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (7)
+- * Generate (6)
+- * Project (5)
+- * Filter (4)
+- * Scan ExistingRDD (3)
(1) InMemoryTableScan
Output: []
(2) InMemoryRelation
Arguments: [shardId#5566384, worklistShardItemId#5566393L], StorageLevel(disk, memory, 2 replicas)
(3) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#5566384, orderProposalId#5566385L, items#5566386, optimizationGroups#5566387, isOptimal#5566388, lastModified#5566389, optimizationInsights#5566390]
Arguments: [shardId#5566384, orderProposalId#5566385L, items#5566386, optimizationGroups#5566387, isOptimal#5566388, lastModified#5566389, optimizationInsights#5566390], MapPartitionsRDD[391760] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(4) Filter [codegen id : 1]
Input [7]: [shardId#5566384, orderProposalId#5566385L, items#5566386, optimizationGroups#5566387, isOptimal#5566388, lastModified#5566389, optimizationInsights#5566390]
Condition : ((isnotnull(shardId#5566384) AND ((shardId#5566384 = 0_1_10000001445) AND (isOptimal#5566388 <=> false))) AND ((size(items#5566386.worklistShardItemId, true) > 0) AND isnotnull(items#5566386.worklistShardItemId)))
(5) Project [codegen id : 1]
Output [2]: [shardId#5566384, items#5566386.worklistShardItemId AS _extract_worklistShardItemId#5566396]
Input [7]: [shardId#5566384, orderProposalId#5566385L, items#5566386, optimizationGroups#5566387, isOptimal#5566388, lastModified#5566389, optimizationInsights#5566390]
(6) Generate [codegen id : 1]
Input [2]: [shardId#5566384, _extract_worklistShardItemId#5566396]
Arguments: explode(_extract_worklistShardItemId#5566396), [shardId#5566384], false, [item#5566392L]
(7) Project [codegen id : 1]
Output [2]: [shardId#5566384, item#5566392L AS worklistShardItemId#5566393L]
Input [2]: [shardId#5566384, item#5566392L]
(8) CollectLimit
Input: []
Arguments: 1