RDD Storage Info for *(3) Project [shardId#5589212, worklistShardItemId#5589290L, version#5589299, product#5589360, plant#5589355, availabilityDateTime#5589362 AS periodStart#5589399, nextAvailabilityDateTime#5589363 AS periodEnd#5589400, qty#5589295] +- *(3) BroadcastHashJoin [worklistShardItemId#5589290L], [worklistShardItemId#5589374L], LeftOuter, BuildRight, (shardId#5589212 = 0_1_10000001445), false :- *(3) Project [shardId#5589212, worklistShardItemId#5589290L, qty#5589295, element_at([11], ((cast(array_position([0_1_10000001445], shardId#5589212) as int) - 1) + 1), None, false) AS version#5589299] : +- *(3) Generate explode(requestedQuantities#5589293), [shardId#5589212, worklistShardItemId#5589290L], false, [qty#5589295] : +- *(3) Project [shardId#5589212, item#5589289.worklistShardItemId AS worklistShardItemId#5589290L, item#5589289.requestedQuantities AS requestedQuantities#5589293] : +- *(3) Filter ((size(item#5589289.requestedQuantities, true) > 0) AND isnotnull(item#5589289.requestedQuantit...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 30
  • Total Partitions: 30
  • Memory Size: 1990.0 B
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.31:7079 441.0 B (-2147497440.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.18.37:7079 848.0 B (-2280089595.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.11.45:7079 701.0 B (-1097799921.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

30 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_394323_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_5 Memory Serialized 2x Replicated 772.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_29 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_21 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_17 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_16 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_14 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394323_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_11 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_10 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394323_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394323_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
Page: