RDD Storage Info for ObjectHashAggregate(keys=[shardId#5594062, resultSeparationId#5597941L], functions=[collect_list(orderProposal#5596205, 0, 0)], output=[shardId#5594062, resultSeparationId#5597941L, orderProposals#5597945]) +- Exchange hashpartitioning(shardId#5594062, resultSeparationId#5597941L, 30), ENSURE_REQUIREMENTS, [plan_id=2904443] +- ObjectHashAggregate(keys=[shardId#5594062, resultSeparationId#5597941L], functions=[partial_collect_list(orderProposal#5596205, 0, 0)], output=[shardId#5594062, resultSeparationId#5597941L, buf#5597981]) +- Project [shardId#5594062, orderProposal#5596205, CASE WHEN (size(orderProposal#5596205.parentItems, true) > 2000) THEN xxhash64(orderProposal#5596205.orderProposalId, 42) ELSE xxhash64(pmod(cast(orderProposal#5596205.orderProposalId as decimal(20,0)), 0), 42) END AS resultSeparationId#5597941L] +- InMemoryTableScan [orderProposal#5596205, shardId#5594062] +- InMemoryRelation [shardId#5594062, orderProposal#5596205], StorageLevel(disk, memory, 2 rep...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 30
  • Total Partitions: 30
  • Memory Size: 1260.0 B
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.31:7079 504.0 B (-2147497440.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.18.37:7079 462.0 B (-2280089595.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.11.45:7079 294.0 B (-1097799921.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

30 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_394979_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394979_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_29 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394979_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_21 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394979_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394979_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_17 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_16 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_14 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.20.31:7079
rdd_394979_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
rdd_394979_11 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_10 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.18.37:7079 10.96.20.31:7079
rdd_394979_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.11.45:7079 10.96.18.37:7079
Page: