== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330, shardId#5594062]
Arguments: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330, shardId#5594062], [isnotnull(shardId#5594062), (shardId#5594062 = 0_1_10000001445), (size(quantityKpis#5595330, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594732L, originalReplenishmentRunId#5594735L, supplierGroup#5594742, supplier#5594743, supplyingPlant#5594773, productGroup#5594774, product#5594745, plant#5594746, subrange#5594744, orderDateTime#5594750, deliveryDateTime#5594751, availabilityDateTime#5594752, nextAvailabilityDateTime#5594753, constraintValues#5594767, constraintOperators#5594765, constraintLabels#5594764, logisticUnits#5594769, orderQuantityBaseUom#5594755, orderQuantityBaseUomUuid#5594756, splitIndicator#5594737L, netPriceAmount#5594760, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#5594062, items#5594064]
Arguments: [shardId#5594062, items#5594064], [(size(items#5594064, true) > 0), isnotnull(items#5594064)]
(4) InMemoryRelation
Arguments: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, optimizationInsights#5594068], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, optimizationInsights#5594068]
Arguments: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, optimizationInsights#5594068], [isnotnull(shardId#5594062), (shardId#5594062 = 0_1_10000001445)]
(6) InMemoryRelation
Arguments: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, lastModified#5594067, optimizationInsights#5594068], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, lastModified#5594067, optimizationInsights#5594068]
Arguments: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, lastModified#5594067, optimizationInsights#5594068], MapPartitionsRDD[394811] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, lastModified#5594067, optimizationInsights#5594068]
Condition : (isnotnull(shardId#5594062) AND (shardId#5594062 = 0_1_10000001445))
(9) Filter [codegen id : 1]
Input [6]: [shardId#5594062, orderProposalId#5594063L, items#5594064, optimizationGroups#5594065, isOptimal#5594066, optimizationInsights#5594068]
Condition : (isnotnull(shardId#5594062) AND (shardId#5594062 = 0_1_10000001445))
(10) Filter [codegen id : 3]
Input [2]: [shardId#5594062, items#5594064]
Condition : ((size(items#5594064, true) > 0) AND isnotnull(items#5594064))
(11) Generate [codegen id : 3]
Input [2]: [shardId#5594062, items#5594064]
Arguments: explode(items#5594064), [shardId#5594062], false, [item#5594573]
(12) Project [codegen id : 3]
Output [4]: [shardId#5594062, item#5594573.worklistShardItemId AS worklistShardItemId#5594574L, item#5594573.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#5594575, item#5594573.qty AS qty#5594576]
Input [2]: [shardId#5594062, item#5594573]
(13) Scan parquet
Output [38]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818, shardId#5594819, sequenceId#5594797]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000001445]
PartitionFilters: [isnotnull(shardId#5594819), isnotnull(sequenceId#5594797), (shardId#5594819 = 0_1_10000001445), (sequenceId#5594797 = 8)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818, shardId#5594819, sequenceId#5594797]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818, shardId#5594819, sequenceId#5594797]
Condition : isnotnull(worklistShardItemId#5594798L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818]
Input [38]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818, shardId#5594819, sequenceId#5594797]
(17) Exchange
Input [36]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818]
Arguments: hashpartitioning(worklistShardItemId#5594798L, 30), REPARTITION_BY_NUM, [plan_id=2903994]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#5594798L, orderProposalId#5594775L, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, originalReplenishmentRunId#5594817L, splitIndicator#5594794L, previousOrderProposal#5594795L, sourceOfSupplyUuid#5594789, supplierGroup#5594777, supplier#5594778, subrange#5594781, product#5594784, plant#5594779, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, isFallbackOrderOnly#5594792, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, netPriceAmount#5594811, netPriceCurrencyCode#5594812, measurements#5594816, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, logisticUnits#5594802, optimizationGroups#5594818, externalProductId#5594800, externalPlantId#5594801, supplyingPlant#5594782, productGroup#5594783]
Input [36]: [orderProposalId#5594775L, orderProposalItemId#5594776, supplierGroup#5594777, supplier#5594778, plant#5594779, deliveryDateTime#5594780, subrange#5594781, supplyingPlant#5594782, productGroup#5594783, product#5594784, orderDateTime#5594785, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, sourceOfSupplyUuid#5594789, isFallbackOrderOnly#5594792, splitIndicator#5594794L, previousOrderProposal#5594795L, worklistShardItemId#5594798L, orderProposalItemGroupId#5594799, externalProductId#5594800, externalPlantId#5594801, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, measurements#5594816, originalReplenishmentRunId#5594817L, optimizationGroups#5594818]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#5594798L, orderProposalId#5594775L, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, originalReplenishmentRunId#5594817L, splitIndicator#5594794L, previousOrderProposal#5594795L, sourceOfSupplyUuid#5594789, supplierGroup#5594777, supplier#5594778, subrange#5594781, product#5594784, plant#5594779, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, isFallbackOrderOnly#5594792, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, netPriceAmount#5594811, netPriceCurrencyCode#5594812, measurements#5594816, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, logisticUnits#5594802, optimizationGroups#5594818, externalProductId#5594800, externalPlantId#5594801, supplyingPlant#5594782, productGroup#5594783]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=2903998]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#5594574L]
Right keys [1]: [worklistShardItemId#5594798L]
Join type: LeftOuter
Join condition: (shardId#5594062 = 0_1_10000001445)
(21) Project [codegen id : 3]
Output [39]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792]
Input [40]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, worklistShardItemId#5594798L, orderProposalId#5594775L, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, originalReplenishmentRunId#5594817L, splitIndicator#5594794L, previousOrderProposal#5594795L, sourceOfSupplyUuid#5594789, supplierGroup#5594777, supplier#5594778, subrange#5594781, product#5594784, plant#5594779, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, isFallbackOrderOnly#5594792, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, netPriceAmount#5594811, netPriceCurrencyCode#5594812, measurements#5594816, minimumOrderQuantity#5594805, constraintLabels#5594806, constraintOperators#5594807, constraintValues#5594808, logisticUnits#5594802, optimizationGroups#5594818, externalProductId#5594800, externalPlantId#5594801, supplyingPlant#5594782, productGroup#5594783]
(22) Exchange
Input [39]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792]
Arguments: hashpartitioning(shardId#5594062, worklistShardItemId#5594574L, 30), ENSURE_REQUIREMENTS, [plan_id=2904003]
(23) Sort [codegen id : 4]
Input [39]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792]
Arguments: [shardId#5594062 ASC NULLS FIRST, worklistShardItemId#5594574L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#5595295, worklistShardItemId#5595296L, qty#5595297, demandChannel#5595298, demandStream#5595299, kpis#5595300]
Arguments: [shardId#5595295, worklistShardItemId#5595296L, qty#5595297, demandChannel#5595298, demandStream#5595299, kpis#5595300], MapPartitionsRDD[394871] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#5595295, worklistShardItemId#5595296L, qty#5595297, demandChannel#5595298, demandStream#5595299, kpis#5595300]
Condition : (((isnull(qty#5595297) AND isnull(demandChannel#5595298)) AND isnull(demandStream#5595299)) AND (isnotnull(shardId#5595295) AND isnotnull(worklistShardItemId#5595296L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#5595295, worklistShardItemId#5595296L, coalesce(kpis#5595300, []) AS prodLocSpecificKpis#5595301]
Input [6]: [shardId#5595295, worklistShardItemId#5595296L, qty#5595297, demandChannel#5595298, demandStream#5595299, kpis#5595300]
(27) Exchange
Input [3]: [shardId#5595295, worklistShardItemId#5595296L, prodLocSpecificKpis#5595301]
Arguments: hashpartitioning(shardId#5595295, worklistShardItemId#5595296L, 30), ENSURE_REQUIREMENTS, [plan_id=2904009]
(28) Sort [codegen id : 6]
Input [3]: [shardId#5595295, worklistShardItemId#5595296L, prodLocSpecificKpis#5595301]
Arguments: [shardId#5595295 ASC NULLS FIRST, worklistShardItemId#5595296L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#5594062, worklistShardItemId#5594574L]
Right keys [2]: [shardId#5595295, worklistShardItemId#5595296L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, coalesce(prodLocSpecificKpis#5595301, []) AS prodLocSpecificKpis#5595302]
Input [42]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, shardId#5595295, worklistShardItemId#5595296L, prodLocSpecificKpis#5595301]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#5595311, worklistShardItemId#5595312L, qty#5595313, demandChannel#5595314, demandStream#5595315, kpis#5595316]
Arguments: [shardId#5595311, worklistShardItemId#5595312L, qty#5595313, demandChannel#5595314, demandStream#5595315, kpis#5595316], MapPartitionsRDD[394871] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#5595311, worklistShardItemId#5595312L, qty#5595313, demandChannel#5595314, demandStream#5595315, kpis#5595316]
Condition : ((((isnull(qty#5595313) AND isnotnull(demandChannel#5595314)) AND isnotnull(demandStream#5595315)) AND (size(kpis#5595316, true) > 0)) AND (isnotnull(shardId#5595311) AND isnotnull(worklistShardItemId#5595312L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#5595311, worklistShardItemId#5595312L, demandChannel#5595314, demandStream#5595315, kpis#5595316]
Input [6]: [shardId#5595311, worklistShardItemId#5595312L, qty#5595313, demandChannel#5595314, demandStream#5595315, kpis#5595316]
(34) ObjectHashAggregate
Input [5]: [shardId#5595311, worklistShardItemId#5595312L, demandChannel#5595314, demandStream#5595315, kpis#5595316]
Keys [2]: [shardId#5595311, worklistShardItemId#5595312L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#5595314, demandStream, demandStream#5595315, kpis, kpis#5595316), 0, 0)]
Aggregate Attributes [1]: [buf#5595491]
Results [3]: [shardId#5595311, worklistShardItemId#5595312L, buf#5595492]
(35) Exchange
Input [3]: [shardId#5595311, worklistShardItemId#5595312L, buf#5595492]
Arguments: hashpartitioning(shardId#5595311, worklistShardItemId#5595312L, 30), ENSURE_REQUIREMENTS, [plan_id=2904020]
(36) ObjectHashAggregate
Input [3]: [shardId#5595311, worklistShardItemId#5595312L, buf#5595492]
Keys [2]: [shardId#5595311, worklistShardItemId#5595312L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#5595314, demandStream, demandStream#5595315, kpis, kpis#5595316), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#5595314, demandStream, demandStream#5595315, kpis, kpis#5595316), 0, 0)#5595310]
Results [3]: [shardId#5595311, worklistShardItemId#5595312L, collect_list(struct(demandChannel, demandChannel#5595314, demandStream, demandStream#5595315, kpis, kpis#5595316), 0, 0)#5595310 AS channelStreamSpecificKpis#5595303]
(37) Sort [codegen id : 9]
Input [3]: [shardId#5595311, worklistShardItemId#5595312L, channelStreamSpecificKpis#5595303]
Arguments: [shardId#5595311 ASC NULLS FIRST, worklistShardItemId#5595312L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#5594062, worklistShardItemId#5594574L]
Right keys [2]: [shardId#5595311, worklistShardItemId#5595312L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, prodLocSpecificKpis#5595302, coalesce(channelStreamSpecificKpis#5595303, []) AS channelStreamSpecificKpis#5595317]
Input [43]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, prodLocSpecificKpis#5595302, shardId#5595311, worklistShardItemId#5595312L, channelStreamSpecificKpis#5595303]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, demandChannel#5595327, demandStream#5595328, kpis#5595329]
Arguments: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, demandChannel#5595327, demandStream#5595328, kpis#5595329], MapPartitionsRDD[394871] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, demandChannel#5595327, demandStream#5595328, kpis#5595329]
Condition : ((isnotnull(qty#5595326) AND isnotnull(kpis#5595329)) AND (isnotnull(shardId#5595324) AND isnotnull(worklistShardItemId#5595325L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, kpis#5595329]
Input [6]: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, demandChannel#5595327, demandStream#5595328, kpis#5595329]
(43) ObjectHashAggregate
Input [4]: [shardId#5595324, worklistShardItemId#5595325L, qty#5595326, kpis#5595329]
Keys [2]: [shardId#5595324, worklistShardItemId#5595325L]
Functions [1]: [partial_collect_list(struct(qty, qty#5595326, kpis, kpis#5595329), 0, 0)]
Aggregate Attributes [1]: [buf#5595493]
Results [3]: [shardId#5595324, worklistShardItemId#5595325L, buf#5595494]
(44) Exchange
Input [3]: [shardId#5595324, worklistShardItemId#5595325L, buf#5595494]
Arguments: hashpartitioning(shardId#5595324, worklistShardItemId#5595325L, 30), ENSURE_REQUIREMENTS, [plan_id=2904032]
(45) ObjectHashAggregate
Input [3]: [shardId#5595324, worklistShardItemId#5595325L, buf#5595494]
Keys [2]: [shardId#5595324, worklistShardItemId#5595325L]
Functions [1]: [collect_list(struct(qty, qty#5595326, kpis, kpis#5595329), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#5595326, kpis, kpis#5595329), 0, 0)#5595323]
Results [3]: [shardId#5595324, worklistShardItemId#5595325L, map_from_entries(collect_list(struct(qty, qty#5595326, kpis, kpis#5595329), 0, 0)#5595323) AS quantityKpis#5595318]
(46) Sort [codegen id : 12]
Input [3]: [shardId#5595324, worklistShardItemId#5595325L, quantityKpis#5595318]
Arguments: [shardId#5595324 ASC NULLS FIRST, worklistShardItemId#5595325L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#5594062, worklistShardItemId#5594574L]
Right keys [2]: [shardId#5595324, worklistShardItemId#5595325L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, prodLocSpecificKpis#5595302, channelStreamSpecificKpis#5595317, coalesce(quantityKpis#5595318, map(keys: [], values: [])) AS quantityKpis#5595330]
Input [44]: [shardId#5594062, worklistShardItemId#5594574L, quantityAfterProdPlantOptimization#5594575, qty#5594576, orderProposalId#5594775L, originalReplenishmentRunId#5594817L, supplierGroup#5594777, supplier#5594778, supplyingPlant#5594782, productGroup#5594783, product#5594784, plant#5594779, subrange#5594781, orderDateTime#5594785, deliveryDateTime#5594780, availabilityDateTime#5594786, nextAvailabilityDateTime#5594787, constraintValues#5594808, constraintOperators#5594807, constraintLabels#5594806, logisticUnits#5594802, orderQuantityBaseUom#5594803, orderQuantityBaseUomUuid#5594804, splitIndicator#5594794L, netPriceAmount#5594811, netPriceCurrencyCode#5594812, netPriceQuantity#5594813, netPriceQuantityUom#5594814, netPriceQuantityUomUuid#5594815, sourceOfSupplyUuid#5594789, minimumOrderQuantity#5594805, orderProposalItemId#5594776, orderProposalItemGroupId#5594799, optimizationGroups#5594818, measurements#5594816, externalProductId#5594800, externalPlantId#5594801, previousOrderProposal#5594795L, isFallbackOrderOnly#5594792, prodLocSpecificKpis#5595302, channelStreamSpecificKpis#5595317, shardId#5595324, worklistShardItemId#5595325L, quantityKpis#5595318]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330, shardId#5594062]
Condition : ((isnotnull(shardId#5594062) AND (shardId#5594062 = 0_1_10000001445)) AND (size(quantityKpis#5595330, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330]
Input [4]: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330, shardId#5594062]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#5594732L, orderProposalItemId#5594733, quantityKpis#5595330]
Arguments: explode(quantityKpis#5595330), [orderProposalId#5594732L, orderProposalItemId#5594733], false, [orderQuantityInBaseUnit#5598914, kpis#5598915]
(52) Project
Output [7]: [orderProposalId#5594732L, cast(orderProposalItemId#5594733 as bigint) AS orderProposalItemId#5598913L, orderQuantityInBaseUnit#5598914, filter(kpis#5598915, lambdafunction((lambda x_11069#5598917.label = ServiceLevel), lambda x_11069#5598917, false))[0].value AS serviceLevel#5598916, filter(kpis#5598915, lambdafunction((lambda x_11070#5598919.label = RangeOfCoverage), lambda x_11070#5598919, false))[0].value AS rangeOfCoverage#5598918, filter(kpis#5598915, lambdafunction((lambda x_11071#5598921.label = ServiceLevelAtStartOfDelisting), lambda x_11071#5598921, false))[0].value AS serviceLevelAtEndOfListing#5598920, 10000001445 AS replenishmentRunId#5598923L]
Input [4]: [orderProposalId#5594732L, orderProposalItemId#5594733, orderQuantityInBaseUnit#5598914, kpis#5598915]
(53) WriteFiles
Input [7]: [orderProposalId#5594732L, orderProposalItemId#5598913L, orderQuantityInBaseUnit#5598914, serviceLevel#5598916, rangeOfCoverage#5598918, serviceLevelAtEndOfListing#5598920, replenishmentRunId#5598923L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=8, false, Parquet, [path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=8], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]