== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444, shardId#5499000]
Arguments: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444, shardId#5499000], [isnotnull(shardId#5499000), (shardId#5499000 = 0_1_10000001445), (size(quantityKpis#5500444, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499670L, originalReplenishmentRunId#5499673L, supplierGroup#5499680, supplier#5499681, supplyingPlant#5499711, productGroup#5499712, product#5499683, plant#5499684, subrange#5499682, orderDateTime#5499688, deliveryDateTime#5499689, availabilityDateTime#5499690, nextAvailabilityDateTime#5499691, constraintValues#5499705, constraintOperators#5499703, constraintLabels#5499702, logisticUnits#5499707, orderQuantityBaseUom#5499693, orderQuantityBaseUomUuid#5499694, splitIndicator#5499675L, netPriceAmount#5499698, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#5499000, items#5499002]
Arguments: [shardId#5499000, items#5499002], [(size(items#5499002, true) > 0), isnotnull(items#5499002)]
(4) InMemoryRelation
Arguments: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, optimizationInsights#5499006], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, optimizationInsights#5499006]
Arguments: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, optimizationInsights#5499006], [isnotnull(shardId#5499000), (shardId#5499000 = 0_1_10000001445)]
(6) InMemoryRelation
Arguments: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, lastModified#5499005, optimizationInsights#5499006], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, lastModified#5499005, optimizationInsights#5499006]
Arguments: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, lastModified#5499005, optimizationInsights#5499006], MapPartitionsRDD[387429] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, lastModified#5499005, optimizationInsights#5499006]
Condition : (isnotnull(shardId#5499000) AND (shardId#5499000 = 0_1_10000001445))
(9) Filter [codegen id : 1]
Input [6]: [shardId#5499000, orderProposalId#5499001L, items#5499002, optimizationGroups#5499003, isOptimal#5499004, optimizationInsights#5499006]
Condition : (isnotnull(shardId#5499000) AND (shardId#5499000 = 0_1_10000001445))
(10) Filter [codegen id : 3]
Input [2]: [shardId#5499000, items#5499002]
Condition : ((size(items#5499002, true) > 0) AND isnotnull(items#5499002))
(11) Generate [codegen id : 3]
Input [2]: [shardId#5499000, items#5499002]
Arguments: explode(items#5499002), [shardId#5499000], false, [item#5499511]
(12) Project [codegen id : 3]
Output [4]: [shardId#5499000, item#5499511.worklistShardItemId AS worklistShardItemId#5499512L, item#5499511.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#5499513, item#5499511.qty AS qty#5499514]
Input [2]: [shardId#5499000, item#5499511]
(13) Scan parquet
Output [38]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756, shardId#5499757, sequenceId#5499735]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000001445]
PartitionFilters: [isnotnull(shardId#5499757), isnotnull(sequenceId#5499735), (shardId#5499757 = 0_1_10000001445), (sequenceId#5499735 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756, shardId#5499757, sequenceId#5499735]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756, shardId#5499757, sequenceId#5499735]
Condition : isnotnull(worklistShardItemId#5499736L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756]
Input [38]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756, shardId#5499757, sequenceId#5499735]
(17) Exchange
Input [36]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756]
Arguments: hashpartitioning(worklistShardItemId#5499736L, 30), REPARTITION_BY_NUM, [plan_id=2853795]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#5499736L, orderProposalId#5499713L, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, originalReplenishmentRunId#5499755L, splitIndicator#5499732L, previousOrderProposal#5499733L, sourceOfSupplyUuid#5499727, supplierGroup#5499715, supplier#5499716, subrange#5499719, product#5499722, plant#5499717, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, isFallbackOrderOnly#5499730, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, netPriceAmount#5499749, netPriceCurrencyCode#5499750, measurements#5499754, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, logisticUnits#5499740, optimizationGroups#5499756, externalProductId#5499738, externalPlantId#5499739, supplyingPlant#5499720, productGroup#5499721]
Input [36]: [orderProposalId#5499713L, orderProposalItemId#5499714, supplierGroup#5499715, supplier#5499716, plant#5499717, deliveryDateTime#5499718, subrange#5499719, supplyingPlant#5499720, productGroup#5499721, product#5499722, orderDateTime#5499723, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, sourceOfSupplyUuid#5499727, isFallbackOrderOnly#5499730, splitIndicator#5499732L, previousOrderProposal#5499733L, worklistShardItemId#5499736L, orderProposalItemGroupId#5499737, externalProductId#5499738, externalPlantId#5499739, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, measurements#5499754, originalReplenishmentRunId#5499755L, optimizationGroups#5499756]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#5499736L, orderProposalId#5499713L, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, originalReplenishmentRunId#5499755L, splitIndicator#5499732L, previousOrderProposal#5499733L, sourceOfSupplyUuid#5499727, supplierGroup#5499715, supplier#5499716, subrange#5499719, product#5499722, plant#5499717, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, isFallbackOrderOnly#5499730, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, netPriceAmount#5499749, netPriceCurrencyCode#5499750, measurements#5499754, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, logisticUnits#5499740, optimizationGroups#5499756, externalProductId#5499738, externalPlantId#5499739, supplyingPlant#5499720, productGroup#5499721]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=2853799]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#5499512L]
Right keys [1]: [worklistShardItemId#5499736L]
Join type: LeftOuter
Join condition: (shardId#5499000 = 0_1_10000001445)
(21) Project [codegen id : 3]
Output [39]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730]
Input [40]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, worklistShardItemId#5499736L, orderProposalId#5499713L, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, originalReplenishmentRunId#5499755L, splitIndicator#5499732L, previousOrderProposal#5499733L, sourceOfSupplyUuid#5499727, supplierGroup#5499715, supplier#5499716, subrange#5499719, product#5499722, plant#5499717, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, isFallbackOrderOnly#5499730, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, netPriceAmount#5499749, netPriceCurrencyCode#5499750, measurements#5499754, minimumOrderQuantity#5499743, constraintLabels#5499744, constraintOperators#5499745, constraintValues#5499746, logisticUnits#5499740, optimizationGroups#5499756, externalProductId#5499738, externalPlantId#5499739, supplyingPlant#5499720, productGroup#5499721]
(22) Exchange
Input [39]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730]
Arguments: hashpartitioning(shardId#5499000, worklistShardItemId#5499512L, 30), ENSURE_REQUIREMENTS, [plan_id=2853804]
(23) Sort [codegen id : 4]
Input [39]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730]
Arguments: [shardId#5499000 ASC NULLS FIRST, worklistShardItemId#5499512L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#5500409, worklistShardItemId#5500410L, qty#5500411, demandChannel#5500412, demandStream#5500413, kpis#5500414]
Arguments: [shardId#5500409, worklistShardItemId#5500410L, qty#5500411, demandChannel#5500412, demandStream#5500413, kpis#5500414], MapPartitionsRDD[387503] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#5500409, worklistShardItemId#5500410L, qty#5500411, demandChannel#5500412, demandStream#5500413, kpis#5500414]
Condition : (((isnull(qty#5500411) AND isnull(demandChannel#5500412)) AND isnull(demandStream#5500413)) AND (isnotnull(shardId#5500409) AND isnotnull(worklistShardItemId#5500410L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#5500409, worklistShardItemId#5500410L, coalesce(kpis#5500414, []) AS prodLocSpecificKpis#5500415]
Input [6]: [shardId#5500409, worklistShardItemId#5500410L, qty#5500411, demandChannel#5500412, demandStream#5500413, kpis#5500414]
(27) Exchange
Input [3]: [shardId#5500409, worklistShardItemId#5500410L, prodLocSpecificKpis#5500415]
Arguments: hashpartitioning(shardId#5500409, worklistShardItemId#5500410L, 30), ENSURE_REQUIREMENTS, [plan_id=2853810]
(28) Sort [codegen id : 6]
Input [3]: [shardId#5500409, worklistShardItemId#5500410L, prodLocSpecificKpis#5500415]
Arguments: [shardId#5500409 ASC NULLS FIRST, worklistShardItemId#5500410L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#5499000, worklistShardItemId#5499512L]
Right keys [2]: [shardId#5500409, worklistShardItemId#5500410L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, coalesce(prodLocSpecificKpis#5500415, []) AS prodLocSpecificKpis#5500416]
Input [42]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, shardId#5500409, worklistShardItemId#5500410L, prodLocSpecificKpis#5500415]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#5500425, worklistShardItemId#5500426L, qty#5500427, demandChannel#5500428, demandStream#5500429, kpis#5500430]
Arguments: [shardId#5500425, worklistShardItemId#5500426L, qty#5500427, demandChannel#5500428, demandStream#5500429, kpis#5500430], MapPartitionsRDD[387503] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#5500425, worklistShardItemId#5500426L, qty#5500427, demandChannel#5500428, demandStream#5500429, kpis#5500430]
Condition : ((((isnull(qty#5500427) AND isnotnull(demandChannel#5500428)) AND isnotnull(demandStream#5500429)) AND (size(kpis#5500430, true) > 0)) AND (isnotnull(shardId#5500425) AND isnotnull(worklistShardItemId#5500426L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#5500425, worklistShardItemId#5500426L, demandChannel#5500428, demandStream#5500429, kpis#5500430]
Input [6]: [shardId#5500425, worklistShardItemId#5500426L, qty#5500427, demandChannel#5500428, demandStream#5500429, kpis#5500430]
(34) ObjectHashAggregate
Input [5]: [shardId#5500425, worklistShardItemId#5500426L, demandChannel#5500428, demandStream#5500429, kpis#5500430]
Keys [2]: [shardId#5500425, worklistShardItemId#5500426L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#5500428, demandStream, demandStream#5500429, kpis, kpis#5500430), 0, 0)]
Aggregate Attributes [1]: [buf#5500605]
Results [3]: [shardId#5500425, worklistShardItemId#5500426L, buf#5500606]
(35) Exchange
Input [3]: [shardId#5500425, worklistShardItemId#5500426L, buf#5500606]
Arguments: hashpartitioning(shardId#5500425, worklistShardItemId#5500426L, 30), ENSURE_REQUIREMENTS, [plan_id=2853821]
(36) ObjectHashAggregate
Input [3]: [shardId#5500425, worklistShardItemId#5500426L, buf#5500606]
Keys [2]: [shardId#5500425, worklistShardItemId#5500426L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#5500428, demandStream, demandStream#5500429, kpis, kpis#5500430), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#5500428, demandStream, demandStream#5500429, kpis, kpis#5500430), 0, 0)#5500424]
Results [3]: [shardId#5500425, worklistShardItemId#5500426L, collect_list(struct(demandChannel, demandChannel#5500428, demandStream, demandStream#5500429, kpis, kpis#5500430), 0, 0)#5500424 AS channelStreamSpecificKpis#5500417]
(37) Sort [codegen id : 9]
Input [3]: [shardId#5500425, worklistShardItemId#5500426L, channelStreamSpecificKpis#5500417]
Arguments: [shardId#5500425 ASC NULLS FIRST, worklistShardItemId#5500426L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#5499000, worklistShardItemId#5499512L]
Right keys [2]: [shardId#5500425, worklistShardItemId#5500426L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, prodLocSpecificKpis#5500416, coalesce(channelStreamSpecificKpis#5500417, []) AS channelStreamSpecificKpis#5500431]
Input [43]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, prodLocSpecificKpis#5500416, shardId#5500425, worklistShardItemId#5500426L, channelStreamSpecificKpis#5500417]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, demandChannel#5500441, demandStream#5500442, kpis#5500443]
Arguments: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, demandChannel#5500441, demandStream#5500442, kpis#5500443], MapPartitionsRDD[387503] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, demandChannel#5500441, demandStream#5500442, kpis#5500443]
Condition : ((isnotnull(qty#5500440) AND isnotnull(kpis#5500443)) AND (isnotnull(shardId#5500438) AND isnotnull(worklistShardItemId#5500439L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, kpis#5500443]
Input [6]: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, demandChannel#5500441, demandStream#5500442, kpis#5500443]
(43) ObjectHashAggregate
Input [4]: [shardId#5500438, worklistShardItemId#5500439L, qty#5500440, kpis#5500443]
Keys [2]: [shardId#5500438, worklistShardItemId#5500439L]
Functions [1]: [partial_collect_list(struct(qty, qty#5500440, kpis, kpis#5500443), 0, 0)]
Aggregate Attributes [1]: [buf#5500607]
Results [3]: [shardId#5500438, worklistShardItemId#5500439L, buf#5500608]
(44) Exchange
Input [3]: [shardId#5500438, worklistShardItemId#5500439L, buf#5500608]
Arguments: hashpartitioning(shardId#5500438, worklistShardItemId#5500439L, 30), ENSURE_REQUIREMENTS, [plan_id=2853833]
(45) ObjectHashAggregate
Input [3]: [shardId#5500438, worklistShardItemId#5500439L, buf#5500608]
Keys [2]: [shardId#5500438, worklistShardItemId#5500439L]
Functions [1]: [collect_list(struct(qty, qty#5500440, kpis, kpis#5500443), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#5500440, kpis, kpis#5500443), 0, 0)#5500437]
Results [3]: [shardId#5500438, worklistShardItemId#5500439L, map_from_entries(collect_list(struct(qty, qty#5500440, kpis, kpis#5500443), 0, 0)#5500437) AS quantityKpis#5500432]
(46) Sort [codegen id : 12]
Input [3]: [shardId#5500438, worklistShardItemId#5500439L, quantityKpis#5500432]
Arguments: [shardId#5500438 ASC NULLS FIRST, worklistShardItemId#5500439L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#5499000, worklistShardItemId#5499512L]
Right keys [2]: [shardId#5500438, worklistShardItemId#5500439L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, prodLocSpecificKpis#5500416, channelStreamSpecificKpis#5500431, coalesce(quantityKpis#5500432, map(keys: [], values: [])) AS quantityKpis#5500444]
Input [44]: [shardId#5499000, worklistShardItemId#5499512L, quantityAfterProdPlantOptimization#5499513, qty#5499514, orderProposalId#5499713L, originalReplenishmentRunId#5499755L, supplierGroup#5499715, supplier#5499716, supplyingPlant#5499720, productGroup#5499721, product#5499722, plant#5499717, subrange#5499719, orderDateTime#5499723, deliveryDateTime#5499718, availabilityDateTime#5499724, nextAvailabilityDateTime#5499725, constraintValues#5499746, constraintOperators#5499745, constraintLabels#5499744, logisticUnits#5499740, orderQuantityBaseUom#5499741, orderQuantityBaseUomUuid#5499742, splitIndicator#5499732L, netPriceAmount#5499749, netPriceCurrencyCode#5499750, netPriceQuantity#5499751, netPriceQuantityUom#5499752, netPriceQuantityUomUuid#5499753, sourceOfSupplyUuid#5499727, minimumOrderQuantity#5499743, orderProposalItemId#5499714, orderProposalItemGroupId#5499737, optimizationGroups#5499756, measurements#5499754, externalProductId#5499738, externalPlantId#5499739, previousOrderProposal#5499733L, isFallbackOrderOnly#5499730, prodLocSpecificKpis#5500416, channelStreamSpecificKpis#5500431, shardId#5500438, worklistShardItemId#5500439L, quantityKpis#5500432]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444, shardId#5499000]
Condition : ((isnotnull(shardId#5499000) AND (shardId#5499000 = 0_1_10000001445)) AND (size(quantityKpis#5500444, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444]
Input [4]: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444, shardId#5499000]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#5499670L, orderProposalItemId#5499671, quantityKpis#5500444]
Arguments: explode(quantityKpis#5500444), [orderProposalId#5499670L, orderProposalItemId#5499671], false, [orderQuantityInBaseUnit#5504028, kpis#5504029]
(52) Project
Output [7]: [orderProposalId#5499670L, cast(orderProposalItemId#5499671 as bigint) AS orderProposalItemId#5504027L, orderQuantityInBaseUnit#5504028, filter(kpis#5504029, lambdafunction((lambda x_10915#5504031.label = ServiceLevel), lambda x_10915#5504031, false))[0].value AS serviceLevel#5504030, filter(kpis#5504029, lambdafunction((lambda x_10916#5504033.label = RangeOfCoverage), lambda x_10916#5504033, false))[0].value AS rangeOfCoverage#5504032, filter(kpis#5504029, lambdafunction((lambda x_10917#5504035.label = ServiceLevelAtStartOfDelisting), lambda x_10917#5504035, false))[0].value AS serviceLevelAtEndOfListing#5504034, 10000001445 AS replenishmentRunId#5504037L]
Input [4]: [orderProposalId#5499670L, orderProposalItemId#5499671, orderQuantityInBaseUnit#5504028, kpis#5504029]
(53) WriteFiles
Input [7]: [orderProposalId#5499670L, orderProposalItemId#5504027L, orderQuantityInBaseUnit#5504028, serviceLevel#5504030, rangeOfCoverage#5504032, serviceLevelAtEndOfListing#5504034, replenishmentRunId#5504037L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=6, false, Parquet, [path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]