== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432, shardId#5543988]
Arguments: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432, shardId#5543988], [isnotnull(shardId#5543988), (shardId#5543988 = 0_1_10000001445), (size(quantityKpis#5545432, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544658L, originalReplenishmentRunId#5544661L, supplierGroup#5544668, supplier#5544669, supplyingPlant#5544699, productGroup#5544700, product#5544671, plant#5544672, subrange#5544670, orderDateTime#5544676, deliveryDateTime#5544677, availabilityDateTime#5544678, nextAvailabilityDateTime#5544679, constraintValues#5544693, constraintOperators#5544691, constraintLabels#5544690, logisticUnits#5544695, orderQuantityBaseUom#5544681, orderQuantityBaseUomUuid#5544682, splitIndicator#5544663L, netPriceAmount#5544686, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#5543988, items#5543990]
Arguments: [shardId#5543988, items#5543990], [(size(items#5543990, true) > 0), isnotnull(items#5543990)]
(4) InMemoryRelation
Arguments: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, optimizationInsights#5543994], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, optimizationInsights#5543994]
Arguments: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, optimizationInsights#5543994], [isnotnull(shardId#5543988), (shardId#5543988 = 0_1_10000001445)]
(6) InMemoryRelation
Arguments: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, lastModified#5543993, optimizationInsights#5543994], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, lastModified#5543993, optimizationInsights#5543994]
Arguments: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, lastModified#5543993, optimizationInsights#5543994], MapPartitionsRDD[390845] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, lastModified#5543993, optimizationInsights#5543994]
Condition : (isnotnull(shardId#5543988) AND (shardId#5543988 = 0_1_10000001445))
(9) Filter [codegen id : 1]
Input [6]: [shardId#5543988, orderProposalId#5543989L, items#5543990, optimizationGroups#5543991, isOptimal#5543992, optimizationInsights#5543994]
Condition : (isnotnull(shardId#5543988) AND (shardId#5543988 = 0_1_10000001445))
(10) Filter [codegen id : 3]
Input [2]: [shardId#5543988, items#5543990]
Condition : ((size(items#5543990, true) > 0) AND isnotnull(items#5543990))
(11) Generate [codegen id : 3]
Input [2]: [shardId#5543988, items#5543990]
Arguments: explode(items#5543990), [shardId#5543988], false, [item#5544499]
(12) Project [codegen id : 3]
Output [4]: [shardId#5543988, item#5544499.worklistShardItemId AS worklistShardItemId#5544500L, item#5544499.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#5544501, item#5544499.qty AS qty#5544502]
Input [2]: [shardId#5543988, item#5544499]
(13) Scan parquet
Output [38]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744, shardId#5544745, sequenceId#5544723]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000001445]
PartitionFilters: [isnotnull(shardId#5544745), isnotnull(sequenceId#5544723), (shardId#5544745 = 0_1_10000001445), (sequenceId#5544723 = 7)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744, shardId#5544745, sequenceId#5544723]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744, shardId#5544745, sequenceId#5544723]
Condition : isnotnull(worklistShardItemId#5544724L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744]
Input [38]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744, shardId#5544745, sequenceId#5544723]
(17) Exchange
Input [36]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744]
Arguments: hashpartitioning(worklistShardItemId#5544724L, 30), REPARTITION_BY_NUM, [plan_id=2877045]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#5544724L, orderProposalId#5544701L, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, originalReplenishmentRunId#5544743L, splitIndicator#5544720L, previousOrderProposal#5544721L, sourceOfSupplyUuid#5544715, supplierGroup#5544703, supplier#5544704, subrange#5544707, product#5544710, plant#5544705, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, isFallbackOrderOnly#5544718, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, netPriceAmount#5544737, netPriceCurrencyCode#5544738, measurements#5544742, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, logisticUnits#5544728, optimizationGroups#5544744, externalProductId#5544726, externalPlantId#5544727, supplyingPlant#5544708, productGroup#5544709]
Input [36]: [orderProposalId#5544701L, orderProposalItemId#5544702, supplierGroup#5544703, supplier#5544704, plant#5544705, deliveryDateTime#5544706, subrange#5544707, supplyingPlant#5544708, productGroup#5544709, product#5544710, orderDateTime#5544711, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, sourceOfSupplyUuid#5544715, isFallbackOrderOnly#5544718, splitIndicator#5544720L, previousOrderProposal#5544721L, worklistShardItemId#5544724L, orderProposalItemGroupId#5544725, externalProductId#5544726, externalPlantId#5544727, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, measurements#5544742, originalReplenishmentRunId#5544743L, optimizationGroups#5544744]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#5544724L, orderProposalId#5544701L, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, originalReplenishmentRunId#5544743L, splitIndicator#5544720L, previousOrderProposal#5544721L, sourceOfSupplyUuid#5544715, supplierGroup#5544703, supplier#5544704, subrange#5544707, product#5544710, plant#5544705, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, isFallbackOrderOnly#5544718, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, netPriceAmount#5544737, netPriceCurrencyCode#5544738, measurements#5544742, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, logisticUnits#5544728, optimizationGroups#5544744, externalProductId#5544726, externalPlantId#5544727, supplyingPlant#5544708, productGroup#5544709]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=2877049]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#5544500L]
Right keys [1]: [worklistShardItemId#5544724L]
Join type: LeftOuter
Join condition: (shardId#5543988 = 0_1_10000001445)
(21) Project [codegen id : 3]
Output [39]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718]
Input [40]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, worklistShardItemId#5544724L, orderProposalId#5544701L, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, originalReplenishmentRunId#5544743L, splitIndicator#5544720L, previousOrderProposal#5544721L, sourceOfSupplyUuid#5544715, supplierGroup#5544703, supplier#5544704, subrange#5544707, product#5544710, plant#5544705, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, isFallbackOrderOnly#5544718, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, netPriceAmount#5544737, netPriceCurrencyCode#5544738, measurements#5544742, minimumOrderQuantity#5544731, constraintLabels#5544732, constraintOperators#5544733, constraintValues#5544734, logisticUnits#5544728, optimizationGroups#5544744, externalProductId#5544726, externalPlantId#5544727, supplyingPlant#5544708, productGroup#5544709]
(22) Exchange
Input [39]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718]
Arguments: hashpartitioning(shardId#5543988, worklistShardItemId#5544500L, 30), ENSURE_REQUIREMENTS, [plan_id=2877054]
(23) Sort [codegen id : 4]
Input [39]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718]
Arguments: [shardId#5543988 ASC NULLS FIRST, worklistShardItemId#5544500L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#5545397, worklistShardItemId#5545398L, qty#5545399, demandChannel#5545400, demandStream#5545401, kpis#5545402]
Arguments: [shardId#5545397, worklistShardItemId#5545398L, qty#5545399, demandChannel#5545400, demandStream#5545401, kpis#5545402], MapPartitionsRDD[390919] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#5545397, worklistShardItemId#5545398L, qty#5545399, demandChannel#5545400, demandStream#5545401, kpis#5545402]
Condition : (((isnull(qty#5545399) AND isnull(demandChannel#5545400)) AND isnull(demandStream#5545401)) AND (isnotnull(shardId#5545397) AND isnotnull(worklistShardItemId#5545398L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#5545397, worklistShardItemId#5545398L, coalesce(kpis#5545402, []) AS prodLocSpecificKpis#5545403]
Input [6]: [shardId#5545397, worklistShardItemId#5545398L, qty#5545399, demandChannel#5545400, demandStream#5545401, kpis#5545402]
(27) Exchange
Input [3]: [shardId#5545397, worklistShardItemId#5545398L, prodLocSpecificKpis#5545403]
Arguments: hashpartitioning(shardId#5545397, worklistShardItemId#5545398L, 30), ENSURE_REQUIREMENTS, [plan_id=2877060]
(28) Sort [codegen id : 6]
Input [3]: [shardId#5545397, worklistShardItemId#5545398L, prodLocSpecificKpis#5545403]
Arguments: [shardId#5545397 ASC NULLS FIRST, worklistShardItemId#5545398L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#5543988, worklistShardItemId#5544500L]
Right keys [2]: [shardId#5545397, worklistShardItemId#5545398L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, coalesce(prodLocSpecificKpis#5545403, []) AS prodLocSpecificKpis#5545404]
Input [42]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, shardId#5545397, worklistShardItemId#5545398L, prodLocSpecificKpis#5545403]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#5545413, worklistShardItemId#5545414L, qty#5545415, demandChannel#5545416, demandStream#5545417, kpis#5545418]
Arguments: [shardId#5545413, worklistShardItemId#5545414L, qty#5545415, demandChannel#5545416, demandStream#5545417, kpis#5545418], MapPartitionsRDD[390919] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#5545413, worklistShardItemId#5545414L, qty#5545415, demandChannel#5545416, demandStream#5545417, kpis#5545418]
Condition : ((((isnull(qty#5545415) AND isnotnull(demandChannel#5545416)) AND isnotnull(demandStream#5545417)) AND (size(kpis#5545418, true) > 0)) AND (isnotnull(shardId#5545413) AND isnotnull(worklistShardItemId#5545414L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#5545413, worklistShardItemId#5545414L, demandChannel#5545416, demandStream#5545417, kpis#5545418]
Input [6]: [shardId#5545413, worklistShardItemId#5545414L, qty#5545415, demandChannel#5545416, demandStream#5545417, kpis#5545418]
(34) ObjectHashAggregate
Input [5]: [shardId#5545413, worklistShardItemId#5545414L, demandChannel#5545416, demandStream#5545417, kpis#5545418]
Keys [2]: [shardId#5545413, worklistShardItemId#5545414L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#5545416, demandStream, demandStream#5545417, kpis, kpis#5545418), 0, 0)]
Aggregate Attributes [1]: [buf#5545593]
Results [3]: [shardId#5545413, worklistShardItemId#5545414L, buf#5545594]
(35) Exchange
Input [3]: [shardId#5545413, worklistShardItemId#5545414L, buf#5545594]
Arguments: hashpartitioning(shardId#5545413, worklistShardItemId#5545414L, 30), ENSURE_REQUIREMENTS, [plan_id=2877071]
(36) ObjectHashAggregate
Input [3]: [shardId#5545413, worklistShardItemId#5545414L, buf#5545594]
Keys [2]: [shardId#5545413, worklistShardItemId#5545414L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#5545416, demandStream, demandStream#5545417, kpis, kpis#5545418), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#5545416, demandStream, demandStream#5545417, kpis, kpis#5545418), 0, 0)#5545412]
Results [3]: [shardId#5545413, worklistShardItemId#5545414L, collect_list(struct(demandChannel, demandChannel#5545416, demandStream, demandStream#5545417, kpis, kpis#5545418), 0, 0)#5545412 AS channelStreamSpecificKpis#5545405]
(37) Sort [codegen id : 9]
Input [3]: [shardId#5545413, worklistShardItemId#5545414L, channelStreamSpecificKpis#5545405]
Arguments: [shardId#5545413 ASC NULLS FIRST, worklistShardItemId#5545414L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#5543988, worklistShardItemId#5544500L]
Right keys [2]: [shardId#5545413, worklistShardItemId#5545414L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, prodLocSpecificKpis#5545404, coalesce(channelStreamSpecificKpis#5545405, []) AS channelStreamSpecificKpis#5545419]
Input [43]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, prodLocSpecificKpis#5545404, shardId#5545413, worklistShardItemId#5545414L, channelStreamSpecificKpis#5545405]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, demandChannel#5545429, demandStream#5545430, kpis#5545431]
Arguments: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, demandChannel#5545429, demandStream#5545430, kpis#5545431], MapPartitionsRDD[390919] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, demandChannel#5545429, demandStream#5545430, kpis#5545431]
Condition : ((isnotnull(qty#5545428) AND isnotnull(kpis#5545431)) AND (isnotnull(shardId#5545426) AND isnotnull(worklistShardItemId#5545427L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, kpis#5545431]
Input [6]: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, demandChannel#5545429, demandStream#5545430, kpis#5545431]
(43) ObjectHashAggregate
Input [4]: [shardId#5545426, worklistShardItemId#5545427L, qty#5545428, kpis#5545431]
Keys [2]: [shardId#5545426, worklistShardItemId#5545427L]
Functions [1]: [partial_collect_list(struct(qty, qty#5545428, kpis, kpis#5545431), 0, 0)]
Aggregate Attributes [1]: [buf#5545595]
Results [3]: [shardId#5545426, worklistShardItemId#5545427L, buf#5545596]
(44) Exchange
Input [3]: [shardId#5545426, worklistShardItemId#5545427L, buf#5545596]
Arguments: hashpartitioning(shardId#5545426, worklistShardItemId#5545427L, 30), ENSURE_REQUIREMENTS, [plan_id=2877083]
(45) ObjectHashAggregate
Input [3]: [shardId#5545426, worklistShardItemId#5545427L, buf#5545596]
Keys [2]: [shardId#5545426, worklistShardItemId#5545427L]
Functions [1]: [collect_list(struct(qty, qty#5545428, kpis, kpis#5545431), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#5545428, kpis, kpis#5545431), 0, 0)#5545425]
Results [3]: [shardId#5545426, worklistShardItemId#5545427L, map_from_entries(collect_list(struct(qty, qty#5545428, kpis, kpis#5545431), 0, 0)#5545425) AS quantityKpis#5545420]
(46) Sort [codegen id : 12]
Input [3]: [shardId#5545426, worklistShardItemId#5545427L, quantityKpis#5545420]
Arguments: [shardId#5545426 ASC NULLS FIRST, worklistShardItemId#5545427L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#5543988, worklistShardItemId#5544500L]
Right keys [2]: [shardId#5545426, worklistShardItemId#5545427L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, prodLocSpecificKpis#5545404, channelStreamSpecificKpis#5545419, coalesce(quantityKpis#5545420, map(keys: [], values: [])) AS quantityKpis#5545432]
Input [44]: [shardId#5543988, worklistShardItemId#5544500L, quantityAfterProdPlantOptimization#5544501, qty#5544502, orderProposalId#5544701L, originalReplenishmentRunId#5544743L, supplierGroup#5544703, supplier#5544704, supplyingPlant#5544708, productGroup#5544709, product#5544710, plant#5544705, subrange#5544707, orderDateTime#5544711, deliveryDateTime#5544706, availabilityDateTime#5544712, nextAvailabilityDateTime#5544713, constraintValues#5544734, constraintOperators#5544733, constraintLabels#5544732, logisticUnits#5544728, orderQuantityBaseUom#5544729, orderQuantityBaseUomUuid#5544730, splitIndicator#5544720L, netPriceAmount#5544737, netPriceCurrencyCode#5544738, netPriceQuantity#5544739, netPriceQuantityUom#5544740, netPriceQuantityUomUuid#5544741, sourceOfSupplyUuid#5544715, minimumOrderQuantity#5544731, orderProposalItemId#5544702, orderProposalItemGroupId#5544725, optimizationGroups#5544744, measurements#5544742, externalProductId#5544726, externalPlantId#5544727, previousOrderProposal#5544721L, isFallbackOrderOnly#5544718, prodLocSpecificKpis#5545404, channelStreamSpecificKpis#5545419, shardId#5545426, worklistShardItemId#5545427L, quantityKpis#5545420]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432, shardId#5543988]
Condition : ((isnotnull(shardId#5543988) AND (shardId#5543988 = 0_1_10000001445)) AND (size(quantityKpis#5545432, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432]
Input [4]: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432, shardId#5543988]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#5544658L, orderProposalItemId#5544659, quantityKpis#5545432]
Arguments: explode(quantityKpis#5545432), [orderProposalId#5544658L, orderProposalItemId#5544659], false, [orderQuantityInBaseUnit#5549016, kpis#5549017]
(52) Project
Output [7]: [orderProposalId#5544658L, cast(orderProposalItemId#5544659 as bigint) AS orderProposalItemId#5549015L, orderQuantityInBaseUnit#5549016, filter(kpis#5549017, lambdafunction((lambda x_10991#5549019.label = ServiceLevel), lambda x_10991#5549019, false))[0].value AS serviceLevel#5549018, filter(kpis#5549017, lambdafunction((lambda x_10992#5549021.label = RangeOfCoverage), lambda x_10992#5549021, false))[0].value AS rangeOfCoverage#5549020, filter(kpis#5549017, lambdafunction((lambda x_10993#5549023.label = ServiceLevelAtStartOfDelisting), lambda x_10993#5549023, false))[0].value AS serviceLevelAtEndOfListing#5549022, 10000001445 AS replenishmentRunId#5549025L]
Input [4]: [orderProposalId#5544658L, orderProposalItemId#5544659, orderQuantityInBaseUnit#5549016, kpis#5549017]
(53) WriteFiles
Input [7]: [orderProposalId#5544658L, orderProposalItemId#5549015L, orderQuantityInBaseUnit#5549016, serviceLevel#5549018, rangeOfCoverage#5549020, serviceLevelAtEndOfListing#5549022, replenishmentRunId#5549025L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=7, false, Parquet, [path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000001445/shardId=0_1_10000001445/sequenceId=7], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]