== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675, shardId#6608407]
Arguments: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675, shardId#6608407], [isnotnull(shardId#6608407), (shardId#6608407 = 0_1_10000002290), (size(quantityKpis#6609675, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609077L, originalReplenishmentRunId#6609080L, supplierGroup#6609087, supplier#6609088, supplyingPlant#6609118, productGroup#6609119, product#6609090, plant#6609091, subrange#6609089, orderDateTime#6609095, deliveryDateTime#6609096, availabilityDateTime#6609097, nextAvailabilityDateTime#6609098, constraintValues#6609112, constraintOperators#6609110, constraintLabels#6609109, logisticUnits#6609114, orderQuantityBaseUom#6609100, orderQuantityBaseUomUuid#6609101, splitIndicator#6609082L, netPriceAmount#6609105, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#6608407, items#6608409]
Arguments: [shardId#6608407, items#6608409], [(size(items#6608409, true) > 0), isnotnull(items#6608409)]
(4) InMemoryRelation
Arguments: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, optimizationInsights#6608413], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, optimizationInsights#6608413]
Arguments: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, optimizationInsights#6608413], [isnotnull(shardId#6608407), (shardId#6608407 = 0_1_10000002290)]
(6) InMemoryRelation
Arguments: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, lastModified#6608412, optimizationInsights#6608413], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, lastModified#6608412, optimizationInsights#6608413]
Arguments: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, lastModified#6608412, optimizationInsights#6608413], MapPartitionsRDD[467832] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, lastModified#6608412, optimizationInsights#6608413]
Condition : (isnotnull(shardId#6608407) AND (shardId#6608407 = 0_1_10000002290))
(9) Filter [codegen id : 1]
Input [6]: [shardId#6608407, orderProposalId#6608408L, items#6608409, optimizationGroups#6608410, isOptimal#6608411, optimizationInsights#6608413]
Condition : (isnotnull(shardId#6608407) AND (shardId#6608407 = 0_1_10000002290))
(10) Filter [codegen id : 1]
Input [2]: [shardId#6608407, items#6608409]
Condition : ((size(items#6608409, true) > 0) AND isnotnull(items#6608409))
(11) Generate [codegen id : 1]
Input [2]: [shardId#6608407, items#6608409]
Arguments: explode(items#6608409), [shardId#6608407], false, [item#6608918]
(12) Project [codegen id : 1]
Output [4]: [shardId#6608407, item#6608918.worklistShardItemId AS worklistShardItemId#6608919L, item#6608918.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#6608920, item#6608918.qty AS qty#6608921]
Input [2]: [shardId#6608407, item#6608918]
(13) Exchange
Input [4]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921]
Arguments: hashpartitioning(worklistShardItemId#6608919L, 30), ENSURE_REQUIREMENTS, [plan_id=3473522]
(14) Sort [codegen id : 2]
Input [4]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921]
Arguments: [worklistShardItemId#6608919L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163, shardId#6609164, sequenceId#6609142]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://dac252a8-bd1b-4f30-995e-f6d4a08836d2.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002290]
PartitionFilters: [isnotnull(shardId#6609164), isnotnull(sequenceId#6609142), (shardId#6609164 = 0_1_10000002290), (sequenceId#6609142 = 3)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163, shardId#6609164, sequenceId#6609142]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163, shardId#6609164, sequenceId#6609142]
Condition : isnotnull(worklistShardItemId#6609143L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163]
Input [38]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163, shardId#6609164, sequenceId#6609142]
(19) Exchange
Input [36]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163]
Arguments: hashpartitioning(worklistShardItemId#6609143L, 30), REPARTITION_BY_NUM, [plan_id=3473532]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#6609143L, orderProposalId#6609120L, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, originalReplenishmentRunId#6609162L, splitIndicator#6609139L, previousOrderProposal#6609140L, sourceOfSupplyUuid#6609134, supplierGroup#6609122, supplier#6609123, subrange#6609126, product#6609129, plant#6609124, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, isFallbackOrderOnly#6609137, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, netPriceAmount#6609156, netPriceCurrencyCode#6609157, measurements#6609161, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, logisticUnits#6609147, optimizationGroups#6609163, externalProductId#6609145, externalPlantId#6609146, supplyingPlant#6609127, productGroup#6609128]
Input [36]: [orderProposalId#6609120L, orderProposalItemId#6609121, supplierGroup#6609122, supplier#6609123, plant#6609124, deliveryDateTime#6609125, subrange#6609126, supplyingPlant#6609127, productGroup#6609128, product#6609129, orderDateTime#6609130, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, sourceOfSupplyUuid#6609134, isFallbackOrderOnly#6609137, splitIndicator#6609139L, previousOrderProposal#6609140L, worklistShardItemId#6609143L, orderProposalItemGroupId#6609144, externalProductId#6609145, externalPlantId#6609146, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, measurements#6609161, originalReplenishmentRunId#6609162L, optimizationGroups#6609163]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#6609143L, orderProposalId#6609120L, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, originalReplenishmentRunId#6609162L, splitIndicator#6609139L, previousOrderProposal#6609140L, sourceOfSupplyUuid#6609134, supplierGroup#6609122, supplier#6609123, subrange#6609126, product#6609129, plant#6609124, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, isFallbackOrderOnly#6609137, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, netPriceAmount#6609156, netPriceCurrencyCode#6609157, measurements#6609161, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, logisticUnits#6609147, optimizationGroups#6609163, externalProductId#6609145, externalPlantId#6609146, supplyingPlant#6609127, productGroup#6609128]
Arguments: [worklistShardItemId#6609143L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#6608919L]
Right keys [1]: [worklistShardItemId#6609143L]
Join type: LeftOuter
Join condition: (shardId#6608407 = 0_1_10000002290)
(23) Project [codegen id : 5]
Output [39]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137]
Input [40]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, worklistShardItemId#6609143L, orderProposalId#6609120L, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, originalReplenishmentRunId#6609162L, splitIndicator#6609139L, previousOrderProposal#6609140L, sourceOfSupplyUuid#6609134, supplierGroup#6609122, supplier#6609123, subrange#6609126, product#6609129, plant#6609124, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, isFallbackOrderOnly#6609137, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, netPriceAmount#6609156, netPriceCurrencyCode#6609157, measurements#6609161, minimumOrderQuantity#6609150, constraintLabels#6609151, constraintOperators#6609152, constraintValues#6609153, logisticUnits#6609147, optimizationGroups#6609163, externalProductId#6609145, externalPlantId#6609146, supplyingPlant#6609127, productGroup#6609128]
(24) Exchange
Input [39]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137]
Arguments: hashpartitioning(shardId#6608407, worklistShardItemId#6608919L, 30), ENSURE_REQUIREMENTS, [plan_id=3473541]
(25) Sort [codegen id : 6]
Input [39]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137]
Arguments: [shardId#6608407 ASC NULLS FIRST, worklistShardItemId#6608919L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#6609640, worklistShardItemId#6609641L, qty#6609642, demandChannel#6609643, demandStream#6609644, kpis#6609645]
Arguments: [shardId#6609640, worklistShardItemId#6609641L, qty#6609642, demandChannel#6609643, demandStream#6609644, kpis#6609645], MapPartitionsRDD[467892] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#6609640, worklistShardItemId#6609641L, qty#6609642, demandChannel#6609643, demandStream#6609644, kpis#6609645]
Condition : (((isnull(qty#6609642) AND isnull(demandChannel#6609643)) AND isnull(demandStream#6609644)) AND (isnotnull(shardId#6609640) AND isnotnull(worklistShardItemId#6609641L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#6609640, worklistShardItemId#6609641L, coalesce(kpis#6609645, []) AS prodLocSpecificKpis#6609646]
Input [6]: [shardId#6609640, worklistShardItemId#6609641L, qty#6609642, demandChannel#6609643, demandStream#6609644, kpis#6609645]
(29) Exchange
Input [3]: [shardId#6609640, worklistShardItemId#6609641L, prodLocSpecificKpis#6609646]
Arguments: hashpartitioning(shardId#6609640, worklistShardItemId#6609641L, 30), ENSURE_REQUIREMENTS, [plan_id=3473547]
(30) Sort [codegen id : 8]
Input [3]: [shardId#6609640, worklistShardItemId#6609641L, prodLocSpecificKpis#6609646]
Arguments: [shardId#6609640 ASC NULLS FIRST, worklistShardItemId#6609641L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#6608407, worklistShardItemId#6608919L]
Right keys [2]: [shardId#6609640, worklistShardItemId#6609641L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, coalesce(prodLocSpecificKpis#6609646, []) AS prodLocSpecificKpis#6609647]
Input [42]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, shardId#6609640, worklistShardItemId#6609641L, prodLocSpecificKpis#6609646]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#6609656, worklistShardItemId#6609657L, qty#6609658, demandChannel#6609659, demandStream#6609660, kpis#6609661]
Arguments: [shardId#6609656, worklistShardItemId#6609657L, qty#6609658, demandChannel#6609659, demandStream#6609660, kpis#6609661], MapPartitionsRDD[467892] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#6609656, worklistShardItemId#6609657L, qty#6609658, demandChannel#6609659, demandStream#6609660, kpis#6609661]
Condition : ((((isnull(qty#6609658) AND isnotnull(demandChannel#6609659)) AND isnotnull(demandStream#6609660)) AND (size(kpis#6609661, true) > 0)) AND (isnotnull(shardId#6609656) AND isnotnull(worklistShardItemId#6609657L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#6609656, worklistShardItemId#6609657L, demandChannel#6609659, demandStream#6609660, kpis#6609661]
Input [6]: [shardId#6609656, worklistShardItemId#6609657L, qty#6609658, demandChannel#6609659, demandStream#6609660, kpis#6609661]
(36) ObjectHashAggregate
Input [5]: [shardId#6609656, worklistShardItemId#6609657L, demandChannel#6609659, demandStream#6609660, kpis#6609661]
Keys [2]: [shardId#6609656, worklistShardItemId#6609657L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#6609659, demandStream, demandStream#6609660, kpis, kpis#6609661), 0, 0)]
Aggregate Attributes [1]: [buf#6609836]
Results [3]: [shardId#6609656, worklistShardItemId#6609657L, buf#6609837]
(37) Exchange
Input [3]: [shardId#6609656, worklistShardItemId#6609657L, buf#6609837]
Arguments: hashpartitioning(shardId#6609656, worklistShardItemId#6609657L, 30), ENSURE_REQUIREMENTS, [plan_id=3473558]
(38) ObjectHashAggregate
Input [3]: [shardId#6609656, worklistShardItemId#6609657L, buf#6609837]
Keys [2]: [shardId#6609656, worklistShardItemId#6609657L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#6609659, demandStream, demandStream#6609660, kpis, kpis#6609661), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#6609659, demandStream, demandStream#6609660, kpis, kpis#6609661), 0, 0)#6609655]
Results [3]: [shardId#6609656, worklistShardItemId#6609657L, collect_list(struct(demandChannel, demandChannel#6609659, demandStream, demandStream#6609660, kpis, kpis#6609661), 0, 0)#6609655 AS channelStreamSpecificKpis#6609648]
(39) Sort [codegen id : 11]
Input [3]: [shardId#6609656, worklistShardItemId#6609657L, channelStreamSpecificKpis#6609648]
Arguments: [shardId#6609656 ASC NULLS FIRST, worklistShardItemId#6609657L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#6608407, worklistShardItemId#6608919L]
Right keys [2]: [shardId#6609656, worklistShardItemId#6609657L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, prodLocSpecificKpis#6609647, coalesce(channelStreamSpecificKpis#6609648, []) AS channelStreamSpecificKpis#6609662]
Input [43]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, prodLocSpecificKpis#6609647, shardId#6609656, worklistShardItemId#6609657L, channelStreamSpecificKpis#6609648]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, demandChannel#6609672, demandStream#6609673, kpis#6609674]
Arguments: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, demandChannel#6609672, demandStream#6609673, kpis#6609674], MapPartitionsRDD[467892] at start at FileStorageAdapterImpl.java:598, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, demandChannel#6609672, demandStream#6609673, kpis#6609674]
Condition : ((isnotnull(qty#6609671) AND isnotnull(kpis#6609674)) AND (isnotnull(shardId#6609669) AND isnotnull(worklistShardItemId#6609670L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, kpis#6609674]
Input [6]: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, demandChannel#6609672, demandStream#6609673, kpis#6609674]
(45) ObjectHashAggregate
Input [4]: [shardId#6609669, worklistShardItemId#6609670L, qty#6609671, kpis#6609674]
Keys [2]: [shardId#6609669, worklistShardItemId#6609670L]
Functions [1]: [partial_collect_list(struct(qty, qty#6609671, kpis, kpis#6609674), 0, 0)]
Aggregate Attributes [1]: [buf#6609838]
Results [3]: [shardId#6609669, worklistShardItemId#6609670L, buf#6609839]
(46) Exchange
Input [3]: [shardId#6609669, worklistShardItemId#6609670L, buf#6609839]
Arguments: hashpartitioning(shardId#6609669, worklistShardItemId#6609670L, 30), ENSURE_REQUIREMENTS, [plan_id=3473570]
(47) ObjectHashAggregate
Input [3]: [shardId#6609669, worklistShardItemId#6609670L, buf#6609839]
Keys [2]: [shardId#6609669, worklistShardItemId#6609670L]
Functions [1]: [collect_list(struct(qty, qty#6609671, kpis, kpis#6609674), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#6609671, kpis, kpis#6609674), 0, 0)#6609668]
Results [3]: [shardId#6609669, worklistShardItemId#6609670L, map_from_entries(collect_list(struct(qty, qty#6609671, kpis, kpis#6609674), 0, 0)#6609668) AS quantityKpis#6609663]
(48) Sort [codegen id : 14]
Input [3]: [shardId#6609669, worklistShardItemId#6609670L, quantityKpis#6609663]
Arguments: [shardId#6609669 ASC NULLS FIRST, worklistShardItemId#6609670L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#6608407, worklistShardItemId#6608919L]
Right keys [2]: [shardId#6609669, worklistShardItemId#6609670L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, prodLocSpecificKpis#6609647, channelStreamSpecificKpis#6609662, coalesce(quantityKpis#6609663, map(keys: [], values: [])) AS quantityKpis#6609675]
Input [44]: [shardId#6608407, worklistShardItemId#6608919L, quantityAfterProdPlantOptimization#6608920, qty#6608921, orderProposalId#6609120L, originalReplenishmentRunId#6609162L, supplierGroup#6609122, supplier#6609123, supplyingPlant#6609127, productGroup#6609128, product#6609129, plant#6609124, subrange#6609126, orderDateTime#6609130, deliveryDateTime#6609125, availabilityDateTime#6609131, nextAvailabilityDateTime#6609132, constraintValues#6609153, constraintOperators#6609152, constraintLabels#6609151, logisticUnits#6609147, orderQuantityBaseUom#6609148, orderQuantityBaseUomUuid#6609149, splitIndicator#6609139L, netPriceAmount#6609156, netPriceCurrencyCode#6609157, netPriceQuantity#6609158, netPriceQuantityUom#6609159, netPriceQuantityUomUuid#6609160, sourceOfSupplyUuid#6609134, minimumOrderQuantity#6609150, orderProposalItemId#6609121, orderProposalItemGroupId#6609144, optimizationGroups#6609163, measurements#6609161, externalProductId#6609145, externalPlantId#6609146, previousOrderProposal#6609140L, isFallbackOrderOnly#6609137, prodLocSpecificKpis#6609647, channelStreamSpecificKpis#6609662, shardId#6609669, worklistShardItemId#6609670L, quantityKpis#6609663]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675, shardId#6608407]
Condition : ((isnotnull(shardId#6608407) AND (shardId#6608407 = 0_1_10000002290)) AND (size(quantityKpis#6609675, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675]
Input [4]: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675, shardId#6608407]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#6609077L, orderProposalItemId#6609078, quantityKpis#6609675]
Arguments: explode(quantityKpis#6609675), [orderProposalId#6609077L, orderProposalItemId#6609078], false, [orderQuantityInBaseUnit#6613275, kpis#6613276]
(54) Project
Output [7]: [orderProposalId#6609077L, cast(orderProposalItemId#6609078 as bigint) AS orderProposalItemId#6613274L, orderQuantityInBaseUnit#6613275, filter(kpis#6613276, lambdafunction((lambda x_12851#6613278.label = ServiceLevel), lambda x_12851#6613278, false))[0].value AS serviceLevel#6613277, filter(kpis#6613276, lambdafunction((lambda x_12852#6613280.label = RangeOfCoverage), lambda x_12852#6613280, false))[0].value AS rangeOfCoverage#6613279, filter(kpis#6613276, lambdafunction((lambda x_12853#6613282.label = ServiceLevelAtStartOfDelisting), lambda x_12853#6613282, false))[0].value AS serviceLevelAtEndOfListing#6613281, 10000002290 AS replenishmentRunId#6613284L]
Input [4]: [orderProposalId#6609077L, orderProposalItemId#6609078, orderQuantityInBaseUnit#6613275, kpis#6613276]
(55) WriteFiles
Input [7]: [orderProposalId#6609077L, orderProposalItemId#6613274L, orderQuantityInBaseUnit#6613275, serviceLevel#6613277, rangeOfCoverage#6613279, serviceLevelAtEndOfListing#6613281, replenishmentRunId#6613284L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://dac252a8-bd1b-4f30-995e-f6d4a08836d2.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002290/shardId=0_1_10000002290/sequenceId=3, false, Parquet, [path=hdlfs://dac252a8-bd1b-4f30-995e-f6d4a08836d2.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002290/shardId=0_1_10000002290/sequenceId=3], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]