Thursday 5 July 2018

Accelerate data import process by using entity execution parameters

Lets discuss about execution parameters which are found in the Data import/export framework parameters. They can be used for speeding up data import process in order to optimize the performance when large number of records are uploaded using data management features.

As we all know that in Dynamics AX 2012 we used to define number of tasks at a creation of processing group. While here in D365 they are moved to Data import/export framework parameters.
Basically it is an option which provides information of dividing workload whenever we are performing records upload in bulk by using batch framework.
Lets begin with a scenario of  uploading sales order lines  in bulk. So, here we need to divide this upload process into sub tasks for better performance. For this purpose we need to follow some steps.

1. Open entity execution parameters by navigating on this path : Work spaces -> Data Management -> Framework parameters tile -> Entity settings -> Configure entity execution parameters









2. After clicking configure entity execution parameter, a screen will appear where we can add our entity.

  • Entity : Entity name will be selected from drop down and it will be used here for further process.
  • Import threshold record count : Here we can specify a threshold per entity when the tasks need to split and how many task will be created. For instance in below example 500 records will be processed per task. 
  • Import task count :  It will create multiple threads where the workload will be divided and run in parallel. For instance in below example 20 threads will be created.









3. Now its time to import the records in batch. For this navigate to Work spaces -> Data management -> Import tile 
Add all required details here for upload process and go on Import options -> Import in batch.
You process will be started and it will upload records in batch, You can monitor how many tasks are created on the View tasks form at a time of  execution of batch job. 













Note : It is not necessary that all entities will be supported for multiple task. See below screen shot like vendors entity is not supported for more than one task.


No comments:

Post a Comment

Note: only a member of this blog may post a comment.

Connect and upload in azure blob with azure key vault using x++

 Today, I will be sharing details about file upload in azure blob using azure vault that includes pre requisite and code snippet used to it....