Activities

August 18
Dániel Kocsis updated LPS-67653.
Dániel Kocsis updated LPS-67653.
Dániel Kocsis updated LPS-67653.
5:31 AM
Dániel Kocsis added LPS-67653.
August 10
Dániel Kocsis updated LPS-67427.
August 8
Dániel Kocsis updated LPS-67511.
Dániel Kocsis updated LPS-67511.
Dániel Kocsis commented on LPS-67329.
2:46 AM The numeric results of the performance tests can be found here: https://docs.google.com/spreadsheets/d/1XWCno85XQSLz-h4LzY2h5csxTSCsdY7Clwkk-pexlLQ/edit?ts=57989f7b *The key findings are* # The controlling overhead is generally small and constant, so we can't really make any significant performance gain here # The export process performance is acceptable, and when it is slower it is because the entity specific logic we can't change (DL API is generally slower then Journal, etc... ), _however further tests could find possible improvements here, because it seems complex scenarios can cause longer export time then import_ # The import process is generally slower then export (1-10 times slower compared to the export time of the same elements) # The import process is not linearly slower with the file size (with small ones the gains is 10-20%, howver in case of large lar files the gain is 4-500%) # The import process requires a lot of direct access (currently with XPath) to the elements of the many XML files we have in the lar *Conclusions* # We need to improve the import performance #* To achive that we need to either make the direct access of the XML faster, or remove the need of the direct access #* *We decided to get rid of the need of direct access* # We need to develop the so called *Topological Ordering* #* To do that we need to first change the following things #** We need to homogenize the entity graph staging processes #** We need to develop Staged Model Repositories for all the Staged Model #** We need to refactor the controlling logic (the current one is polluted with entity specific logic) #** We need to refactor and split the serialization from the other logic *Next Steps* * Mate is going to create Epics/User Stories and attach to this one to track the required changes * We should do further tests regarding complex scenarios export time
Dániel Kocsis updated LPS-67511.
Dániel Kocsis updated LPS-67511.
Subscribe to Dániel Kocsis's activities. (Opens New Window)