Save Operation time on File Watcher csv import  Topic is solved

Discussions relating to plugin development, and the Jiwa API.

Save Operation time on File Watcher csv import

Postby indikad » Fri Oct 04, 2019 4:26 pm

we have a file watcher csv import ( file per order ) that has taken about 2 minutes each per file ( generally about 160 lines per order ). This was done on the test sever at customer site with limited resources.
However the database is large 100 gigs with the so_lines having about 28 million lines.

======
• I have installed the database , and tested the same scenario on a laptop ( with SQL server on a spin disk similar to the DEV server )
The speed of the file process seemed to be half of the dev server ( 1 minute vs 2 ).

I have also looked at any other areas that could be delaying and have found nothing. After discussions with the internal team , the assumption is the 1 minute speed with a 166 line order was expected.

During debug i found that :
Out of the entire operation ( of the 1 minute ) , about 25 seconds was to add the lines to the sales order and about 35 seconds was used by the Jiwa engine to save. on the SalesOrder.Save() method.


I would like your thoughts on this .
indikad
Frequent Contributor
Frequent Contributor
 
Posts: 182
Joined: Thu Jun 18, 2009 1:14 pm
Topics Solved: 2

Re: Save Operation time on File Watcher csv import  Topic is solved

Postby SBarnes » Fri Oct 04, 2019 10:07 pm

Take a look at these

https://docs.jiwa.com.au/display/J7UG/Changing+the+SQL+version+of+my+database

https://docs.jiwa.com.au/display/J7UG/Slow+performance+when+retrieving+data

And if it is the customer I think it is, then try running the archiving process on the sales orders as it has a lot data going back well over 10 years.
Regards
Stuart Barnes
SBarnes
Shihan
Shihan
 
Posts: 1617
Joined: Fri Aug 15, 2008 3:27 pm
Topics Solved: 175

Re: Save Operation time on File Watcher csv import

Postby Scott.Pearce » Fri Oct 11, 2019 2:57 pm

Which version of Jiwa is this happening in?

I believe that changes regarding sales order and quote imports were made in 7.2.1 that may speed things up.
Scott Pearce
Senior Analyst/Programmer
Jiwa Financials
User avatar
Scott.Pearce
Senpai
Senpai
 
Posts: 742
Joined: Tue Feb 12, 2008 11:27 am
Location: New South Wales, Australia
Topics Solved: 221

Re: Save Operation time on File Watcher csv import

Postby SBarnes » Fri Oct 11, 2019 3:03 pm

I am pretty sure its already 7.2.1 as this is for a November Go Live
Regards
Stuart Barnes
SBarnes
Shihan
Shihan
 
Posts: 1617
Joined: Fri Aug 15, 2008 3:27 pm
Topics Solved: 175

Re: Save Operation time on File Watcher csv import

Postby indikad » Fri Oct 11, 2019 3:06 pm

7.2.1
indikad
Frequent Contributor
Frequent Contributor
 
Posts: 182
Joined: Thu Jun 18, 2009 1:14 pm
Topics Solved: 2

Re: Save Operation time on File Watcher csv import

Postby SBarnes » Fri Oct 11, 2019 3:13 pm

I suspect doing what I suggested above will make some difference as I don't think the database has ever seen a maintenance plan.
Regards
Stuart Barnes
SBarnes
Shihan
Shihan
 
Posts: 1617
Joined: Fri Aug 15, 2008 3:27 pm
Topics Solved: 175


Return to Technical and or Programming

Who is online

Users browsing this forum: Google [Bot] and 4 guests

cron