[freeside-users] sysvshell.export - High L.A. since Upgrage

Peter Kolbe peter at venturenet.co.za
Mon Jun 5 23:04:57 PDT 2006 

I don;t know if this helps.
but dprofpp on the script gives the ffg:
( I am only listing the top 3 Calls (Time Wise)
41.4% of Script Time, 40705 Calls, - FS::Record::qsearch
6.28% of Script Time, 40711 Calls, - DBI::st::execute
3.50% of Script Time, 60536 Calls, - FS::Record::new
.
.
.

Peter

----- Original Message ----- 
From: "Ivan Kohler" <ivan at 420.am>
To: "Freeside users mailing list" <freeside-users at sisd.com>
Sent: Monday, June 05, 2006 4:11 PM
Subject: Re: [freeside-users] sysvshell.export - High L.A. since Upgrage


>I haven't used sysvshell.export in ages, personally.  You probably want
> to track down what code changes are causing the extra queries for you.
>
> -- 
> _ivan
>
>
> On Mon, Jun 05, 2006 at 10:50:32AM +0200, Peter Kolbe wrote:
>> Hi
>>
>> Freeside 1.5.8, Postgresql 8.0.4, Fedora Core 4.
>>
>> Dual Intel(R) Xeon(TM) CPU 2.40GHz Hyperthreading CPU's
>>
>> MemTotal:      2075788 kB
>> MemFree:         60212 kB
>> SwapTotal:     4096532 kB
>> SwapFree:      4095684 kB
>>
>> Since upgrading to freeside-1.5.8 from 1.5.7, every time I run 
>> sysvshell.export, my Load Average shoots up to 40 to 50.
>> Top shows that it is a postgresql process and the sysvshell.export 
>> process that are at the top of the list, and it is almost impossible to 
>> do anything on the server
>>
>> As soon as I kill sysvshell.export, my L.A drops down to 1 again.
>>
>> I have diffed the sysvshell.export scripts for 1.5.7 and 1.5.8, and they 
>> are almost identical (except for some whitespace)
>>
>> I turned on logging in Postgres, and when I run the sysvshell.export 
>> script, it executes thousands of queries like this (I have about 1200 
>> services that are getting processed by this export), and am exporting to 
>> 1 host :
>>
>> Please Help,
>>
>> freeside1.5.8 LOG:  statement: begin
>> freeside1.5.8 LOG:  duration: 0.334 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'part_export'
>> freeside1.5.8 LOG:  duration: 6.001 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_export WHERE exporttype 
>> = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_1
>> freeside1.5.8 LOG:  duration: 0.247 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'export_svc'
>> freeside1.5.8 LOG:  duration: 0.845 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM export_svc WHERE exportnum = 
>> $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_2
>> freeside1.5.8 LOG:  duration: 0.233 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'cust_svc'
>> freeside1.5.8 LOG:  duration: 0.805 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_3
>> freeside1.5.8 LOG:  duration: 0.227 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_4
>> freeside1.5.8 LOG:  duration: 0.204 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_5
>> freeside1.5.8 LOG:  duration: 0.191 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_6
>> freeside1.5.8 LOG:  duration: 0.206 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_7
>> freeside1.5.8 LOG:  duration: 0.183 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_8
>> freeside1.5.8 LOG:  duration: 0.205 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_9
>> freeside1.5.8 LOG:  duration: 0.205 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_10
>> freeside1.5.8 LOG:  duration: 0.183 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_11
>> freeside1.5.8 LOG:  duration: 0.241 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_12
>> freeside1.5.8 LOG:  duration: 0.203 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_13
>> freeside1.5.8 LOG:  duration: 0.189 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_14
>> freeside1.5.8 LOG:  duration: 0.367 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_15
>> freeside1.5.8 LOG:  duration: 0.201 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_16
>> freeside1.5.8 LOG:  duration: 0.201 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'part_svc'
>> freeside1.5.8 LOG:  duration: 0.769 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_17
>> freeside1.5.8 LOG:  duration: 0.177 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'svc_acct'
>> freeside1.5.8 LOG:  duration: 0.775 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM svc_acct WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_19
>> freeside1.5.8 LOG:  duration: 0.205 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_20
>> freeside1.5.8 LOG:  duration: 0.184 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_21
>> freeside1.5.8 LOG:  duration: 0.180 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_22
>> freeside1.5.8 LOG:  duration: 0.266 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_23
>> freeside1.5.8 LOG:  duration: 0.184 ms
>> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE 
>> dbtable = 'part_svc_column'
>> freeside1.5.8 LOG:  duration: 0.791 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_24
>> freeside1.5.8 LOG:  duration: 0.184 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_25
>> freeside1.5.8 LOG:  duration: 0.178 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_26
>> freeside1.5.8 LOG:  duration: 0.176 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_27
>> freeside1.5.8 LOG:  duration: 0.176 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_28
>> freeside1.5.8 LOG:  duration: 0.178 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_29
>> freeside1.5.8 LOG:  duration: 0.174 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_30
>> freeside1.5.8 LOG:  duration: 0.175 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_31
>> freeside1.5.8 LOG:  duration: 0.248 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_32
>> freeside1.5.8 LOG:  duration: 0.181 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_33
>> freeside1.5.8 LOG:  duration: 0.177 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_34
>> freeside1.5.8 LOG:  duration: 0.177 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_35
>> freeside1.5.8 LOG:  duration: 0.178 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_36
>> freeside1.5.8 LOG:  duration: 0.250 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_37
>> freeside1.5.8 LOG:  duration: 0.177 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_38
>> freeside1.5.8 LOG:  duration: 0.176 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_39
>> freeside1.5.8 LOG:  duration: 0.176 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1 AND columnname = $2
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_40
>> freeside1.5.8 LOG:  duration: 0.178 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_41
>> freeside1.5.8 LOG:  duration: 0.185 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
>> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_42
>> freeside1.5.8 LOG:  duration: 0.185 ms
>> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE 
>> svcpart = $1
>>
>> --------------------------------------------------------------------------
>> The information transmitted is intended only for the person to whom it is
>> addressed and may contain confidential and/or privileged material.
>>
>> Although SCDS / Venturenet scans incoming and outgoing emails and email
>> attachments for viruses we cannot guarantee a communication to be free of
>> all viruses nor accept any responsibility for viruses.
>>
>> Although SCDS / Venturenet monitors incoming and outgoing emails for
>> inappropriate content, we cannot be held responsible for the views or
>> expressions of the author.
>>
>> The views expressed may not necessarily be those of SCDS / Venturenet and
>> as such, cannot be held responsible for any loss or injury resulting from
>> the contents of a message.
>> --------------------------------------------------------------------------
>>
>>
>
>> _______________________________________________
>> freeside-users mailing list
>> freeside-users at sisd.com
>> http://420.am/cgi-bin/mailman/listinfo/freeside-users
>
>
> _______________________________________________
> freeside-users mailing list
> freeside-users at sisd.com
> http://420.am/cgi-bin/mailman/listinfo/freeside-users
>
>
> -- 
> No virus found in this incoming message.
> Checked by AVG Free Edition.
> Version: 7.1.394 / Virus Database: 268.8.2/356 - Release Date: 2006/06/05
>
> 

--------------------------------------------------------------------------
The information transmitted is intended only for the person to whom it is 
addressed and may contain confidential and/or privileged material.

Although SCDS / Venturenet scans incoming and outgoing emails and email 
attachments for viruses we cannot guarantee a communication to be free of 
all viruses nor accept any responsibility for viruses. 

Although SCDS / Venturenet monitors incoming and outgoing emails for 
inappropriate content, we cannot be held responsible for the views or 
expressions of the author. 

The views expressed may not necessarily be those of SCDS / Venturenet and 
as such, cannot be held responsible for any loss or injury resulting from 
the contents of a message. 
--------------------------------------------------------------------------

More information about the freeside-users mailing list