Quantcast

Latency Issues

classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Latency Issues

Shafer, Philip
Latency Issues I’ve noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Andrew Nagy-4
Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general



------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Shafer, Philip
Re: [VuFind-General] Latency Issues We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

‘-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5’

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general




------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Delis, Christopher
Re: [VuFind-General] Latency Issues You already tried:

-Xms3800m -Xmx3800m

?

--Chris


On 1/22/09 1:59 PM, "Philip Shafer" <shafer@...> wrote:

We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

‘-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5’

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <asnagy@...>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <shafer@...>
Cc: <vufind-general@...>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <shafer@...> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
VuFind-General@...
https://lists.sourceforge.net/lists/listinfo/vufind-general





------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword

_______________________________________________
VuFind-General mailing list
VuFind-General@...
https://lists.sourceforge.net/lists/listinfo/vufind-general

------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Andrew Nagy-4
In reply to this post by Shafer, Philip
Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general





------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Shafer, Philip
Re: [VuFind-General] Latency Issues Been doing the firebug thing for a while. The AJAX stuff looks to be running a little faster (then again I’m on campus so my connection is faster), right now it looks like the slowest part of the application is the book covers.  I’ll check from home later tonight. I looks like some of those requests are timing out after a while.  I was able to start the the java solr with 2048M of heap space.  We had the heap size at 1024 so doubling it definitely helped.  I tried 3800M and it just would start the service, it said it started, but then when I checked it wasn’t acutally running.


------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:20:08 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general






------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Andrew Nagy-4
Well the book covers is completely PHP.  So you will want to optimize apache for that.

Andrew

On Thu, Jan 22, 2009 at 4:29 PM, Philip Shafer <[hidden email]> wrote:
Been doing the firebug thing for a while. The AJAX stuff looks to be running a little faster (then again I'm on campus so my connection is faster), right now it looks like the slowest part of the application is the book covers.  I'll check from home later tonight. I looks like some of those requests are timing out after a while.  I was able to start the the java solr with 2048M of heap space.  We had the heap size at 1024 so doubling it definitely helped.  I tried 3800M and it just would start the service, it said it started, but then when I checked it wasn't acutally running.



------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:20:08 -0500

To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general







------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Shafer, Philip
Re: [VuFind-General] Latency Issues It sure is, any suggestions? I know there has been discussions on this issue.

However, I’m still concerned about not being able to increase the heap larger than 2048.


------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:43:04 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well the book covers is completely PHP.  So you will want to optimize apache for that.

Andrew

On Thu, Jan 22, 2009 at 4:29 PM, Philip Shafer <[hidden email]> wrote:
Been doing the firebug thing for a while. The AJAX stuff looks to be running a little faster (then again I'm on campus so my connection is faster), right now it looks like the slowest part of the application is the book covers.  I'll check from home later tonight. I looks like some of those requests are timing out after a while.  I was able to start the the java solr with 2048M of heap space.  We had the heap size at 1024 so doubling it definitely helped.  I tried 3800M and it just would start the service, it said it started, but then when I checked it wasn't acutally running.



------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:20:08 -0500

To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general








------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Bill Dueber-2
In reply to this post by Shafer, Philip
I can say without a shred of doubt that solr is by *far* not the bottleneck in our stuff.

We're running solr and vufind code on the same machine, with a 32-bit linux os and 2.2GB allocated to the java heap.

I did the following:

  - Got a bunch of search terms from our current OPAC
  - Turned these into search URLs for vufind
  - Ran them through jmeter to stress-test our vufind install
  - Pulled the actual queries that ran from the jetty log
  - Used jmeter to run *those* queries directly against the solr install, and compare

Solr throughput was (depending on threads and such) about 150 requests/second; going through vufind brought that down by about an order of magnitude, and then some.

So, I would say, "Look for bottlenecks, but (if your setup is anything like ours) don't waste your time looking for them in solr."

On Thu, Jan 22, 2009 at 4:29 PM, Philip Shafer <[hidden email]> wrote:
Been doing the firebug thing for a while. The AJAX stuff looks to be running a little faster (then again I'm on campus so my connection is faster), right now it looks like the slowest part of the application is the book covers.  I'll check from home later tonight. I looks like some of those requests are timing out after a while.  I was able to start the the java solr with 2048M of heap space.  We had the heap size at 1024 so doubling it definitely helped.  I tried 3800M and it just would start the service, it said it started, but then when I checked it wasn't acutally running.



------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:20:08 -0500

To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general






------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general




--
Bill Dueber
Library Systems Programmer
University of Michigan Library

------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Greg Pendlebury
In reply to this post by Shafer, Philip
Re: [VuFind-General] Latency Issues
I wouldn't get too concerned Phil.
 
On a vm with 4gb you are already using 50% for solr. You want to leave enough for apache/php to function with many people hitting it, your OS of course needs it's cut, and the import process needs to fire up another JVM again to run.
 
Sail too close to the wind and you'll start excessively using swap space and cause worse problems then you started with. You might be able to increase it a little... I normally go back to the sysadmins for detailed advice on this stuff, but 3800 out of 4096 screams "Too much" to me.
 

Greg Pendlebury
Electronic Services Officer (Systems Team)
Division of Academic Information Services
University of Southern Queensland
Phone: +61 7 4631 1501
Fax: +61 7 4631 1841

 


From: Philip Shafer [mailto:[hidden email]]
Sent: Friday, 23 January 2009 7:46 AM
To: Andrew Nagy
Cc: [hidden email]
Subject: Re: [VuFind-General] Latency Issues

It sure is, any suggestions? I know there has been discussions on this issue.

However, I’m still concerned about not being able to increase the heap larger than 2048.


------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:43:04 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well the book covers is completely PHP.  So you will want to optimize apache for that.

Andrew

On Thu, Jan 22, 2009 at 4:29 PM, Philip Shafer <[hidden email]> wrote:
Been doing the firebug thing for a while. The AJAX stuff looks to be running a little faster (then again I'm on campus so my connection is faster), right now it looks like the slowest part of the application is the book covers.  I'll check from home later tonight. I looks like some of those requests are timing out after a while.  I was able to start the the java solr with 2048M of heap space.  We had the heap size at 1024 so doubling it definitely helped.  I tried 3800M and it just would start the service, it said it started, but then when I checked it wasn't acutally running.



------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Thu, 22 Jan 2009 16:20:08 -0500

To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Well it seems that everything that looks to be slow for you is coming in via AJAX.  Install the firebug plugin for firefox and run a search with the firebug console open.  That should give you an idea as to what javascript functions are running slow.

Let us know what you see when running a search with firebug open.

Andrew

On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]> wrote:
We just re-allocated our VM from 2048M of memory to 4096M.  However, the most I can allocate the heap is at 2048M

Here is the JAVA_OPTIONS

'-server -Xmx2048m -Xms2048m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5'

Any suggestions?

-Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax




From: Andrew Nagy <[hidden email]>
Date: Wed, 21 Jan 2009 15:08:14 -0500
To: Philip Shafer <[hidden email]>
Cc: <[hidden email]>
Subject: Re: [VuFind-General] Latency Issues

Have you had a look at the performance page on the vufind wiki?

http://vufind.org/wiki/performance

Start there and let us know if you have any better performance.

Andrew

On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer <[hidden email]> wrote:
I've noticed that there are some latency issues with vufind after performing a search it seams to take some time for Holdings and Call number, as well as facets to appear.

I have also noticed that the book covers feature seems to not work most of the time.

Has anyone experienced similar problems, is there any tuning that I can do on the server to speed things up?

Thanks,

Phil
------------------------------

Philip Shafer
Library System Services
Rowan University Library
201 Mullica Hill Rd
Glassboro, NJ  08028
856-256-4418
856-256-4924 Fax


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general








This email (including any attached files) is confidential and is for the intended recipient(s) only. If you received this email by mistake, please, as a courtesy, tell the sender, then delete this email.

The views and opinions are the originator's and do not necessarily reflect those of the University of Southern Queensland. Although all reasonable precautions were taken to ensure that this email contained no viruses at the time it was sent we accept no liability for any losses arising from its receipt.

The University of Southern Queensland is a registered provider of education with the Australian Government (CRICOS Institution Code No's. QLD 00244B / NSW 02225M)
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Till Kinstler
In reply to this post by Bill Dueber-2
Bill Dueber schrieb:

> So, I would say, "Look for bottlenecks, but (if your setup is anything
> like ours) don't waste your time looking for them in solr."

There are/were some bottlenecks in Solr that may affect VuFind
(depending on your implementation). Solr 1.3 (which is used in VuFind
RC1, I don't know if the current svn tree uses a more recent version of
Solr) is very slow faceting multivalued index fields with many unique
values (though I am not sure if vanilla VuFind uses facets on
multivalued fields currently, our customization does e.g. for
author/person names). Since around December Solr nightly versions have a
patch that speeds up faceting significantly. I posted some results using
the old and the new faceting algorithm in a thread on the solr-user list
discussing the changes, see
http://www.nabble.com/new-faceting-algorithm-to20674902.html#a20851598


--
Till Kinstler
Verbundzentrale des Gemeinsamen Bibliotheksverbundes (VZG)
Platz der Göttinger Sieben 1, D 37073 Göttingen
[hidden email], +49 (0) 551 39-13431, http://www.gbv.de

------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

wsgrah
Administrator
In reply to this post by Andrew Nagy-4
Does turning on caching for Smarty help? I don't think it's on by default...

Andrew Nagy wrote:

> Well the book covers is completely PHP.  So you will want to optimize
> apache for that.
>
> Andrew
>
> On Thu, Jan 22, 2009 at 4:29 PM, Philip Shafer <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Been doing the firebug thing for a while. The AJAX stuff looks to
>     be running a little faster (then again I'm on campus so my
>     connection is faster), right now it looks like the slowest part of
>     the application is the book covers.  I'll check from home later
>     tonight. I looks like some of those requests are timing out after
>     a while.  I was able to start the the java solr with 2048M of heap
>     space.  We had the heap size at 1024 so doubling it definitely
>     helped.  I tried 3800M and it just would start the service, it
>     said it started, but then when I checked it wasn't acutally running.
>
>
>
>     ------------------------------
>
>     Philip Shafer
>     Library System Services
>     Rowan University Library
>     201 Mullica Hill Rd
>     Glassboro, NJ  08028
>     856-256-4418
>     856-256-4924 Fax
>
>
>
>     ------------------------------------------------------------------------
>     *From: *Andrew Nagy <[hidden email] <mailto:[hidden email]>>
>     *Date: *Thu, 22 Jan 2009 16:20:08 -0500
>
>     *To: *Philip Shafer <[hidden email] <mailto:[hidden email]>>
>     *Cc: *<[hidden email]
>     <mailto:[hidden email]>>
>     *Subject: *Re: [VuFind-General] Latency Issues
>
>     Well it seems that everything that looks to be slow for you is
>     coming in via AJAX.  Install the firebug plugin for firefox and
>     run a search with the firebug console open.  That should give you
>     an idea as to what javascript functions are running slow.
>
>     Let us know what you see when running a search with firebug open.
>
>     Andrew
>
>     On Thu, Jan 22, 2009 at 2:59 PM, Philip Shafer <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         We just re-allocated our VM from 2048M of memory to 4096M.
>          However, the most I can allocate the heap is at 2048M
>
>         Here is the JAVA_OPTIONS
>
>         '-server -Xmx2048m -Xms2048m -XX:+UseParallelGC
>         -XX:+AggressiveOpts -XX:NewRatio=5'
>
>         Any suggestions?
>
>         -Phil
>         ------------------------------
>
>         Philip Shafer
>         Library System Services
>         Rowan University Library
>         201 Mullica Hill Rd
>         Glassboro, NJ  08028
>         856-256-4418
>         856-256-4924 Fax
>
>
>
>         ------------------------------------------------------------------------
>         *From: *Andrew Nagy <[hidden email] <mailto:[hidden email]>>
>         *Date: *Wed, 21 Jan 2009 15:08:14 -0500
>         *To: *Philip Shafer <[hidden email] <mailto:[hidden email]>>
>         *Cc: *<[hidden email]
>         <mailto:[hidden email]>>
>         *Subject: *Re: [VuFind-General] Latency Issues
>
>         Have you had a look at the performance page on the vufind wiki?
>
>         http://vufind.org/wiki/performance
>
>         Start there and let us know if you have any better performance.
>
>         Andrew
>
>         On Wed, Jan 21, 2009 at 12:52 PM, Philip Shafer
>         <[hidden email] <mailto:[hidden email]>> wrote:
>
>             I've noticed that there are some latency issues with
>             vufind after performing a search it seams to take some
>             time for Holdings and Call number, as well as facets to
>             appear.
>
>             I have also noticed that the book covers feature seems to
>             not work most of the time.
>
>             Has anyone experienced similar problems, is there any
>             tuning that I can do on the server to speed things up?
>
>             Thanks,
>
>             Phil
>             ------------------------------
>
>             Philip Shafer
>             Library System Services
>             Rowan University Library
>             201 Mullica Hill Rd
>             Glassboro, NJ  08028
>             856-256-4418
>             856-256-4924 Fax
>
>
>             ------------------------------------------------------------------------------
>             This SF.net email is sponsored by:
>             SourcForge Community
>             SourceForge wants to tell your story.
>             http://p.sf.net/sfu/sf-spreadtheword
>             _______________________________________________
>             VuFind-General mailing list
>             [hidden email]
>             <mailto:[hidden email]>
>             https://lists.sourceforge.net/lists/listinfo/vufind-general
>
>
>
>
>
>
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by:
> SourcForge Community
> SourceForge wants to tell your story.
> http://p.sf.net/sfu/sf-spreadtheword
> ------------------------------------------------------------------------
>
> _______________________________________________
> VuFind-General mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/vufind-general
>  

--
/**
  * Wayne Graham
  * Earl Gregg Swem Library
  * PO Box 8794
  * Williamsburg, VA 23188
  * 757.221.3112
  * http://swem.wm.edu/blogs/waynegraham/
  * http://www.liquidfoot.com
  */



------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Latency Issues

Andrew Nagy-4

On Fri, Jan 23, 2009 at 11:35 AM, Wayne Graham <[hidden email]> wrote:
Does turning on caching for Smarty help? I don't think it's on by default...

No, not yet.  Implementing UI level caching is difficult for search results.  I am working on this for record views however.

Andrew


------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
VuFind-General mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-general
Loading...