Quantcast

Solr on redhat 7 problem loading the dashboard

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Solr on redhat 7 problem loading the dashboard

Bradley Busenius

We're trying to spin up a new vufind instance on Redhat 7 and we're getting a weird problem that we don't fully understand. When we run ./solar.sh start the script seems to execute and everything seems to be working properly, however, when we go to the url ...:8080/solr/#/ the dashboard fails to load. We get an error message, "The connection was reset" in firefox or, "The page isn’t working, ERR_EMPTY_RESPONSE" in chrome.

When we look at the solr logs everything looks okay as far as we can tell and when we look at the process it seems to be running on port 8080.

ps -fwwww
UID        PID  PPID  C STIME TTY          TIME CMD
vuadmin  19377     1  0 12:01 pts/0    00:00:07 java -server -Xms1G -Xmx1G -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xverbosegclog:/vufind/vufind/solr/vufind/logs/solr_gc.log -Djetty.port=8080 -DSTOP.PORT=7080 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/vufind/vufind/solr/vendor/server -Dsolr.solr.home=/vufind/vufind/solr/vufind -Dsolr.install.dir=/vufind/vufind/solr/vendor -Xss256k -Dsolr.log=/vufind/vufind/solr/vufind/logs -jar start.jar -XX:OnOutOfMemoryError=/vufind/vufind/solr/vendor/bin/oom_solr.sh 8080 /vufind/vufind/solr/vufind/logs --module=http
vuadmin  28585 28584  0 Mar15 pts/0    00:00:00 -bash
vuadmin  57826 28585  0 13:01 pts/0    00:00:00 ps -fwwww

When we run netstat and look for 8080 nothing appears, e.g. netstat -a | grep -E '(8080|7080)' doesn't return anything.

I'm not sure if this is the right question but is there a reason the process would fail to bind to port 8080? Is there something else going on? Any suggestions would be greatly appreciated.

-Brad




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr on redhat 7 problem loading the dashboard

Uwe Reh
Hi Brad,

for me it looks like solr wasn't able to start properly for any reason.
If your OS isn't extremely hardened, the Port schouldn't be the problem.

Maybe one of the default parameters (ulimit) is set by Redhat to low.
Maybe your OS is not willing to grant 1Gb of heap.

Below /vufind/vufind/solr/vufind/logs, you should find a logfile from
Solr. (perhaps 'solr-8080-console.log') For a better guess, it would
help to know this output.

Uwe



Am 16.03.2017 um 19:12 schrieb Brad Busenius:

> We're trying to spin up a new vufind instance on Redhat 7 and we're
> getting a weird problem that we don't fully understand. When we run
> ./solar.sh start the script seems to execute and everything seems to be
> working properly, however, when we go to the url ...:8080/solr/#/ the
> dashboard fails to load. We get an error message, "The connection was
> reset" in firefox or, "The page isn’t working, ERR_EMPTY_RESPONSE" in
> chrome.
>
> When we look at the solr logs everything looks okay as far as we can
> tell and when we look at the process it seems to be running on port 8080.
>
>     ps -fwwww
>     UID        PID  PPID  C STIME TTY          TIME CMD
>     vuadmin  19377     1  0 12:01 pts/0    00:00:07 java -server -Xms1G
>     -Xmx1G -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90
>     -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC
>     -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4
>     -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m
>     -XX:+UseCMSInitiatingOccupancyOnly
>     -XX:CMSInitiatingOccupancyFraction=50
>     -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled
>     -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC
>     -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
>     -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime
>     -Xverbosegclog:/vufind/vufind/solr/vufind/logs/solr_gc.log
>     -Djetty.port=8080 -DSTOP.PORT=7080 -DSTOP.KEY=solrrocks
>     -Duser.timezone=UTC -Djetty.home=/vufind/vufind/solr/vendor/server
>     -Dsolr.solr.home=/vufind/vufind/solr/vufind
>     -Dsolr.install.dir=/vufind/vufind/solr/vendor -Xss256k
>     -Dsolr.log=/vufind/vufind/solr/vufind/logs -jar start.jar
>     -XX:OnOutOfMemoryError=/vufind/vufind/solr/vendor/bin/oom_solr.sh
>     8080 /vufind/vufind/solr/vufind/logs --module=http
>     vuadmin  28585 28584  0 Mar15 pts/0    00:00:00 -bash
>     vuadmin  57826 28585  0 13:01 pts/0    00:00:00 ps -fwwww
>
> When we run netstat and look for 8080 nothing appears, e.g. netstat -a |
> grep -E '(8080|7080)' doesn't return anything.
>
> I'm not sure if this is the right question but is there a reason the
> process would fail to bind to port 8080? Is there something else going
> on? Any suggestions would be greatly appreciated.
>
> -Brad
>
>
>
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
>
> _______________________________________________
> Vufind-tech mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/vufind-tech
>

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr on redhat 7 problem loading the dashboard

Demian Katz
In reply to this post by Bradley Busenius

Does import-marc.sh work? Is it possible that SELinux is a factor here? Does “setenforce 0” change the situation? (Obviously turning off SELinux is not a permanent solution, but it can help determine whether or not that is a factor).

 

- Demian

 

From: Brad Busenius [mailto:[hidden email]]
Sent: Thursday, March 16, 2017 2:13 PM
To: [hidden email]
Subject: [VuFind-Tech] Solr on redhat 7 problem loading the dashboard

 

We're trying to spin up a new vufind instance on Redhat 7 and we're getting a weird problem that we don't fully understand. When we run ./solar.sh start the script seems to execute and everything seems to be working properly, however, when we go to the url ...:8080/solr/#/ the dashboard fails to load. We get an error message, "The connection was reset" in firefox or, "The page isn’t working, ERR_EMPTY_RESPONSE" in chrome.

When we look at the solr logs everything looks okay as far as we can tell and when we look at the process it seems to be running on port 8080.

ps -fwwww
UID        PID  PPID  C STIME TTY          TIME CMD
vuadmin  19377     1  0 12:01 pts/0    00:00:07 java -server -Xms1G -Xmx1G -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xverbosegclog:/vufind/vufind/solr/vufind/logs/solr_gc.log -Djetty.port=8080 -DSTOP.PORT=7080 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/vufind/vufind/solr/vendor/server -Dsolr.solr.home=/vufind/vufind/solr/vufind -Dsolr.install.dir=/vufind/vufind/solr/vendor -Xss256k -Dsolr.log=/vufind/vufind/solr/vufind/logs -jar start.jar -XX:OnOutOfMemoryError=/vufind/vufind/solr/vendor/bin/oom_solr.sh 8080 /vufind/vufind/solr/vufind/logs --module=http
vuadmin  28585 28584  0 Mar15 pts/0    00:00:00 -bash
vuadmin  57826 28585  0 13:01 pts/0    00:00:00 ps -fwwww

When we run netstat and look for 8080 nothing appears, e.g. netstat -a | grep -E '(8080|7080)' doesn't return anything.

I'm not sure if this is the right question but is there a reason the process would fail to bind to port 8080? Is there something else going on? Any suggestions would be greatly appreciated.

-Brad

 

 


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr on redhat 7 problem loading the dashboard

Bradley Busenius
In reply to this post by Uwe Reh
Uwe, Demian,

Thanks for your suggestions! I was directed down a different path by our
sysadmins but wanted to follow up in case someone else runs into
something similar. In the end this was just a simple case of a firewall.
In our case it was a hardware firewall maintained by central IT.

Brad


On 3/16/17 3:45 PM, Uwe Reh wrote:

> Hi Brad,
>
> for me it looks like solr wasn't able to start properly for any reason.
> If your OS isn't extremely hardened, the Port schouldn't be the problem.
>
> Maybe one of the default parameters (ulimit) is set by Redhat to low.
> Maybe your OS is not willing to grant 1Gb of heap.
>
> Below /vufind/vufind/solr/vufind/logs, you should find a logfile from
> Solr. (perhaps 'solr-8080-console.log') For a better guess, it would
> help to know this output.
>
> Uwe
>
>
>
> Am 16.03.2017 um 19:12 schrieb Brad Busenius:
>> We're trying to spin up a new vufind instance on Redhat 7 and we're
>> getting a weird problem that we don't fully understand. When we run
>> ./solar.sh start the script seems to execute and everything seems to be
>> working properly, however, when we go to the url ...:8080/solr/#/ the
>> dashboard fails to load. We get an error message, "The connection was
>> reset" in firefox or, "The page isn’t working, ERR_EMPTY_RESPONSE" in
>> chrome.
>>
>> When we look at the solr logs everything looks okay as far as we can
>> tell and when we look at the process it seems to be running on port 8080.
>>
>>      ps -fwwww
>>      UID        PID  PPID  C STIME TTY          TIME CMD
>>      vuadmin  19377     1  0 12:01 pts/0    00:00:07 java -server -Xms1G
>>      -Xmx1G -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90
>>      -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC
>>      -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4
>>      -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m
>>      -XX:+UseCMSInitiatingOccupancyOnly
>>      -XX:CMSInitiatingOccupancyFraction=50
>>      -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled
>>      -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC
>>      -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
>>      -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime
>>      -Xverbosegclog:/vufind/vufind/solr/vufind/logs/solr_gc.log
>>      -Djetty.port=8080 -DSTOP.PORT=7080 -DSTOP.KEY=solrrocks
>>      -Duser.timezone=UTC -Djetty.home=/vufind/vufind/solr/vendor/server
>>      -Dsolr.solr.home=/vufind/vufind/solr/vufind
>>      -Dsolr.install.dir=/vufind/vufind/solr/vendor -Xss256k
>>      -Dsolr.log=/vufind/vufind/solr/vufind/logs -jar start.jar
>>      -XX:OnOutOfMemoryError=/vufind/vufind/solr/vendor/bin/oom_solr.sh
>>      8080 /vufind/vufind/solr/vufind/logs --module=http
>>      vuadmin  28585 28584  0 Mar15 pts/0    00:00:00 -bash
>>      vuadmin  57826 28585  0 13:01 pts/0    00:00:00 ps -fwwww
>>
>> When we run netstat and look for 8080 nothing appears, e.g. netstat -a |
>> grep -E '(8080|7080)' doesn't return anything.
>>
>> I'm not sure if this is the right question but is there a reason the
>> process would fail to bind to port 8080? Is there something else going
>> on? Any suggestions would be greatly appreciated.
>>
>> -Brad
>>
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>
>>
>>
>> _______________________________________________
>> Vufind-tech mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/vufind-tech
>>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Vufind-tech mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/vufind-tech


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Loading...