Quantcast

Error while harvesting

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Error while harvesting

Dp Tripathi-2
Dear All,

Please excuse if the question has already been asked and I am not able to solve the problem.

I am harvesting the records from Koha server.

While harvesting, it harvested record successfully.

root@localhost:/usr/local/vufind/harvest# php harvest_oai.php
Processing BK...
Autodetecting date granularity... found YYYY-MM-DD.
Processing 1 records...
Completed without errors -- 1 source(s) processed.
root@localhost:/usr/local/vufind/harvest#


--------------------------------------------

But when I am running the script (./batch-import-marc.sh) it shows the following and does not index any record.

root@localhost:/usr/local/vufind/harvest# ./batch-import-marc.sh BK

Now Importing /usr/local/vufind/local//harvest/BK/1482993387_KOHA_OAI_TEST_1.xml ...
 INFO [main] (MarcImporter.java:849) - Starting SolrMarc indexing.
 INFO [main] (Utils.java:340) - Opening file: /usr/local/vufind/local/import/import.properties
 INFO [main] (MarcImporter.java:782) -  Connecting to remote Solr server at URL http://localhost:8080/solr/biblio/update
 INFO [main] (MarcHandler.java:371) - Attempting to open data file: /usr/local/vufind/local/harvest/BK/1482993387_KOHA_OAI_TEST_1.xml
 INFO [main] (MarcImporter.java:615) -  Adding 0 of 0 documents to index
 INFO [main] (MarcImporter.java:616) -  Deleting 0 documents from index
 INFO [main] (MarcImporter.java:490) - Calling commit (with optimize set to false)
 INFO [main] (MarcImporter.java:502) - Done with the commit, closing Solr
 INFO [main] (MarcImporter.java:505) - Setting Solr closed flag
 INFO [main] (MarcImporter.java:625) - Finished indexing in 0:00.00
 INFO [main] (MarcImporter.java:634) - Indexed 0 at a rate of about 0.0 per sec
 INFO [main] (MarcImporter.java:635) - Deleted 0 records
 INFO [Thread-2] (MarcImporter.java:565) - Starting Shutdown hook
 INFO [Thread-2] (MarcImporter.java:584) - Finished Shutdown hook
root@localhost:/usr/local/vufind/harvest#

I checked in VuFind, it does not find any record over there.

Please assist.

With regards,
DP Tripathi
NIT Rourkela
India

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Error while harvesting

P. S. Mukhopadhyay
Dear Tripathi

In may case I kept import.properties and marc_local.properties in vufind/local/import directory and changed values there; In import.properties file the lines solr.hosturl = http://localhost:9090/solr/biblio/update (9090 is the port I'm using) and solrmarc.path = /usr/local/vufind/local/import|/usr/local/vufind/import (instructing to use local customized file first) are important. pl check these two entities.

Best wishes

On Sat, Jan 7, 2017 at 7:43 AM, Dp Tripathi <[hidden email]> wrote:
Dear All,

Please excuse if the question has already been asked and I am not able to solve the problem.

I am harvesting the records from Koha server.

While harvesting, it harvested record successfully.

root@localhost:/usr/local/vufind/harvest# php harvest_oai.php
Processing BK...
Autodetecting date granularity... found YYYY-MM-DD.
Processing 1 records...
Completed without errors -- 1 source(s) processed.
root@localhost:/usr/local/vufind/harvest#


--------------------------------------------

But when I am running the script (./batch-import-marc.sh) it shows the following and does not index any record.

root@localhost:/usr/local/vufind/harvest# ./batch-import-marc.sh BK

Now Importing /usr/local/vufind/local//harvest/BK/1482993387_KOHA_OAI_TEST_1.xml ...
 INFO [main] (MarcImporter.java:849) - Starting SolrMarc indexing.
 INFO [main] (Utils.java:340) - Opening file: /usr/local/vufind/local/import/import.properties
 INFO [main] (MarcImporter.java:782) -  Connecting to remote Solr server at URL http://localhost:8080/solr/biblio/update
 INFO [main] (MarcHandler.java:371) - Attempting to open data file: /usr/local/vufind/local/harvest/BK/1482993387_KOHA_OAI_TEST_1.xml
 INFO [main] (MarcImporter.java:615) -  Adding 0 of 0 documents to index
 INFO [main] (MarcImporter.java:616) -  Deleting 0 documents from index
 INFO [main] (MarcImporter.java:490) - Calling commit (with optimize set to false)
 INFO [main] (MarcImporter.java:502) - Done with the commit, closing Solr
 INFO [main] (MarcImporter.java:505) - Setting Solr closed flag
 INFO [main] (MarcImporter.java:625) - Finished indexing in 0:00.00
 INFO [main] (MarcImporter.java:634) - Indexed 0 at a rate of about 0.0 per sec
 INFO [main] (MarcImporter.java:635) - Deleted 0 records
 INFO [Thread-2] (MarcImporter.java:565) - Starting Shutdown hook
 INFO [Thread-2] (MarcImporter.java:584) - Finished Shutdown hook
root@localhost:/usr/local/vufind/harvest#

I checked in VuFind, it does not find any record over there.

Please assist.

With regards,
DP Tripathi
NIT Rourkela
India

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech




--
-----------------------------------------------------------------------
Dr. Parthasarathi Mukhopadhyay
Associate Professor, Department of Library and Information Science, University of Kalyani,
Kalyani - 741 235 (WB), India
-----------------------------------------------------------------------

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Error while harvesting

P. S. Mukhopadhyay
And in marc_local.properties the line id = 999c, first is important for Koha (as Koha stores biblounique id there).

On Sat, Jan 7, 2017 at 10:26 PM, P. S. Mukhopadhyay <[hidden email]> wrote:
Dear Tripathi

In may case I kept import.properties and marc_local.properties in vufind/local/import directory and changed values there; In import.properties file the lines solr.hosturl = http://localhost:9090/solr/biblio/update (9090 is the port I'm using) and solrmarc.path = /usr/local/vufind/local/import|/usr/local/vufind/import (instructing to use local customized file first) are important. pl check these two entities.

Best wishes

On Sat, Jan 7, 2017 at 7:43 AM, Dp Tripathi <[hidden email]> wrote:
Dear All,

Please excuse if the question has already been asked and I am not able to solve the problem.

I am harvesting the records from Koha server.

While harvesting, it harvested record successfully.

root@localhost:/usr/local/vufind/harvest# php harvest_oai.php
Processing BK...
Autodetecting date granularity... found YYYY-MM-DD.
Processing 1 records...
Completed without errors -- 1 source(s) processed.
root@localhost:/usr/local/vufind/harvest#


--------------------------------------------

But when I am running the script (./batch-import-marc.sh) it shows the following and does not index any record.

root@localhost:/usr/local/vufind/harvest# ./batch-import-marc.sh BK

Now Importing /usr/local/vufind/local//harvest/BK/1482993387_KOHA_OAI_TEST_1.xml ...
 INFO [main] (MarcImporter.java:849) - Starting SolrMarc indexing.
 INFO [main] (Utils.java:340) - Opening file: /usr/local/vufind/local/import/import.properties
 INFO [main] (MarcImporter.java:782) -  Connecting to remote Solr server at URL http://localhost:8080/solr/biblio/update
 INFO [main] (MarcHandler.java:371) - Attempting to open data file: /usr/local/vufind/local/harvest/BK/1482993387_KOHA_OAI_TEST_1.xml
 INFO [main] (MarcImporter.java:615) -  Adding 0 of 0 documents to index
 INFO [main] (MarcImporter.java:616) -  Deleting 0 documents from index
 INFO [main] (MarcImporter.java:490) - Calling commit (with optimize set to false)
 INFO [main] (MarcImporter.java:502) - Done with the commit, closing Solr
 INFO [main] (MarcImporter.java:505) - Setting Solr closed flag
 INFO [main] (MarcImporter.java:625) - Finished indexing in 0:00.00
 INFO [main] (MarcImporter.java:634) - Indexed 0 at a rate of about 0.0 per sec
 INFO [main] (MarcImporter.java:635) - Deleted 0 records
 INFO [Thread-2] (MarcImporter.java:565) - Starting Shutdown hook
 INFO [Thread-2] (MarcImporter.java:584) - Finished Shutdown hook
root@localhost:/usr/local/vufind/harvest#

I checked in VuFind, it does not find any record over there.

Please assist.

With regards,
DP Tripathi
NIT Rourkela
India

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech




--
-----------------------------------------------------------------------
Dr. Parthasarathi Mukhopadhyay
Associate Professor, Department of Library and Information Science, University of Kalyani,
Kalyani - 741 235 (WB), India
-----------------------------------------------------------------------



--
-----------------------------------------------------------------------
Dr. Parthasarathi Mukhopadhyay
Associate Professor, Department of Library and Information Science, University of Kalyani,
Kalyani - 741 235 (WB), India
-----------------------------------------------------------------------

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Loading...