Quantcast

MARC Import Error

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

MARC Import Error

Johannes Ruscheinski
Hi,

We just started getting a mysterious error while running
import-marc.sh.  A part of the error message is


Error processing index configurations: marc.properties,
marc_local.properties
ERROR [main] (IndexDriver.java:328) - topic =
custom(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin), getAllTopics
ERROR [main] (IndexDriver.java:330) - topic : Error on test invocation
of custom method:
custom(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin), getAllTopics
ERROR [main] (IndexDriver.java:333) - topic : null

...


We'd be grateful for any suggestions on how to deal with this class of
errors.

Thanks.

-Johannes

--
Dr. Johannes Ruscheinski
Universitätsbibliothek Tübingen - IT-Abteilung -
Wilhelmstr. 32, 72074 Tübingen

Tel: +49 7071 29-72820
FAX: +49 7071 29-5069
Email: [hidden email]



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: MARC Import Error

Uwe Reh
Am 14.03.2017 um 10:07 schrieb Johannes Ruscheinski:
> Error processing index configurations: marc.properties,
> marc_local.properties
> ERROR [main] (IndexDriver.java:328) - topic =
> custom(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin), getAllTopics

Hi Johannes,

looks like a DIY problem.

You are using own (custom) Java code to process the topics
(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin).
When your log says "Error on test invocation of custom method", I would
suggest to check your configuration:
- Is the call in marc.properties compatible to the signature of your method?
- Is there probably an old version of your class anywhere an could be
found in the classpath first?
- May your class missing any resources?
- ...

Uwe

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: MARC Import Error

Demian Katz

The problem here is that SolrMarc tests custom methods by sending a hard-coded sample record into them before doing actual indexing. If something about the example record causes the method to fail, the whole import process is stopped. Bob Haschart is aware of this, and I believe he is planning on changing this behavior. However, for the moment, it is something we need to work around. You might want to check your code and see if it has hard-coded assumptions that will cause fatal errors if certain fields are missing or contain unexpected values; you may be able to solve this by making your code a bit more error-tolerant. I'm copying the solrmarc-tech list so Bob can weigh in with more details.


- Demian




From: Uwe Reh <[hidden email]>
Sent: Tuesday, March 14, 2017 6:10 AM
To: [hidden email]
Subject: Re: [VuFind-Tech] MARC Import Error
 
Am 14.03.2017 um 10:07 schrieb Johannes Ruscheinski:
> Error processing index configurations: marc.properties,
> marc_local.properties
> ERROR [main] (IndexDriver.java:328) - topic =
> custom(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin), getAllTopics

Hi Johannes,

looks like a DIY problem.

You are using own (custom) Java code to process the topics
(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin).
When your log says "Error on test invocation of custom method", I would
suggest to check your configuration:
- Is the call in marc.properties compatible to the signature of your method?
- Is there probably an old version of your class anywhere an could be
found in the classpath first?
- May your class missing any resources?
- ...

Uwe

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsdm.link%2Fslashdot&data=02%7C01%7Cdemian.katz%40villanova.edu%7C4dd70febf11a422aeb5508d46ac50cd9%7C765a8de5cf9444f09cafae5bf8cfa366%7C1%7C0%7C636250841970192558&sdata=qhgTmCNhL9u2joQr2SBsbBrjxxt7uCXzxt%2BfZDTXWrI%3D&reserved=0
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fvufind-tech&data=02%7C01%7Cdemian.katz%40villanova.edu%7C4dd70febf11a422aeb5508d46ac50cd9%7C765a8de5cf9444f09cafae5bf8cfa366%7C1%7C0%7C636250841970192558&sdata=jUJMAjpXTZQmaV088k3vyc9kEHfyCFeZ4J4p7Lkzs5M%3D&reserved=0

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: [solrmarc-tech] Re: MARC Import Error

Robert Haschart
I'll have to  take a look, but the code doing the test invocation of custom methods, is now able to be disabled, and I think it is now disabled by default.

Also only a short segment of the error message was included in the forwarded message, so I can't quite tell what is going wrong.

-Bob

On 3/14/2017 8:48 AM, Demian Katz wrote:

The problem here is that SolrMarc tests custom methods by sending a hard-coded sample record into them before doing actual indexing. If something about the example record causes the method to fail, the whole import process is stopped. Bob Haschart is aware of this, and I believe he is planning on changing this behavior. However, for the moment, it is something we need to work around. You might want to check your code and see if it has hard-coded assumptions that will cause fatal errors if certain fields are missing or contain unexpected values; you may be able to solve this by making your code a bit more error-tolerant. I'm copying the solrmarc-tech list so Bob can weigh in with more details.


- Demian




From: Uwe Reh [hidden email]
Sent: Tuesday, March 14, 2017 6:10 AM
To: [hidden email]
Subject: Re: [VuFind-Tech] MARC Import Error
 
Am 14.03.2017 um 10:07 schrieb Johannes Ruscheinski:
> Error processing index configurations: marc.properties,
> marc_local.properties
> ERROR [main] (IndexDriver.java:328) - topic =
> custom(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin), getAllTopics

Hi Johannes,

looks like a DIY problem.

You are using own (custom) Java code to process the topics
(de.unituebingen.ub.ubtools.solrmarcMixin.TuelibMixin).
When your log says "Error on test invocation of custom method", I would
suggest to check your configuration:
- Is the call in marc.properties compatible to the signature of your method?
- Is there probably an old version of your class anywhere an could be
found in the classpath first?
- May your class missing any resources?
- ...

Uwe

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsdm.link%2Fslashdot&data=02%7C01%7Cdemian.katz%40villanova.edu%7C4dd70febf11a422aeb5508d46ac50cd9%7C765a8de5cf9444f09cafae5bf8cfa366%7C1%7C0%7C636250841970192558&sdata=qhgTmCNhL9u2joQr2SBsbBrjxxt7uCXzxt%2BfZDTXWrI%3D&reserved=0
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fvufind-tech&data=02%7C01%7Cdemian.katz%40villanova.edu%7C4dd70febf11a422aeb5508d46ac50cd9%7C765a8de5cf9444f09cafae5bf8cfa366%7C1%7C0%7C636250841970192558&sdata=jUJMAjpXTZQmaV088k3vyc9kEHfyCFeZ4J4p7Lkzs5M%3D&reserved=0
--
You received this message because you are subscribed to the Google Groups "solrmarc-tech" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/solrmarc-tech.
For more options, visit https://groups.google.com/d/optout.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Vufind-tech mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/vufind-tech
Loading...