GithubHelp home page GithubHelp logo

Indexing problem about exhibits HOT 16 CLOSED

laurensorensen avatar laurensorensen commented on July 30, 2024
Indexing problem

from exhibits.

Comments (16)

jcoyne avatar jcoyne commented on July 30, 2024 2

gml:pos should look like this:

<gml:pos>40.689167 -74.044444</gml:pos>

See http://opengeospatial.github.io/e-learning/gml/text/main.html

from exhibits.

corylown avatar corylown commented on July 30, 2024 1

I think the value here is not valid <gml:pos>48°15'25.65"N 14°30'0.49"E</gml:pos>

from exhibits.

jcoyne avatar jcoyne commented on July 30, 2024 1

@corylown I think projectblacklight/spotlight#2977 may also be needed

from exhibits.

corylown avatar corylown commented on July 30, 2024 1

@laurensorensen it looks like the exhibits issue you reported via feedback yesterday for the lauren-s-sandbox exhibit is the same. This object has invalid geographic metadata that Solr can't index: https://purl.stanford.edu/bd283qd5772.xml

<extension displayLabel="geo">
  <rdf:RDF>
    <rdf:Description rdf:about="http://purl.stanford.edu/bd283qd5772">
      <dc:format>application/pdf</dc:format>
        <gmd:centerPoint>
          <gml:Point>
           <gml:pos>48°14'25.43"N 12°27'9.35"E</gml:pos>
         </gml:Point>
      </gmd:centerPoint>
    </rdf:Description>
  </rdf:RDF>
</extension>

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024 1

Hmmm, that's really strange! Because bd283qd5772 is in a whole different exhibit/collection... European theater - which I didn't add any druids from to the Sandbox exhibit. These are the only four items in the sandbox exhibit:
zg893jk3553
xw889fc2359
dd739qy0841
fw846pf3883

from exhibits.

corylown avatar corylown commented on July 30, 2024 1

@laurensorensen I think the latitude and longitude are reversed in record zg893jk3553. They should be in latitude, longitude order and 129 isn't a valid latitude. I think the value you want in zg893jk3553 is <gml:pos>34.30000000 129.3000000</gml:pos> And Google Maps tells me that is somewhere in Japan, which appears to make sense.

The error above is confusing because Solr accepts points in a quirky longitude then latitude order so in the error they're shown in reverse order than what appears in the Purl.

from exhibits.

corylown avatar corylown commented on July 30, 2024 1

@laurensorensen no problem. Glad you got the maps to work. Can I close this issue?

from exhibits.

corylown avatar corylown commented on July 30, 2024

@laurensorensen I think there might be some invalid geographic metadata in some of these records. I haven't identified all of them, but https://purl.stanford.edu/bc936sx1426.xml is an example.

    <extension displayLabel="geo">
      <rdf:RDF xmlns:gml="http://www.opengis.net/gml/3.2/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:gmd="http://www.isotc211.org/2005/gmd">
        <rdf:Description rdf:about="http://purl.stanford.edu/bc936sx1426">
          <dc:format>application/pdf</dc:format>
          <gmd:centerPoint>
            <gml:Point>
              <gml:pos>48°15'25.65"N 14°30'0.49"E</gml:pos>
            </gml:Point>
          </gmd:centerPoint>
        </rdf:Description>
      </rdf:RDF>
    </extension>

Related honeybadger error link: https://app.honeybadger.io/projects/49092/faults/99659726

RSolr::Error::Http: RSolr::Error::Http - 400 Bad Request Error: Async exception during distributed update: Error from server at http://sul-solr-prod-f.stanford.edu:8080/solr/exhibits-prod_shard1_replica_n19/: Bad Request request: http://sul-solr-prod-f.stanford.edu:8080/solr/exhibits-prod_shard1_replica_n19/ Remote error message: ERROR: [doc=bb392bt9034] Error adding field 'geographic_srpt'='[10°44'55.22"E 51°32'7.32"N]' msg=Unable to parse shape given formats "lat,lon", "x y" or as WKT because java.text.ParseException: Unknown Shape definition [10°44'55.22"E 51°32'7.32"N] 

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

Thank you! Is it possible to know what inputted data is causing the error? Or I guess I could ask Arcadia?

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

Thanks!!

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

I uploaded these druids above as a test, and was going to change to the correct format for European and Pacific theater after successfully testing. Kim Durante helped me out and converted all the degree format latitude/longitude to decimal format, so those are available. And Arcadia confirmed that the MODS is working when I uploaded the 4 druids above...

from exhibits.

corylown avatar corylown commented on July 30, 2024

@laurensorensen sorry, I think I found the wrong log entry. But I did find this for zg893jk3553. I'll try to figure out why...but I'm in interviews most of the day.

Error: ERROR: [doc=zg893jk3553] Error adding field 'geographic_srpt'='[34.30000000 129.3000000]' msg=Unable to parse shape given formats "lat,lon", "x y" or as WKT because java.text.ParseException: Unknown Shape definition [34.30000000 129.3000000]

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

That's ok, and thanks very much for looking into it when you have a chance! Maybe I'll try and add a hyphen to the data to match the formatting that Justin posted above to see how it goes.

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

Thanks for this! Just getting back to this. I switched the latitude/longitude and their respective labels in these four druids in that same Sandbox exhibit, but am still not seeing a map on the item's exhibit page. The box 'inline map' has been checked in the metadata configuration... should I make a separate ticket? I cleared my cache (but not cookies).

zg893jk3553
xw889fc2359
dd739qy0841
fw846pf3883

from exhibits.

corylown avatar corylown commented on July 30, 2024

@laurensorensen the geographic_srpt is missing in Solr for these records, which I think is what's required for the map to display. When I checked the metadata for these in purl the geo data looks odd:

For example, dd739qy0841:

    <extension displayLabel="geo">
      <rdf:RDF xmlns:gml="http://www.opengis.net/gml/3.2/" xmlns:dc="http://purl.org/dc/elements/1.1/">
        <rdf:Description rdf:about="http://purl.stanford.edu/dd739qy0841">
          <dc:format>application/pdf</dc:format>
          <dc:type>Image</dc:type>
        </rdf:Description>
      </rdf:RDF>
    </extension>

from exhibits.

laurensorensen avatar laurensorensen commented on July 30, 2024

Nevermind! I was able to get it the map to work. For the record, I missed a field in the metadata - point coordinates (which I swore I put in there). Sorry for asking for your time investigating this when it was not a software issue!

from exhibits.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.