GithubHelp home page GithubHelp logo

fiji-hpc / hpc-datastore Goto Github PK

View Code? Open in Web Editor NEW
1.0 3.0 3.0 2.51 MB

Server-side of the HPC DataStore project - Java API, shell scripts

Shell 1.68% Java 98.32%
image-processing image-storage big-image-data

hpc-datastore's People

Contributors

kozusznik avatar michaelmachu avatar xulman avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

hpc-datastore's Issues

legacy BDS emulation: int server error 500

.spim.data.SpimDataIOException: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:9080/bdv/a534ba9f-578d-49e9-8eb5-6f1e28ffe66e/1/

when accessing newly added channel

as a result, the new channel cannot be opened in BDV

failing to show remote datasets in BDV when the viewsetups use non-identity view transforms

....simply when, e.g., a dataset consists of four channels each being displayed translated/rotated/scaled w.r.t. to some common reference frame

One can download a test dataset, unzip, a point BDV to the 807191f5-.../0/export.xml file to understand what the dataset looks like. It should look like this:
Screenshot_20230425_182237
when zoomed-out a little, and displayed using the Fuse mode on.

➡️
The issue comes when accessing this dataset using any option from the menu Fiji -> Plugins -> HPC DataStore -> BigDataViewer, which means to access the data remotely via the DS server itself, in this regime the opening fails. The error is the following.
Screenshot_20230425_182725

Worth noticing is that the JSON listing from alfeios, where this dataset is also installed, shows nulls for transformations and viewRegistration fields.

legacy BDV: convert data and send it always as gray16

[ERROR] Command errored: Create new dataset from XML/HDF5
java.lang.NoSuchMethodError: net.imglib2.img.basictypeaccess.ArrayDataAccessFactory.get(Lnet/imglib2/type/NativeType;)Ljava/lang/Object;
at bdv.export.ExportScalePyramid$BlockCreator.forType(ExportScalePyramid.java:431)
at bdv.export.ExportScalePyramid.writeScalePyramid(ExportScalePyramid.java:237)
at cz.it4i.fiji.datastore.rest_client.WriteSequenceToN5.writeScalePyramid(WriteSequenceToN5.java:249)
at cz.it4i.fiji.datastore.rest_client.WriteSequenceToN5.writeN5File(WriteSequenceToN5.java:208)
at cz.it4i.fiji.datastore.ij.ExportSPIMAsN5PlugIn.run(ExportSPIMAsN5PlugIn.java:220)
at org.scijava.command.CommandModule.run(CommandModule.java:196)
at org.scijava.module.ModuleRunner.run(ModuleRunner.java:165)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:125)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:64)
at org.scijava.thread.DefaultThreadService.lambda$wrap$2(DefaultThreadService.java:247)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Wrong return dimensions of parital blocks

Při typech uint8, float32 (uint16 funguje, jiné jsem nezkoušel) vrací server dimenze částečného bloku (prvních 12B) nekorektně. resp. vrátí (-1,-1,-1), nicméně zbytek dat má validní velikost, která odpovídá očekávání.

Postup reprodukce:
zvolit typ datasetu float32 nebo uint8
vytvořit dataset o velikosti, která není dělitelná velikostí bloku
poslat request na získání částečného bloku (tedy toho na okraji obrázku).

Chování:
Server vrátí prvních 12B reprezentujících (-1,-1,-1) a potom data odpovídající korektnímu bloku

Očekávané chování:
Server vrátí prvních 12B odpovídajích dimenzi získaného block (x,y,z) a data o odpovídajíc velikosti...
celý obsah odpovědi by tedy měl být velký: 12 (dimenze) + x * y * z * sizeof(voxelType)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.