Object-Oriented Layer on Top of Amazon S3 SDK
Home Page: https://s3.jcabi.com
License: Other
This project is just a parent POM for all other Java projects in "jcabi family".
See www.jcabi.com website for more details.
![renovate[bot] avatar](https://avatars.githubusercontent.com/in/2740?v=4 "renovate[bot]")
used logger version is very old (and have a vulnerabilities)
should be replaced with the fresh one
This code:
final Region region = new MkRegion(this.temp.newFolder());
final Bucket bucket = region.bucket("foo");
new Ocket.Text(bucket.ocket("1/foo.txt")).write("");
new Ocket.Text(bucket.ocket("1/2/foo.txt")).write("");
new Ocket.Text(bucket.ocket("1/2/3/foo.txt")).write("");
MatcherAssert.assertThat(
new Bucket.Prefixed(bucket, "1/").list(""),
Matchers.<String>iterableWithSize(1)
);Causes:
java.lang.StringIndexOutOfBoundsException: String index out of range: -1
at java.lang.String.substring(String.java:1875)
at com.jcabi.s3.Bucket$Prefixed$1.apply(Bucket.java:186)
at com.jcabi.s3.Bucket$Prefixed$1.apply(Bucket.java:183)
at com.google.common.collect.Iterators$8.transform(Iterators.java:817)
at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48)
at com.google.common.collect.Iterators$7.computeNext(Iterators.java:674)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at org.hamcrest.collection.IsIterableWithSize.featureValueOf(IsIterableWithSize.java:21)
at org.hamcrest.collection.IsIterableWithSize.featureValueOf(IsIterableWithSize.java:11)
at org.hamcrest.FeatureMatcher.matchesSafely(FeatureMatcher.java:40)
at org.hamcrest.TypeSafeDiagnosingMatcher.matches(TypeSafeDiagnosingMatcher.java:55)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:12)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
at com.jcabi.s3.mock.MkBucketTest.listsOcketsWithDifferentPrefixes(MkBucketTest.java:96)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:78)
at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:212)
at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)
after #47. Let's set it to real date of the file.
Running mvn clean install locally on windows machine leads to the result:
Failed tests:
MkBucketTest.listsOckets:68
Expected: (an iterable with size <2> and a collection containing "hello.txt" and a collection containing "f/2.txt")
but: a collection containing "f/2.txt" was "f\2.txt", was "hello.txt"
It seems that path delimiters there are OS dependent.
Running locally mvn clean install -Pqulice leads to many lines in the build log looking like
...
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[30]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[36]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[45]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[52]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[66]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\java\com\jcabi\s3\RegionITCase.java[68]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\resources\log4j.properties[27]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\resources\log4j.properties[30]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\resources\log4j.properties[35]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[ERROR] \src\test\resources\log4j.properties[38]: Lines in file should end with Unix-like end of line (RegexpMultilineCheck)
[INFO] Read our quality policy: http://www.qulice.com/quality.html
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
...
It differs from the actual result here, but should not.
mvn -version returns the following:
Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1; 2014-12-14T20:29:23+03:00)
Maven home: d:\apps\apache-maven-3.2.5\bin\..
Java version: 1.7.0_72, vendor: Oracle Corporation
Java home: C:\Program Files\Java\jdk1.7.0_72\jre
Default locale: en_US, platform encoding: Cp1251
OS name: "windows 7", version: "6.1", arch: "amd64", family: "windows"
Ocket.Text should accept content type
Let's add method Bucket.exists() to check bucket existence
The documentation says nothing about what for the class com.jcabi.s3.Bucket.Prefixed exists. I would suggest to complete the javadoc for the class.
MkBucket.list() must show directories, not only files
Review our existing source code and all other technical artifacts and report at least 8 bugs. More about such reviews you can read here. The task will be closed once we have that bugs reported and classified. Don't forget to add itr tag to each of them.
There is no estimate in the project yet. We have to create one as explained here
Let's add method Ocket.exists() to check for S3 object existence.
Right now, MkOcket.meta() just returns a new instance of ObjectMetadata. However, it would be useful for ObjectMetadata to return some meaningful (and commonly used) data.
For example, contentLength would be useful when I need to test a class which needs to get the total size of a bucket (like in libreio/libre#131). I suggest we start with adding contentLength and identify other data that might be of use for projects that test with MkOcket.
The puzzle 47-51f62688 in pom.xml (lines 160-162) has to be resolved: For some reason this profile doesn't work any more. Most probably because of the absence of Cobertura. Let's configure it properly, so that it works with Jacocco.
The puzzle was created by Yegor Bugayenko on 25-Jan-17.
Estimate: 30 minutes, role: IMP.
If you have any technical questions, don't ask me, submit new tickets instead. The task will be "done" when the problem is fixed and the text of the puzzle is removed from the source code.
Please, publish a new release 0.11 (or higher). Don't forget to update us here regularly (at least once a week), as explained in this article.
This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.
These updates have all been created already. Click a checkbox below to force a retry/rebase of any.
com.amazonaws:aws-java-sdk-s3, com.amazonaws:aws-java-sdk-core).github/workflows/codecov.yml
actions/checkout v4actions/setup-java v4actions/cache v4codecov/codecov-action v4ubuntu 22.04.github/workflows/mvn.yml
actions/checkout v4actions/setup-java v4actions/cache v4.github/workflows/pdd.yml
actions/checkout v4ubuntu 22.04.github/workflows/xcop.yml
actions/checkout v4ubuntu 22.04
pom.xml
com.jcabi:jcabi 1.39.0com.jcabi:jcabi-aspects 0.25.1com.jcabi:jcabi-log 0.24.1javax.activation:activation 1.1.1org.projectlombok:lombok 1.18.34org.aspectj:aspectjrt 1.9.20.1com.amazonaws:aws-java-sdk-core 1.12.684com.amazonaws:aws-java-sdk-s3 1.12.684com.google.guava:guava 33.3.0-jrecommons-io:commons-io 2.15.1org.apache.commons:commons-lang3 3.16.0javax.validation:validation-api 2.0.1.Finaljunit:junit 4.13.2org.slf4j:slf4j-log4j12 2.0.16log4j:log4j 1.2.17org.hamcrest:hamcrest-core 3.0org.hamcrest:hamcrest-library 3.0org.junit.vintage:junit-vintage-engine 5.9.1com.qulice:qulice-maven-plugin 0.22.0
Puzzle 2-68b8eec9 in src/main/java/com/jcabi/s3/AwsBucket.java:115-119 has to be resolved: Large lists are not supported. The method doesn't support marker functionality, provided by ObjectListing. We should create a test that reproduces the problem and fix the method. The method should return an iterable, which should fetch portions of objects from S3 on demand.
If you have any technical questions, don't ask me, submit new tickets instead
let's use com.jcabi:jcabi:1.4 as a parent pom
CdOcket.meta() must be cacheable too.
@dmarkov Looks like we need to add .gitattributes to force EOL of the repo.
Let's make it default
Let's create it
Let's get rid of it
Let's add them
Copyright sections still feature 2014 as a year.
After the changes in #41 AwsOcket#write() doesn't work:
com.amazonaws.AbortedException:
at com.amazonaws.internal.SdkFilterInputStream.abortIfNeeded(SdkFilterInputStream.java:51)
at com.amazonaws.internal.SdkFilterInputStream.markSupported(SdkFilterInputStream.java:107)
at com.amazonaws.http.AmazonHttpClient.beforeRequest(AmazonHttpClient.java:450)
at com.amazonaws.http.AmazonHttpClient.doExecute(AmazonHttpClient.java:355)
at com.amazonaws.http.AmazonHttpClient.executeWithTimer(AmazonHttpClient.java:328)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:307)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3649)
at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1414)
at com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInOneChunk(UploadCallable.java:131)
at com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:123)
at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:139)
at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:47)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Let's make it possible
Let's add new method list() to Bucket interface, which should list ockets using a prefix.
Right now jcabi-s3 doesn't have multi part upload feature (see http://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html for reference).
It prohibits uploading of large files, as they have to be buffered in memory (to calculate file size) before being uploaded to S3.
AWS SDK 1.7.13 is almost one year old. I suggest to update it to the latest one.
S3 is actually supported by non-amazon service providers including dreamobjects, ceph (with addons), and riak.
It would be really nice to be able to connect to non-amazon URL's
AWSCredentials credentials = new BasicAWSCredentials(accessKey, secretKey);
AmazonS3 conn = new AmazonS3Client(credentials);
conn.setEndpoint("s3-compatible-url.local");At the moment jcabi-s3 doesn't support retrieve object in parts (see http://docs.aws.amazon.com/AmazonS3/latest/dev/GettingObjectsUsingAPIs.html for reference). This option will give the possibility to organize multithreaded downloading a file. It will performance benefits for large files
Please, publish a new release 0.10 (or higher). Don't forget to update us here regularly (at least once a week), as explained in this article.
mvn qulice:check -PquliceLine does not match expected header line of ' * BSD License'. (HeaderCheck) messages.This is a known bug of qulice configuration in parent-0.31 (jcabi/jcabi-parent#19), accessed via jcabi-0.16. Suggested action is waiting until jcabi/jcabi#297 fix is released and upgrading jcabi version.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.