Comments (12)
@VachaShah the fix is in, could you please rerun the failing action(s), I don't have permissions sadly to do that, thank you
Thank you @reta! I have rerun it for PR #142, will rerun for others as well.
from opensearch-go.
The tests are passing now, thank you @reta for the fix!
Closing this now.
from opensearch-go.
TestBulkIndexerIntegration
test with body compression fails when testing against OpenSearch main:
FAIL: TestBulkIndexerIntegration/With_body_compression (9.46s)
--- FAIL: TestBulkIndexerIntegration/With_body_compression/Default (9.25s)
bulk_indexer_integration_test.go:114: Unexpected NumIndexed: want=100000, got=0
bulk_indexer_integration_test.go:118: Unexpected NumFailed: want=0, got=100000
bulk_indexer_integration_test.go:122: Unexpected countSuccessful: want=100000, got=0
--- FAIL: TestBulkIndexerIntegration/With_body_compression/Multiple_indices (0.21s)
bulk_indexer_integration_test.go:188: Unexpected NumIndexed: want=30, got=0
Stacktrace from OpenSearch end:
{"type": "server", "timestamp": "2022-10-20T22:44:46,490Z", "level": "WARN", "component": "r.suppressed", "cluster.name": "docker-cluster", "node.name": "8e1ce1e71492", "message": "path: /test-bulk-integration, params: {wait_for_active_shards=1, index=test-bulk-integration}", "cluster.uuid": "3bPso61HQZWlstl9afmOZg", "node.id": "jZN3cDgWQWGNTA6E4eQpcg" ,
"stacktrace": ["org.opensearch.common.compress.NotXContentException: Compressor detection can only be called on some xcontent bytes or compressed xcontent bytes",
"at org.opensearch.common.compress.CompressorFactory.compressor(CompressorFactory.java:71) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:144) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.rest.action.admin.indices.RestCreateIndexAction.prepareRequest(RestCreateIndexAction.java:79) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:103) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.rest.RestController.dispatchRequest(RestController.java:312) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.rest.RestController.tryAllHandlers(RestController.java:398) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.rest.RestController.dispatchRequest(RestController.java:241) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:366) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:445) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:356) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:55) [transport-netty4-client-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
"at org.opensearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:41) [transport-netty4-client-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]",
from opensearch-go.
Another test failure due to compression
--- FAIL: TestTransportCompression (0.01s)
opensearchtransport_integration_test.go:162: Unexpected StatusCode, expected 201, got: 400
from opensearch-go.
For TestTransportCompression, PUT and POST requests are failing with 400 bad request (against OpenSearch main):
&{PUT /shiny_new_index HTTP/1.1 1 1 map[] <nil> <nil> 0 [] false map[] map[] <nil> map[] <nil> <nil> <nil> 0xc0000160c0}
&{400 Bad Request 400 HTTP/1.1 1 1 map[Content-Type:[application/json; charset=UTF-8]] 0xc00000f680 -1 [] false true map[] 0xc0001cbb00 <nil>}
&{GET /shiny_new_index HTTP/1.1 1 1 map[] <nil> <nil> 0 [] false map[] map[] <nil> map[] <nil> <nil> <nil> 0xc0000160c0}
&{200 OK 200 HTTP/1.1 1 1 map[Content-Type:[application/json; charset=UTF-8]] 0xc00000f8c0 -1 [] false true map[] 0xc00014df00 <nil>}
&{POST /shiny_new_index/_doc HTTP/1.1 1 1 map[Content-Type:[application/json]] {0xc00000f9a0} 0x856a00 19 [] false map[] map[] <nil> map[] <nil> <nil> <nil> 0xc0000160c0}
&{400 Bad Request 400 HTTP/1.1 1 1 map[Content-Type:[application/json; charset=UTF-8]] 0xc0002e68c0 -1 [] false true map[] 0xc000442100 <nil>}
Against OpenSearch 1.x and 2.x, the requests succeed.
from opensearch-go.
Upon picking the commits from OpenSearch main, looks like opensearch-project/OpenSearch#3847 is the change from which the tests have started failing. Looking into why this is the case.
from opensearch-go.
@reta Any suggestions on how this can be fixed?
This is affecting only for requests when compression is enabled. Doesn't look like this is a breaking change from OpenSearch's end but I am not sure how the go client is breaking because of this.
from opensearch-go.
@VachaShah thanks a lot for bringing this up, looking into it
from opensearch-go.
@VachaShah thanks a lot for bringing this up, looking into it
Thank you!
from opensearch-go.
@VachaShah ah, found the issue, the fix on the way ... sorry about that ...
from opensearch-go.
@VachaShah ah, found the issue, the fix on the way ... sorry about that ...
Thats awesome! Thank you @reta :)
from opensearch-go.
@VachaShah the fix is in, could you please rerun the failing action(s), I don't have permissions sadly to do that, thank you
from opensearch-go.
Related Issues (20)
- [FEATURE] Add an Explanation field containing the document explain details to the SearchHit struct
- [BUG] Add missing global io usage field for nodes stats
- [FEATURE] Use pooled gzip writer for request body gzip compression
- [BUG] 429 error does not follow standard error format HOT 5
- [BUG] not reporting when failed index HOT 5
- [FEATURE] ML client for pipeline setup and neural search HOT 2
- [BUG] Request context cancellation is ignored when `retryBackoff` is configured
- [BUG] Error http: ContentLength=401 with Body length 0 HOT 9
- [FEATURE] Exploring similar functionality in Go as Python classes {Object, Nested, Text, Keyword}. HOT 3
- Cleanup unused branches HOT 1
- [BUG]Unable to install because of checksum error HOT 3
- ISM Plugin `Conditions` struct is invalid
- [BUG] MappingFieldResp struct is not parsed correctly. HOT 2
- [BUG] Tests are flaky HOT 1
- Add MatchedQueries field to opensearchapi.SearchHit HOT 3
- [BUG] Index name is added two times to a query when using SearchRequest HOT 1
- [BUG] opensearchapi.Client.Document.Delete bugged error handling (v4) HOT 5
- [FEATURE] Make all response structs their own type
- [FEATURE] Support `search_pipeline` query parameter for search API requests HOT 1
- [BUG] ISM Allocation action does not match Opensearch server expectation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opensearch-go.