Comments (8)
https://new-relic.atlassian.net/browse/NR-276779
from newrelic-ruby-agent.
I'm sorry to hear this is happening, @kichik. Thanks for bringing this to our attention.
It seems like this might be related to our new DynamoDB instrumentation introduced as part of 9.10.0.
While we look into this, I think the error should stop if you disable DynamoDB instrumentation. You can do this by updating your config/newrelic.yml
file to include the following:
instrumentation.dynamodb: disabled
Or by using an environment variable:
NEW_RELIC_INSTRUMENTATION_DYNAMODB = "disabled"
Can you let us know if that stops the problem?
from newrelic-ruby-agent.
Thanks for the quick reply @kaylareopelle. For now we downgraded to 9.9.0 and things are stable. But it's good to know DynamoDB instrumentation can be disabled. As part of this issue we have seen DynamoDB segments being 3x longer. I bet it's just the undefined method issue. But if not, it would be good to be able to disable it.
from newrelic-ruby-agent.
@kichik - Glad to hear you found a way to restore stability!
We reproduced the problem and have a solution in this branch: bugfix_aws_dynamodb_credentials_error
(PR #2684)
In addition to accommodating Aws::InstanceProfileCredentials
, it also introduces some performance improvements.
If you'd like to try it out, you can do so by installing newrelic_rpm
from the branch:
gem 'newrelic_rpm', github: 'newrelic/newrelic-ruby-agent', branch: 'bugfix_aws_dynamodb_credentials_error'
We'll include this fix in a patch release soon, but if you decide to test it out, we'd love to hear your feedback.
from newrelic-ruby-agent.
Hi @kichik, we included #2684 in version 9.10.2, which was released yesterday. This issue should be resolved.
Thanks again for your report!
from newrelic-ruby-agent.
Thanks @kaylareopelle. The big issue seems to be resolved. But CPU is still a bit higher. Our average transaction segment time of DynamoDB went from 125ms to 150ms. CPU usage is also about 5% higher. I am not sure yet what's going on. I'll report back if I have more details.
from newrelic-ruby-agent.
Hi @kichik, thanks for the update!
If you get more details about the slowdown, we'd love to hear them. Feel free to open a new issue and we'll take a closer look 🙂
from newrelic-ruby-agent.
Thanks @kaylareopelle. Is there some guidelines on the information you need to be able to resolve such an issue? I'm not sure what to get. Right now we're thinking of rolling back again as it eats too much of our available overhead.
from newrelic-ruby-agent.
Related Issues (20)
- ActiveSupport notifications improvements HOT 1
- FOSSA Ruby scanning - enhancements for our public repos HOT 2
- Add testing constraints for ffi HOT 1
- Revert `autostart_denylisted_constants` default change and document options HOT 1
- Spike: Investigate `autostart.denylisted_constants` HOT 1
- Investigate rspec-mocks incompatibility with `add_method_tracer` HOT 3
- Add a configuration option to permit custom method tracers to be defined automatically HOT 1
- CI: GHA - DRY up the action version shas HOT 1
- Meet OYC standards for Agent2Query service HOT 1
- Add Errors Inbox metadata configuration content to generated doc HOT 3
- [Spike] k8s & container integration HOT 1
- [Spike] Support FM/SA configuration HOT 1
- API driven noticed errors display as `expected: true`, and observed errors should too HOT 2
- Stripe integration Causes Cardinality Explosion HOT 6
- CI: address issues that stemmed from Rack hitting v3.1.x HOT 1
- CI: Investigate, address Grape v2.1 failures HOT 1
- Spike: Instrument `start_transaction.active_record` HOT 1
- Failed to get cluster name for elasticsearch during health check routine HOT 1
- Avoid deprecated Bundler method all_specs HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from newrelic-ruby-agent.