Comments (3)
@collinss-jpl where are we at with this implementation?
from data-upload-manager.
I don't think we've had a serious conversation to define "exactly what we would like to see logged for each request". What is currently logged by both the lambda service and the client script is based on what I wanted to see to support development, but my guess is that this is insufficient for production.
from data-upload-manager.
Descoping this from this build. We will need to design what we want logged in a future release.
from data-upload-manager.
Related Issues (20)
- Investigate COTs Tools for Improving Overall Functionality and Robustness of DUM HOT 4
- As a user, I want to skip upload of files already in S3 (nucleus staging bucket)
- Upgrade SBN to latest and Rename Bucket Folder HOT 1
- As a user, I want an end summary report in logs to show statistics of files uploaded HOT 1
- As a user, I want to skip upload of files that are already in the Registry HOT 5
- As a user, I want to force an upload of file that is already in S3 or the Registry HOT 3
- As an admin, I want access to buckets to be restricted by subnet HOT 1
- Implement automatic refresh of Cognito authentication token HOT 1
- Deploy v1.2.0 DUM to Production HOT 1
- DUM Client does not properly sanitize double-quotes from INI config
- Backoff/Retry logic masks errors from urllib3 exceptions
- DUM Lambda Service can return pre-signed S3 URL's to non-existing buckets
- As a user, I want timestamps to the ongoing logs that are printed to stdout while running the job
- As a user, I want status summary reports during a long running execution (batching functionality) HOT 1
- As a user, I want to verify all my data has been uploaded to the cloud successfully
- As a user, I want to provide a checksum manifest as input to verify the checksums being generated by data upload manager
- As a user, I want to monitor the progress of Data Upload Manager in a visual dashboard in AWS
- Investigate usage of localstack for use with DUM local integration testing HOT 1
- DUM Client script does not respect configured logging level after a transfer failure/retry
- Backoff/Retry logic not firing for certain error codes
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from data-upload-manager.