API calls suddenly unauthorized. about aws-data-lake-solution

[stevejonpeters]

https://forums.aws.amazon.com/thread.jspa?messageID=767716 here is the issue from 2017

[stevejonpeters]

is this a CORS issue? the datalakeweb bucket does not have CORS enabled.

[ericquinones]

We apologize for the inconvenience. We are currently researching the issue on our end. Please continue to monitor the repository for updates.

[ericquinones]

Hi @stevejonpeters -
Below is an example of constructing an API call to v2.1.0 of Data Lake that was tested on the Python 3.7 Lambda runtime using requests v2.22.0. The API returns a 200 status code with a JSON payload as the response body.

The commented lines in getSignatureKey are the JavaScript versions of the code from our API documentation.

The access_key and secret_key needed to generate the signing key will both come from the Data Lake console (details here) so there should be no need to compare with Cognito.

Can you please compare the below with how you are constructing the signing key and the API request?

import os, base64, datetime, hashlib, hmac 
import requests

def getSignatureKey(accessKey, secretKey, dateStamp, apiEndpoint):
    # let kDate = crypto.createHmac('sha256', "DATALAKE4" + secretKey);
    # kDate.update(moment().utc().format("YYYYMMDD"));
    kDate = hmac.new(f"DATALAKE4{secretKey}".encode('utf-8'), dateStamp.encode('utf-8'), hashlib.sha256)
    
    # let kEndpoint = crypto.createHmac('sha256', kDate.digest('base64'));
    # kEndpoint.update(apiEndpoint);
    kEndpoint = hmac.new(base64.b64encode(kDate.digest()), apiEndpoint.encode('utf-8'), hashlib.sha256)

    # let kService = crypto.createHmac('sha256', kEndpoint.digest('base64'));
    # kService.update('datalake');
    kService = hmac.new(base64.b64encode(kEndpoint.digest()), "datalake".encode('utf-8'), hashlib.sha256)

    # let kSigning = crypto.createHmac('sha256', kService.digest('base64'));
    # kSigning.update("datalake4_request");
    kSigning = hmac.new(base64.b64encode(kService.digest()), "datalake4_request".encode('utf-8'), hashlib.sha256)

    # let _signature = kSigning.digest('base64');
    _signature = base64.b64encode(kSigning.digest()).decode('utf-8')

    # let _apiKey = [accessKey, _signature].join(':');
    # let _authKey = Base64.encode(_apiKey);
    _apiKey = ":".join([accessKey, _signature])
    _authKey = base64.b64encode(_apiKey.encode('utf-8')).decode('utf-8')

    # return ['ak', _authKey].join(':');
    return ":".join(["ak", _authKey])

access_key = os.environ.get('KEY')
secret_key = os.environ.get('SECRET')
api_endpoint = os.environ.get('API_ENDPOINT')

sign_key = getSignatureKey(access_key, secret_key, datetime.datetime.utcnow().strftime('%Y%m%d'), api_endpoint)

headers = {'Auth':sign_key}

request_url = f"https://{api_endpoint}/prod/search?term=test"

r = requests.get(request_url, headers=headers)

print(f"Response code: {r.status_code}")
print(r.text)

[knihit]

Hi @stevejonpeters are you still facing this issue. Did the example provided by eric help you to find a solution. If the problem is resolved, can you please close the issue.

[georgebearden]

Closing this issue, but please let us know if you need additional assistance.