The fastwork-commission-table from phakphumv

fastwork-commission-table's People

Contributors

Stargazers

Watchers

fastwork-commission-table's Issues

New scrapping approach : Retrieve product cards via graphQL

Sample of CURL

curl 'https://f24luz3xrm-dsn.algolia.net/1/indexes/th_prod_products/query?x-algolia-agent=Algolia%20for%20JavaScript%20(3.35.1)%3B%20Browser&x-algolia-application-id=F24LUZ3XRM&x-algolia-api-key=a639c2213baa3a66e57cee665d7e17a6' --compressed -X POST -H 'Accept: application/json' -H 'Accept-Language: en-US,en;q=0.5' -H 'Accept-Encoding: gzip, deflate, br' -H 'content-type: application/x-www-form-urlencoded' -H 'Connection: keep-alive' -H 'Sec-Fetch-Dest: empty' -H 'Sec-Fetch-Mode: cors' -H 'Sec-Fetch-Site: cross-site' --data-raw '{"params":"attributesToRetrieve=%5B%22*%22%5D&facets=%5B%22subcategory.title%22%2C%22subcategory.slug%22%2C%22base_price%22%2C%22user.first_name%22%2C%22tags%22%5D&filters=(subcategory.slug%3A%20it-project-management)&hitsPerPage=40&page=0&query="}'

Convert to Python

import requests

headers = {
    'Accept': 'application/json',
    'Accept-Language': 'en-US,en;q=0.5',
    # 'Accept-Encoding': 'gzip, deflate, br',
    'content-type': 'application/x-www-form-urlencoded',
    'Connection': 'keep-alive',
    'Sec-Fetch-Dest': 'empty',
    'Sec-Fetch-Mode': 'cors',
    'Sec-Fetch-Site': 'cross-site',
}

data = '{"params":"attributesToRetrieve=%5B%22*%22%5D&facets=%5B%22subcategory.title%22%2C%22subcategory.slug%22%2C%22base_price%22%2C%22user.first_name%22%2C%22tags%22%5D&filters=(subcategory.slug%3A%20it-project-management)&hitsPerPage=40&page=0&query="}'

response = requests.post(
    'https://f24luz3xrm-dsn.algolia.net/1/indexes/th_prod_products/query?x-algolia-agent=Algolia%20for%20JavaScript%20(3.35.1)%3B%20Browser&x-algolia-application-id=F24LUZ3XRM&x-algolia-api-key=a639c2213baa3a66e57cee665d7e17a6',
    headers=headers,
    data=data,
)

Recommend Projects