GithubHelp home page GithubHelp logo

viniciusgava / itauscraper Goto Github PK

View Code? Open in Web Editor NEW
25.0 3.0 9.0 627 KB

Download Itaú exportable files using node and Puppeteer. OFX, OFC and TXT(CSV)

License: MIT License

JavaScript 80.50% Dockerfile 17.64% Makefile 1.86%
node puppeteer itau ofx statement extrato ofc csv txt

itauscraper's Issues

[Bug] Puppeteer fails to find selector on headless mode

Running the itauscraper script results in a failure at the login step. Puppeteer is unable to locate the selector #agencia, throwing an Error: No node found for selector: #agencia.

Environment:

  • Node.js version: v18.17.1
  • Project version: v1.4.2

Steps to Reproduce:

  1. Clone the repository and navigate to the project directory.
  2. Install dependencies via npm install or yarn install.
  3. Run the script

Observe the error:

/home/deck/Projects/itauscraper/node_modules/puppeteer/lib/cjs/puppeteer/common/assert.js:26
        throw new Error(message);
              ^

Error: No node found for selector: #agencia
    at assert (/home/deck/Projects/itauscraper/node_modules/puppeteer/lib/cjs/puppeteer/common/assert.js:26:15)
    at DOMWorld.type (/home/deck/Projects/itauscraper/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:315:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async stepLogin (/home/deck/Projects/itauscraper/itauscraper.js:16:3)
    at async scraper (/home/deck/Projects/itauscraper/itauscraper.js:199:3)

Additional information

  • Running on non-headless mode, it works as expected. This might be due to Itaú checking for automated tools like Pupeteer, and it seems an user-agent can be used to fix this error.

No node found for selector

Olá Vini, estou vendo aqui que deve ter mudado o HTML do site do Itau.
Eu gostaria de contribuir atualizando o código para corrigir este erro, olha abaixo:

Error: No node found for selector: #varejo > header > div.container > nav > ul > li > div > div > div:nth-child(1) > ul:nth-child(1) > li:nth-child(2) > a
at assert (/Users/macadmin/dev/projetos/itauscraper/node_modules/puppeteer/lib/helper.js:283:11)
at DOMWorld.hover (/Users/macadmin/dev/projetos/itauscraper/node_modules/puppeteer/lib/DOMWorld.js:386:5)
at processTicksAndRejections (node:internal/process/task_queues:96:5)
at async stepExport (/Users/macadmin/dev/projetos/itauscraper/itauscraper.js:45:3)
at async scraper (/Users/macadmin/dev/projetos/itauscraper/itauscraper.js:171:3)
-- ASYNC --
at Frame. (/Users/macadmin/dev/projetos/itauscraper/node_modules/puppeteer/lib/helper.js:111:15)
at Page.hover (/Users/macadmin/dev/projetos/itauscraper/node_modules/puppeteer/lib/Page.js:1078:29)
at stepExport (/Users/macadmin/dev/projetos/itauscraper/itauscraper.js:45:14)
at async scraper (/Users/macadmin/dev/projetos/itauscraper/itauscraper.js:171:3)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.