GithubHelp home page GithubHelp logo

Indexer deployment about od-subgraph HOT 6 CLOSED

open-dollar avatar open-dollar commented on September 4, 2024
Indexer deployment

from od-subgraph.

Comments (6)

jahabeebs avatar jahabeebs commented on September 4, 2024
  • Create a render.com postgres database

    • Get the IPFS pinning endpoint from Patrick

    • Deploy the indexer docker

    • Configure DNS subgraph.opendollar.com

      • Playground
      • Query endpoint

@pi0neerpat I saw in render that it will detect you have a dockerfile in the root so what do you think if I do the following:

  1. change our docker-compose.yml to have .env variables for the network type (mainnet/arbitrum-sepolia), RPC URL, and postgres DB connection string, and IPFS pinning endpoint (which you can DM me)
  2. after merging the changes above I should be able to create a .env in render and it should deploy the docker file successfully
  3. set up dns

from od-subgraph.

pi0neerpat avatar pi0neerpat commented on September 4, 2024

Sounds like a good plan. Please complete a tutorial on how to deploy using docker-compose, or directly from dockerfile if you'd rather that that approach.

from od-subgraph.

jahabeebs avatar jahabeebs commented on September 4, 2024

Sounds like a good plan. Please complete a tutorial on how to deploy using docker-compose, or directly from dockerfile if you'd rather that that approach.

@pi0neerpat

while trying to deploy I found that render doesn't have support for docker compose https://community.render.com/t/can-i-use-docker-compose/58/7

this makes things a bit trickier because we'll have to split all our docker compose services into dockerfiles (one for graph node service, one for IPFS service, one for postgreSQL service), build those images separately and then create a render.yaml to bring these together

if our goal is to have a deployed playground pointed to our latest SDK version maybe it would be worth using the hosted service instead of trying to self-host? and then we just point our subgraph.opendollar subdomain to our organizational subgraph page on the graph's website?

https://thegraph.com/docs/en/network/benefits/

from od-subgraph.

jahabeebs avatar jahabeebs commented on September 4, 2024
  • Create a render.com postgres database

    • Get the IPFS pinning endpoint from Patrick

    • Deploy the indexer docker

    • Configure DNS subgraph.opendollar.com

      • Playground
      • Query endpoint

@pi0neerpat I've created the following services to render in the od-subgraph-indexer project and configured them:

  • an ipfs/kubo:v0.14.0 image as a web service
  • a postgres:14 image as a web service (note why below)
  • a graphprotocol/graph-node image as a web service

Why db a web service

I had to create a postgres DB from a Docker image rather than from the standard db option that render provides because graphprotocol/graph-node requires certain custom properties for our db that the standard db option does not allow. specifically, these variables:

PGDATA: "/var/lib/postgresql/data"
POSTGRES_INITDB_ARGS: "-E UTF8 --locale=C"

There's no way to customize the arguments during the standard db creation process, or even after it's created

db configured

in the logs we can see both the IPFS and postgres connections were successful and our service is now indexing

Screenshot 2023-12-06 at 3 24 03 PM

from od-subgraph.

pi0neerpat avatar pi0neerpat commented on September 4, 2024

Great work! My only question is whether our db will be persistent? If so, you can close this issue

from od-subgraph.

jahabeebs avatar jahabeebs commented on September 4, 2024

Great work! My only question is whether our db will be persistent? If so, you can close this issue

yes I've set up a 5GB disk for the deployment but we can raise the memory if this isn't enough

from od-subgraph.

Related Issues (9)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.