kaiwaehner / hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference Goto Github PK

Hi @kaiwaehner
Love the project!
Was just wondering when i finished example would be ready to run.

Many thanks,
Best,
Andrew

Hi all,

Thanks a lot for the great project.
We do not have access to google cloud but want to deploy your project on our server to start learning all the parts. As we are not experts in cloud deployment and tools, we do not know which parts and configuration files should be changed so we can go from the G-cloud deployment to our local server deployment.

Could you please guide what is the easiest way to make such modifications? and possibly do you have the setup instruction and files for such deployment

Thanks a lot

Hi there.
I followed the guide for the GCP deployment, but I bumped in this error near the end of the tf apply:
Any ideas?
Thanks

During terraform apply

Download Confluent Operator
Operator is installed...
../confluent/01_installConfluentPlatform.sh: line 42: cd: helm/: No such file or directory

With default GCP quotas set:

Error: error creating NodePool: googleapi: Error 403: 
        (1) insufficient regional quota to satisfy request: resource "CPUS": request requires '72.0' and is short '48.0'. project has a quota of '24.0' with '24.0' available. View and manage quotas at https://console.cloud.google.com/iam-admin/quotas?usage=USED&project=hive-kafka-tensorflow-demo
        (2) insufficient regional quota to satisfy request: resource "IN_USE_ADDRESSES": request requires '9.0' and is short '1.0'. project has a quota of '8.0' with '8.0' available. View and manage quotas at https://console.cloud.google.com/iam-admin/quotas?usage=USED&project=hive-kafka-tensorflow-demo., forbidden

  on main.tf line 42, in resource "google_container_node_pool" "primary_nodes":
  42: resource "google_container_node_pool" "primary_nodes" {

Hi Kai,

I have some trouble ingesting the data directly to the Kafka Cluster using Kafka Client targeting to the [external Kafka IP:9092]
it always shows me that the connection is disconnected, but if we check with telnet it's all good.

On the control center sides, all of the brokers is running well and we could execute CLI inside the Kafka to list the topic using bash from kubectl.

Do you have any solution for this?

Terraform 0.12.9

Error: error creating NodePool: googleapi: Error 400: Auto_upgrade and auto_repair cannot be false when release_channel REGULAR is set., badRequest

  on main.tf line 42, in resource "google_container_node_pool" "primary_nodes":
  42: resource "google_container_node_pool" "primary_nodes" {

Hey Kai,
Just to let you know that your scripts don't work anymore with the very new helm 3. As I am not an expert in helm and K8's, I don't feel comfortable suggesting changes, but here is what I noticed:

• First aspect is that you don't need to set up tiller anymore.
• there seems also to be some cli disrupting changes, like the --name tag is also no more accepted on the helm install commands

Just to make you aware
Cheers
Eric

Hello,

First of all, thank you very much for the amazing project.

I am trying to deploy the project in GCP and I am having this issue:

Note: For Openshift Platform replace kubectl commands with 'oc' commands. If OpenShift Route enabled, port will be either 80/443
After Zookeeper Installation: Check all pods...
NAME READY STATUS RESTARTS AGE
cc-operator-8498f54f9b-vv4mg 1/1 Running 0 12s
Error from server (NotFound): statefulsets.apps "zookeeper" not found

I tried to find the instruction that is causing the issue and is this one:
15:16 $ kubectl rollout status sts -n operator zookeeper
Error from server (NotFound): statefulsets.apps "zookeeper" not found

Someone have an idea about what's is causing an error like this?

Best Regards,
Manuel Monteiro

hi,friend.I use docker to build the simulator.I changed the address in scenario.xml,and then i ran build-generator.sh.When i construct a mirror images of simulator ,i run the container

,but 'No instance configuration provided directly.attempting dynamic discover method.'appears.

There is an issue in the file 01_installConfluentPlatform.sh because prometheus operator is now Deprecated and there's a need to install it through kube-prometheus-stack.

Moreover, I get an issue because it says I need to extend the CPU quota on my google account to 72, and I don't know if the issues are somehow related because I cannot install the prometheus operator.

Thank you, this project should be my MSc Thesis' last brick!

During terraform apply

null_resource.setup-messaging (local-exec): manifest_sorter.go:192: info: skipping unknown hook: "crd-install"