whiver / nifi-protobuf-processor Goto Github PK

I am getting the below error:
ERROR [Timer-Driven Process Thread-1] c.g.w.nifi.processor.ProtobufDecoder ProtobufDecoder[id=299c2a4f-016a-1000-ffff-ffffab7ba612] No schema path given, please fill in the protobuf.schemaPath property, either at processor or flowfile level

Please check the screen shot. I am using apache nifi 1.9.1

I am using the .proto mode. During the decoding process, my hard disk will generate a 5M protocjarxxx file. I don't want it to generate this file. What should I do?

I am trying out a simple flow in Nifi which converts a JSON data into Protobuf type.

Here is the flow which I tried:

Generate flow file(contains json message) --> Protobuf Encoder --> Putfile

These are the configurations of ProtobufEncoder:

As shown in the above picture, I am passing a compiled schema file in the schema path property and I set the compile schema property to false.
But the flow files are routing to error queue saying,

Unable to find the message in protobuf.messageType, Unable to decode data.

Please suggest me the changes need to be done at configurations. Appreciate your help!!

Hi,
My protobuf processor works fine for 6 month and brutally after i purged tmp folder, i face an issue:

2020-01-29 11:00:01,361 ERROR [Timer-Driven Process Thread-10] c.g.w.nifi.processor.ProtobufDecoder ProtobufDecoder[id=a2ae63e8-1934-3e98-bb0c-55cbe70dfe24] Unable to read schema file: Unsupported platform: protoc-3.4.0-linux-x86_64.exe: com.github.whiver.nifi.exception.SchemaLoadingException: Unable to read schema file: Unsupported platform: protoc-3.4.0-linux-x86_64.exe
com.github.whiver.nifi.exception.SchemaLoadingException: Unable to read schema file: Unsupported platform: protoc-3.4.0-linux-x86_64.exe
at com.github.whiver.nifi.parser.SchemaParser.parseSchema(SchemaParser.java:73)
at com.github.whiver.nifi.service.ProtobufService.decodeProtobuf(ProtobufService.java:86)
at com.github.whiver.nifi.processor.ProtobufDecoder.lambda$0(ProtobufDecoder.java:80)
at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2887)
at com.github.whiver.nifi.processor.ProtobufDecoder.onTrigger(ProtobufDecoder.java:75)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.FileNotFoundException: Unsupported platform: protoc-3.4.0-linux-x86_64.exe
at com.github.os72.protocjar.Protoc.extractProtoc(Protoc.java:221)
at com.github.os72.protocjar.Protoc.extractProtoc(Protoc.java:182)
at com.github.os72.protocjar.Protoc.runProtoc(Protoc.java:71)
at com.github.whiver.nifi.parser.SchemaParser.compileProto(SchemaParser.java:46)
at com.github.whiver.nifi.parser.SchemaParser.parseSchema(SchemaParser.java:58)
... 16 common frames omitted

So as understood, a protocjar.webcache folder in /tmp should be not removed, isn't it ?

Wasn't sure of best way to contact you. I build the nar and move to the lib directory of nifi. Using . 1.4.0 but it does not show up.

Hi Team,

I used InvokeGRPC processor in Nifi workflow using EC2 instance. I configured hostname and port, but still InvokeGRPC processor asking for upstream connection. so I used GenerateFlowFile processor, but not sure how I need to give .proto file and how to add my .proto file of GRPC application to Nifi.

Please guide me.