Comments (4)
Glad to hear that worked, @jurschel!
It would probably be a good idea to completely ignore those specific topics, but we've chosen so far to just define them as-is in our state file.
You can also use the topic blacklist option to have the tool ignore topics on a prefixed basis:
settings:
topics:
blacklist:
prefixed:
- _confluent
Good luck with getting your central repository going! Let me know if you have questions! 😄
from kafka-gitops.
Yes, you can use the tool to just create new topics. You can run kafka-gitops
with the --no-delete
flag, and it will only plan/apply creates and updates.
Example state file new-topics.yaml
:
topics:
my-new-topic:
partitions: 6
replication: 3
Run against the cluster:
kafka-gitops -f new-topics.yaml --no-delete plan -o plan.json
kafka-gitops -f new-topics.yaml --no-delete apply -p plan.json
Over time, you can slowly start to add existing topics (and services, if desired) to your state file until we have implemented import functionality (#13).
from kafka-gitops.
Ah ok thanks for the response. I was about to reply with the below. I did see something about the --no-delete option just hadn't gotten to it yet.
I see in your documentation that applying this against a cluster is destructive if you don't have all the topics in the state file. Shouldn't you leave any built-in topics like _confluent.support.metrics, _confluent_offsets and _schemas alone completely?
from kafka-gitops.
That worked. Good work. Now I'm going to get my central repository for topics going!
from kafka-gitops.
Related Issues (20)
- rror thrown when attempting to create a Kafka topic: org.apache.kafka.common.errors.TopicExistsException: Topic 'zuora-email-history' already exists. HOT 1
- Blocker: customUserAcls - Plan command - Marks the action for every entry on the state.yaml as "REMOVE". HOT 14
- plan error HOT 3
- Feature request: Possibility to manage ACLs only HOT 1
- plan dies with a nullpointer exception HOT 5
- MSK IAMs Authentication Support HOT 3
- Documentation around usage HOT 3
- Brew warning about use of deprecated bottle call HOT 3
- Plans for Move to `confluent` vs. `ccloud` CLI? HOT 7
- Topic Configs are considered to be added in "Plan" even if they are present in the existing system. HOT 1
- Can I apply changes(the plan json) selectively for ACLs only ? HOT 2
- Invert deletion / creation process HOT 2
- Feature Request: Support Topic Whitelisting HOT 1
- Feature Request: Provide public Docker image based on java 11 HOT 1
- Entire configuration including password is logged HOT 1
- Latest Docker version (0.2.15 - master) cannot parse state file HOT 2
- kafka-gitops should never output passwords HOT 2
- Missing properties are not reported clearly HOT 1
- kafka-gitopts via homebrew : look for java in JAVA_HOME ? HOT 1
- Connecting to service accounts created in CC
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-gitops.