batikanturkmen / modern-systems

resources that can be useful to look at on infrastructure and software development.

Useful resources for infrastructure and modern web development.

Apache

• Kafka: Distributed streaming platform.

• Avro: Data serialization system.

• Camel: Message-oriented middleware with a rule-based routing and mediation engine.

Apache Camel is based on Enterprise Integration Patterns

• Airflow: Programmatically author, schedule and monitor workflows.

Apache Airflow can be used kubernetes pod deployment and testing with a single command.

Logging, Tracing & Metrics

• ELK: Elasticsearch, Logstash, and Kibana. Data search, transform and visualization stack.

🔄 Fluentd is a good substitution of Logstash

• Jaeger: End-to-end distributed tracing

• Opentelemetry: Services to capture distributed traces and metrics from your application.

• Prometheus / Grafana: Time series based monitoring solutions.

Docker & Kubernetes

• Helm: The package manager for Kubernetes.

• Rancher: Centralized Kubernetes management solution.

• Harbor: CNCF's Container Registry solution.

• skaffold: Easy and Repeatable Kubernetes Development

• kubectx: Faster way to switch between clusters and namespaces in kubectl.

• Health Check: Explaining health check patterns without kubernetes-native probes.

Service Mesh

• Istio: Service mesh solution that lets you connect, monitor, and secure microservices.

Kubernetes Config Management

• Kustomize: customize raw, template-free YAML files for multiple purposes, leaving the original YAML untouched and usable as is.

• flux: GitOps operator for Kubernetes

Kubernetes Operators

• Confluent Operator: Confluent Operator simplifies running Confluent Platform as a cloud-native system on Kubernetes, on-premises or in the cloud.

💡 Recommended if you're planning to use Apache Kafka on Kubernetes

Go

• Inject build-time variables: Blog post about how to inject variables into your Golang executable at build-time.

• pprof: Package pprof serves via its HTTP server runtime profiling data in the format expected by the pprof visualization tool.

• Concurrency in Go: An introduction to Concurrency in Go.

• Concurrency Patterns In Go: Overview of common concurrency patterns and ends with best practices on lockless programming in Go.

• Go module proxy: Why you should use a Go module proxy.

Java

• Lambdas and Streams: Venkat Subramaniam's Session about lambdas and streams in Devoxx for beginners.

• Quarkus Microservice Workshop: Microservice example using Quarkus and GraalVM.

• Garbage Collection: Java Garbage Collection Basics

• OSGi: The Dynamic Module System for Java

• OSGi Modularity Tutorial: This tutorial gives an overview of OSGi and its modularity layer using Eclipse Equinox.

• BND Tools: Tooling to build OSGi bundles.

• Mockito: Mocking framework for unit tests in Java

• Guice: Lightweight dependency injection framework for Java.

• Vert.x: Tool-kit for building reactive applications on the JVM.

Website

• 12 Factor Methodology: The Twelve-Factor App methodology is explaining 12 best practices that are designed to enable applications to be built with portability and resilience.

• Martin Fowler: Martin Fowler's blog about microservices and software architecture.

• High Scalability: Building bigger, faster and more reliable websites.

Other

• Microservices Demo: Sample cloud-native application with 10 microservices showcasing Kubernetes, Istio, gRPC and OpenCensus.

• gRPC: A high-performance RPC framework.

• Google Cloud Code: provides IDE support for the full development cycle of Kubernetes applications.

• Google SRE Books: Google's Site Reliability Engineering related books.

• Google's Monolithic Repository Paper: Explaining Why and How Google stores billions of lines of code in a single repository.

• Ahmet Alp Balkan's Channel: Ahmet is working at Google Cloud and explaining modern infrastructure and cloud-native technologies in his channel.

• Hashicorp Vault: Tool for managing secrets and protecting sensitive data.

• Hashicorp Terraform: Infrastructure as Code solution to provision and manage any cloud, infrastructure, or service.

• Semantic Versioning: Simple set of rules and requirements that dictate how version numbers are assigned and incremented.

• Conventional Commits: This convention dovetails with SemVer, by describing the features, fixes, and breaking changes made in commit messages.

• Configuration Management Database: CMDBs are used to keep track of the state of assets such as products, systems, software, facilities, people as they exist at specific points in time, and the relationship between all assets.

• Database Migration: Flyway updates a database from one version to a next using migrations.