DevOps Günlüğü #36 12.01.2020
Haftanın Başlıkları
- Software Architecture is Overrated, Clear and Simple Design is Underrated
https://blog.pragmaticengineer.com/software-architecture-is-overrated/ - Algo - 101+ coding interview problems with detailed solutions, test cases, and program analysis
https://github.com/hoanhan101/algo - DevOps terms: 10 advanced concepts to know
https://enterprisersproject.com/article/2019/9/devops-terms-10-advanced - 30 Linux Permissions Exercises for Sysadmins
https://devconnected.com/30-linux-permissions-exercises-for-sysadmins/ - Input Output Redirection on Linux Explained
https://devconnected.com/input-output-redirection-on-linux-explained/ - Traefik 2.0
https://blog.containo.us/traefik-2-0-6531ec5196c2 - If you’re not using SSH certificates you’re doing SSH wrong
https://smallstep.com/blog/use-ssh-certificates/ - API Security Checklist - Checklist of the most important security countermeasures when designing, testing, and releasing your API
https://github.com/shieldfy/API-Security-Checklist - Site Reliability Engineer (SRE) Interview Preparation Guide
https://github.com/mxssl/sre-interview-prep-guide - Building Container Images Securely on Kubernetes
https://blog.jessfraz.com/post/building-container-images-securely-on-kubernetes/ - DevOps-Guide - DevOps Guide from basic to advanced with Interview Questions and Notes
https://github.com/Tikam02/DevOps-Guide - Pack Your Bags – Systemd Is Taking You To A New Home
https://hackaday.com/2019/10/16/pack-your-bags-systemd-is-taking-you-to-a-new-home/ - Kubernetes for Full-Stack Developers
https://www.digitalocean.com/community/curriculums/kubernetes-for-full-stack-developers - How To Corrupt An SQLite Database File
https://sqlite.org/howtocorrupt.html - A Very Basic Introduction to AES-256 Cipher
https://hackernoon.com/very-basic-intro-to-aes-256-cipher-qxr32yk - Intelligent DNS based load balancing at Dropbox
https://blogs.dropbox.com/tech/2020/01/intelligent-dns-based-load-balancing-at-dropbox/ - eBay Rolls Out Kubernetes for Performance-Sensitive Search Operations
https://thenewstack.io/ebay-rolls-out-kubernetes-for-performance-sensitive-search-operations/ - A collection of free single-purpose online tools for web developers...
https://tiny-helpers.dev/ - Chaos Mesh - Your Chaos Engineering Solution for System Resiliency on Kubernetes
https://pingcap.com/blog/chaos-mesh-your-chaos-engineering-solution-for-system-resiliency-on-kubernetes/ - DevOps Exercises - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization
https://github.com/bregman-arie/devops-exercises - Multipath TCP Support Is Working Its Upstream - First Bits Landing With Linux 5.6
https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.6-Starts-Multipath-TCP - MySQL Challenge: 100k Connections
https://www.percona.com/blog/2019/02/25/mysql-challenge-100k-connections/ - Systemd service sandboxing and security hardening 101
https://www.ctrl.blog/entry/systemd-service-hardening.html - Making Python Programs Blazingly Fast
https://martinheinz.dev/blog/13 - Auto-restart a crashed service in systemd
https://ma.ttias.be/auto-restart-crashed-service-systemd/ - How to Run Commands on Multiple Linux Hosts Using PSSH
https://www.freecodecamp.org/news/running-commands-linux-hosts-using-pssh/ - Introduction to Vitess on Kubernetes for MySQL – Part I of III
https://www.percona.com/blog/2020/01/13/introduction-to-vitess-on-kubernetes-for-mysql-part-i-of-iii/ - CNCF Cloud Native Interactive Landscape
https://landscape.cncf.io/ - CacheOut - A new Intel CPU vulnerability
https://cacheoutattack.com/ - Introducing Zeitgeist: dependency management for DevOps
https://blog.florentdelannoy.com/blog/2020/introducing-zeitgeist/ - Awesome Scalability - The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
http://awesome-scalability.com/ - How to build a Search-Engine with Common Unix-Tools
https://www.iaria.org/conferences2018/filesDBKDA18/AndreasSchmidt_Tutorial_SearchEngine.pdf - Awk - A Tutorial and Introduction
https://www.grymoire.com/Unix/Awk.html - PostgresqlCO - PostgreSQL configuration for humans
https://postgresqlco.nf/ - Scaling to 100k Users
https://alexpareto.com/scalability/systems/2020/02/03/scaling-100k.html - On Pair Programming
https://martinfowler.com/articles/on-pair-programming.html - Scalene - A high-performance, high-precision CPU and memory profiler for Python
https://github.com/emeryberger/scalene - Prometheus For Beginners
https://itnext.io/prometheus-for-beginners-5f20c2e89b6c - Scripting tmux
https://www.arp242.net/tmux.html - What You Probably Didn’t Know About Sudo
https://aster.cloud/2019/12/17/what-you-probably-didnt-know-about-sudo/ - How LinkedIn customizes Apache Kafka for 7 trillion messages per day
https://engineering.linkedin.com/blog/2019/apache-kafka-trillion-messages - Internet Exchange Map
https://www.internetexchangemap.com/ - Finding MySQL Scaling Problems Using perf
https://www.percona.com/community-blog/2020/02/05/finding-mysql-scaling-problems-using-perf/ - iHateRegex - The Regex Cheat Sheet
https://ihateregex.io
Açık Kaynak Kodlu Projeler
- Osync - A robust two way (bidirectional) file sync script based on rsync with fault tolerance, POSIX ACL support, time control and near realtime sync
http://www.netpower.fr/osync - Git Quick Stats - A simple and efficient way to access various statistics in git repository.
https://github.com/arzzen/git-quick-stats - Kubesphere - Easy-to-use Production Ready Container Platform
https://github.com/kubesphere/kubesphere - Bat - A cat(1) clone with wings.
https://github.com/sharkdp/bat - Img - Standalone, daemon-less, unprivileged Dockerfile and OCI compatible container image builder.
https://github.com/genuinetools/img - OPNids - The first integration of Suricata IDS with a purpose-built Machine Learning Scripting Engine.
https://www.opnids.io/ - DragonFly: Streaming Machine Learning Engine (MLE) for Network Threat Detection
https://github.com/counterflow-ai/dragonfly-mle - Universal Radio Hacker - investigate wireless protocols like a boss
https://github.com/jopohl/urh - Cheat - Create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember.
https://github.com/cheat/cheat - Astra - Automated Security Testing For REST API's
https://github.com/flipkart-incubator/Astra - Sops - Simple and flexible tool for managing secrets
https://github.com/mozilla/sops - Agones - Dedicated Game Server Hosting and Scaling for Multiplayer Games on Kubernetes
https://agones.dev/ - Open Match - Flexible, extensible, and scalable video game matchmaking.
https://open-match.dev/ - Jira Clone - A simplified Jira clone built with React/Babel (Client), and Node/TypeScript (API). Auto formatted with Prettier, tested with Cypress. http://jira.ivorreic.com
- RudderStack - Privacy and Security focused Segment-alternative, in Golang and React
https://rudderstack.com/ - Fider - Open platform to collect and prioritize product feedback
https://getfider.com/ - Daptin - GraphQL/JSON-API Headless CMS
https://github.com/daptin/daptin - HonSSH - Designed to log all SSH communications between a client and server.
https://github.com/tnich/honssh - DTail - Distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.
https://github.com/mimecast/dtail - Super Easy All-In-One DevOps Platform
https://github.com/theonedev/onedev - NebulaGraph - A truly distributed, linear scalable, lightning-fast open source graph database.
https://nebula-graph.io - Open Event Server - The Open Event Organizer Server to Manage Events
https://github.com/fossasia/open-event-server - GoatCounter - Simple web statistics. No tracking of personal data.
https://www.goatcounter.com/ - Neko - A self hosted virtual browser (rabb.it clone) that runs in docker.
https://github.com/nurdism/neko - Sandy - A tiny "sandbox" to run untrusted code
https://github.com/hobochild/sandy - Murex - Bash-like $SHELL designed for greater commandline productivity and safer shell scripts
https://github.com/lmorg/murex - Tcpgoon - tcpgoon, maximum TCP connections tester
https://github.com/dachad/tcpgoon - Terrier - Image and Container analysis tool that can be used to scan Images and Containers to identify and verify the presence of specific files according to their hashes.
https://github.com/heroku/terrier - Kopano - 100% Open source collaboration tools: email, calendaring, Mattermost chat, webRTC video meetings, document collaboration with LibreOffice Online, integration with file storage services and more.
https://kopano.io/ - Img - Standalone, daemon-less, unprivileged Dockerfile and OCI compatible container image builder.
https://github.com/genuinetools/img - Age - A simple, modern and secure encryption tool with small explicit keys, no config options, and UNIX-style composability.
https://github.com/genuinetools/img - MOSN - Powerful cloud-native proxy acts as a edge proxy or service mesh's data plane.
https://mosn.io/ - CrossPlane - The open source multicloud control plane.
https://crossplane.io/ - VictoriaMetrics - fast, cost-effective and scalable time series database, long-term remote storage for Prometheus
https://victoriametrics.com/ - Smallsteps Certificates - A private certificate authority (X.509 & SSH) & ACME server for secure automated certificate management, so you can use TLS everywhere & SSO for SSH.
https://smallstep.com/certificates/ - Gitbatch - Manage your git repositories in one place
https://github.com/isacikgoz/gitbatch - Glow - Render markdown on the CLI, with pizzazz!
https://github.com/charmbracelet/glow - Buf - A new way of working with Protocol Buffers.
https://buf.build/ - Cassowary - Modern cross-platform HTTP load-testing tool written in Go
https://github.com/rogerwelin/cassowary - CoreDHCP - Fast, multithreaded, modular and extensible DHCP server written in Go
https://coredhcp.io/ - Cantools - CAN BUS tools in Python 3.
https://github.com/eerimoq/cantools - Gter - A terminal for GUI apps (WIP)
https://github.com/raoofha/gter - Parsr - Transforms PDF, Documents and Images into Enriched Structured Data
https://github.com/axa-group/Parsr - Open-DMARC-Analyzer - Open Source DMARC Report Analyzer to be used with DMARC reports that have been parsed by John Levine's rrdmarc script or techsneeze's dmarcts-report-parser.
https://github.com/userjack6880/Open-DMARC-Analyzer - Tuptime - Report the historical and statistical real time of the system, keeping it between restarts. Like uptime command but with more interesting output.
https://github.com/rfrail3/tuptime - Firejail - Linux namespaces and seccomp-bpf sandbox
https://firejail.wordpress.com/
https://github.com/netblue30/firejail - PrivateBin - A minimalist, open source online pastebin where the server has zero knowledge of pasted data. Data is encrypted/decrypted in the browser using 256 bits AES.
https://privatebin.info/
https://github.com/PrivateBin/PrivateBin - 0x4447_product_s3_email - A serverless email server on AWS using S3 and SES
https://github.com/0x4447/0x4447_product_s3_email - SpiderFoot - The most complete OSINT collection and reconnaissance tool.
https://github.com/smicallef/spiderfoot - FabioLB - HTTP and TCP reverse proxy that configures itself with data from Consul.
https://github.com/fabiolb/fabio - Better Initramfs - Small and reliable initramfs solution supporting (remote) rescue shell, lvm, dmcrypt luks, software raid, tuxonice, uswsusp and more.
https://github.com/slashbeast/better-initramfs - ShellHub - Enables teams to easily access any Linux device behind firewall and NAT.
https://shellhub-io.github.io/ - Whalebrew - Homebrew, but with Docker images
https://github.com/whalebrew/whalebrew - Zeitgeist - The language-agnostic dependency checker
https://github.com/Pluies/zeitgeist - Distri - 20x faster initramfs (initrd) from scratch
https://michael.stapelberg.ch/posts/2020-01-21-initramfs-from-scratch-golang/ - Sovereign - A set of Ansible playbooks to build and maintain your own private cloud: email, calendar, contacts, file sync, IRC bouncer, VPN, and more.
https://github.com/sovereign/sovereign - EdgeDB - Combines the simplicity of a NoSQL database with relational model’s powerful querying, strictness, consistency, and performance.
https://edgedb.com/ - OpenSnitch - GNU/Linux port of the Little Snitch application firewall
https://github.com/evilsocket/opensnitch - Ouroboros - Automatically update running docker containers with newest available image
https://github.com/pyouroboros/ouroboros - PcapXray - A Network Forensics Tool - To visualize a Packet Capture offline as a Network Diagram including device identification, highlight important communication and file extraction
https://github.com/Srinivas11789/PcapXray - Tinfoil Chat - Onion-routed, endpoint secure messaging system
https://github.com/maqp/tfc - Pueue - A daemon for managing long running shell commands.
https://github.com/Nukesor/pueue - Direnv - unclutter your .profile
https://direnv.net/ - Perkeep - Personal storage system for life: a way of storing, syncing, sharing, modelling and backing up content.
https://perkeep.org/ - Cameradar - Hacks its way into RTSP videosurveillance cameras
https://github.com/Ullaakut/cameradar - Remark42 - Comment engine
https://remark42.com/ - DevSpace - The Fastest Developer Tool for Kubernetes ⚡ Automate your deployment workflow with DevSpace and develop software directly inside Kubernetes.
https://devspace.sh/ - DevicePlane - Open source device management for embedded systems and edge computing
https://deviceplane.com/ - Authelia - The Cloud ready multi-factor single sign-on portal for your Apps
https://www.authelia.com/ - Healthchecks - A Cron Monitoring Tool written in Python & Django
https://github.com/healthchecks/healthchecks - VirtScreen - Make your iPad/tablet/computer into a secondary monitor on Linux.
https://github.com/kbumsik/VirtScreen - Cortex - A horizontally scalable, highly available, multi-tenant, long term Prometheus.
https://cortexmetrics.io/ - Short - URL shortening service written in Go and React
https://github.com/short-d/short - Pomerium - Authenticate, authorize, monitor, and secure user access to any application without a VPN.
https://www.pomerium.io/ - Jellyfin - The Free Software Media System
https://jellyfin.org/ - Bandwhich - Terminal bandwidth utilization tool
https://github.com/imsnif/bandwhich - Apache Pulsar - Open-source distributed pub-sub messaging system
https://pulsar.apache.org/ - Outline - The fastest wiki and knowledge base for growing teams. Beautiful, feature rich, markdown compatible and open source.
https://github.com/outline/outline - Dapr - Portable, event-driven, runtime for building distributed applications across cloud and edge.
https://github.com/dapr/dapr - OpenTelemetry - Robust, portable telemetry a built-in feature of cloud-native software.
https://opentelemetry.io/ - FLIF - Free Lossless Image Format
https://flif.info/ - Bocker - Docker implemented in around 100 lines of bash
https://github.com/p8952/bocker - Rtty - Access your device's terminal from anywhere via the web.
https://github.com/zhaojh329/rtty - Heimdall - Self-hosted personal email guardian with one-step deployment
https://github.com/fterh/heimdall
Go Kütüphaneleri
- Stats - A well tested and comprehensive Golang statistics library package with no dependencies.
https://github.com/montanaflynn/stats - go-dexif - remove exif data fast
https://github.com/xis/go-dexif - govalidator - Package of validators and sanitizers for strings, numerics, slices and structs
https://github.com/asaskevich/govalidator - go-callvis - Visualize call graph of a Go program using dot (Graphviz)
https://truefurby.github.io/go-callvis/ - Octosql - Query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
https://github.com/cube2222/octosql - GoJSONq - Simple Go package to Query over JSON/YAML/XML/CSV Data
https://github.com/thedevsaddam/gojsonq - tbls - CI-Friendly tool for document a database, written in Go.
https://github.com/k1LoW/tbls - Cob - Continuous Benchmark for Go Projects
https://github.com/knqyf263/cob - Gonet - Neural Network for Go.
https://github.com/dathoangnd/gonet - Xorm - Simple and Powerful ORM for Go, support mysql,postgres,tidb,sqlite3,mssql,oracle
https://xorm.io/ - Evio - Fast event-loop networking for Go
https://github.com/tidwall/evio - Hover - Flutter on Windows, MacOS and Linux - based on Flutter Embedding, Go and GLFW.
https://hover.build/ - Git-bug - Distributed, offline-first bug tracker embedded in git, with bridges
https://github.com/MichaelMure/git-bug - Ws - Tiny WebSocket library for Go.
https://github.com/gobwas/ws - Micro - A microservice runtime environment
https://micro.mu/ - Go-Micro - A Go microservices development framework
https://go-micro.dev/ - GoRush - A push notification server written in Go (Golang).
https://github.com/appleboy/gorush - MatterBridge - bridge between mattermost, IRC, gitter, xmpp, slack, discord, telegram, rocketchat, steam, twitch, ssh-chat, zulip, whatsapp, keybase, matrix and more with REST API
https://github.com/42wim/matterbridge - Noise - A decentralized P2P networking stack written in Go.
https://github.com/perlin-network/noise - Flaggy - Idiomatic Go input parsing with subcommands, positional values, and flags at any position. No required project or package layout and no external dependencies.
https://github.com/integrii/flaggy - Fn - The container native, cloud agnostic serverless platform.
https://fnproject.io/
Haftanın Kitapları
- Pure Hash Bible - A collection of pure bash alternatives to external processes.
https://github.com/dylanaraps/pure-bash-bible - UNIX: A History and a Memoir
https://www.amazon.com/gp/product/1695978552
Photo Credits:
Nasa Image of The Day - This Week in NASA History: 3rd Hubble Servicing Mission – Dec. 19, 1999