#office-hours - May 2020

Here's a great question for office hours this week: https://sweetops.slack.com/archives/CQCDCLA1M/p1588441766212200

So I am curious if this is just something that would be useful to me. But would a tool where you can aggregate events from multiple sources onto a single timeline be useful for y’all?

This is just a quick mock up of something I have been thinking about.

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Andrew Roth has joined Public "Office Hours"

zloeber has joined Public "Office Hours"

Adam Watson has joined Public "Office Hours"

Adedayo Akinpelu has joined Public "Office Hours"

Edward Wizelman has joined Public "Office Hours"

Pierre Humberdroz has joined Public "Office Hours"

Marcin Branski has joined Public "Office Hours"

David Scott has joined Public "Office Hours"

Darrin Rentschler has joined Public "Office Hours"

Darrin Rentschler has left Public "Office Hours"

kiran k has joined Public "Office Hours"

Szymon Matuszewski has joined Public "Office Hours"

Brian Tai has joined Public "Office Hours"

Sri P has joined Public "Office Hours"

Gemini Agaloos has joined Public "Office Hours"

Jose Netto has joined Public "Office Hours"

Jordan Levington has joined Public "Office Hours"

Jordan Levington has left Public "Office Hours"

Omer Sen has joined Public "Office Hours"

Libert Schmidt has joined Public "Office Hours"

Andrew Elkins has joined Public "Office Hours"

Miranda Pearson has joined Public "Office Hours"

Mikael Fridh has joined Public "Office Hours"

Lewis Jenkins has joined Public "Office Hours"

Geoff Weinhold has joined Public "Office Hours"

derp, need to rotate those...

it is fine.

Charlie Mathews has joined Public "Office Hours"

Loki is great for the way it can integrate nicely with prometheus metrics due to the labels - you can basically match them up...
But honestly, what has me going right now is https://github.com/flant/loghouse + https://github.com/ClickHouse/ClickHouse . Not fully tested it yet though.

Just look at this statement... ClickHouse works 100-1000x faster than traditional approaches. Most vendors and projects will have bold claims... but they are rarely this confident 😃.

asadana has joined Public "Office Hours"

Olivier Chaine has joined Public "Office Hours"

Miranda Pearson has left Public "Office Hours"

Marc Boudreau has joined Public "Office Hours"

thanks @Andrew Roth

Omer Sen has left Public "Office Hours"

Brian Tai has left Public "Office Hours"

PSA

in 1.16 /extenionsons/v1beta1 api going away for certain resources

Adedayo Akinpelu has left Public "Office Hours"

Charlie Mathews has left Public "Office Hours"

Adam Watson has left Public "Office Hours"

David Scott has left Public "Office Hours"

zloeber has left Public "Office Hours"

Pierre Humberdroz has left Public "Office Hours"

Andrew Roth has left Public "Office Hours"

Geoff Weinhold has left Public "Office Hours"

asadana has left Public "Office Hours"

Marcin Branski has left Public "Office Hours"

Szymon Matuszewski has left Public "Office Hours"

Andrew Elkins has left Public "Office Hours"

Edward Wizelman has left Public "Office Hours"

Marc Boudreau has left Public "Office Hours"

Mikael Fridh has left Public "Office Hours"

Libert Schmidt has left Public "Office Hours"

Olivier Chaine has left Public "Office Hours"

Jose Netto has left Public "Office Hours"

Erik Osterman (Cloud Posse) has left Public "Office Hours"

Sri P has left Public "Office Hours"

Gemini Agaloos has left Public "Office Hours"

kiran k has left Public "Office Hours"

Lewis Jenkins has left Public "Office Hours"

Crap - I think I forgot to hit record. Zoom UI changed and through me off.

still processing

👉️ New Zoom Recording from our Office Hours session on 2020-05-06 is now available.

👉️ New Zoom Recording from our Office Hours session on 2020-04-29 is now available.

Question for today’s office hour: What are the best practices for version numbering of multiple resources (apps, charts, docker images, etc) stored in the same monorepo? Using git tags (ie: v1.0.1) to track semantic versions seems awkward, because all resources would share the same version “counter”. Using the short commit hash seems more appropriate, but it is not allowed as chart version, which expects a semantic version in the form 1.0.1. I’m currently considering using something like 1.0.1589390493, where the last number is the number of seconds since UNIX epoch, calculated using the commit’s timestamp:

$(date "+%s" -d "$(git show -s --format=%ci)")

The major and minor versions could be stored in a file in the base dir of each resource.
Any other suggestions?

@here please share your questions for today's office hours!

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Neil Gealy has joined Public "Office Hours"

Marc Tanne has joined Public "Office Hours"

rohit g has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Andrew Roth has joined Public "Office Hours"

zloeber has joined Public "Office Hours"

Omer Sen has joined Public "Office Hours"

Matt Gowie has joined Public "Office Hours"

Andrew Elkins has joined Public "Office Hours"

Andrea Bolandrina has joined Public "Office Hours"

David Scott has joined Public "Office Hours"

Robert Horrox has joined Public "Office Hours"

Brian Tai has joined Public "Office Hours"

Mathieu Frenette has joined Public "Office Hours"

Vitali Bystritski has joined Public "Office Hours"

CHONAN TSAI has joined Public "Office Hours"

Gemini Agaloos has joined Public "Office Hours"

Adedayo Akinpelu has joined Public "Office Hours"

What do you use to authenticate users against aws eks? I want to use external authentication mechanism aside from aws-auth configmap. Maybe use my AD users/groups?

Jboss keycloak

Okta replacer

Ambassador is a good step I think: https://www.getambassador.io/docs/1.4/howtos/sso/okta/

Steve Boardwell has joined Public "Office Hours"

Edward Wizelman has joined Public "Office Hours"

Question on video stream transcoding from h.265/HEVC to h.264

soyer has joined Public "Office Hours"

Another question. I want to limit pod/deployment to only accept ingress(incoming) traffic from Aws Alb Ingress only not any other pod/deployments on SAME k8s namespace. Networkpolicy is limited namespaces, labels but seperating namespaces requires seperate alb ingress AND seperate external-dns (as both of them works on one Namespace only) what do u suggest?

Muhammed Soyer has joined Public "Office Hours"

Since ingress is not a deployment...

Ok let me chech appmesh on Aws

Instead of istio

Not yet ;)

Or solo meshctl

Anyone heard about BackStage by Spotify ? It is a developer portal to provision applications etc .. I heard about it recently, just started evaluating..
https://backstage.io/

https://thenewstack.io/how-the-u-s-air-force-deployed-kubernetes-and-istio-on-an-f-16-in-45-days/

USAF Chief Software Officer likes to say "If Kubernetes is good enough for missiles and F-16s then it is good enough for you"

Is their any example repos with variant2 running terraform modules

👉️ New Zoom Recording from our Office Hours session on 2020-05-13 is now available.

@chonan tsai perfect time! got this in my inbox today

set the channel topic: Public "Office Hours" are held every Wednesday at 11:30 PST via Zoom. It's open to everyone. Ask questions related to DevOps & Cloud and get answers!
👉️ https://cpco.io/slack-office-hours

Meeting password: sweetops

PSA: ☝️

@Omer Sen check out https://github.com/sighupio/permission-manager

(@Zachary Loeber just linked me to the github org and was looking through the repos when I foudn this)

Hi

let me check

thank you

Hey folks, I just got a job offer from Very Good Security... I found out about them right here, thanks to @Erik Osterman (Cloud Posse)

woot!

I might not be here still want to leave something for later today.

So I was affected by quay incident quite heavily I had a test running in my development cluster which drains a node every hour and adds a new one to have a rotation and short lived nodes. Well since quay was not up some of my pods were not able to be scheduled (image pull back) and this caused quite a bit of headache.. But I am happy that I learned from it. I might have to cache/reupload to my own registry.

With the Windows additions of great Mac/Linux-y things like

• A 1st party package manager
• A MacOS-style "spotlight" feature
• Support for Linux GUI apps
• WSL2
Are we finally getting to the point where I don't have to dual-boot Linux on my windows machine to do serious development in a containerized/kubernetes world?

What was the driving reason why you chose the approach of bundling Terraform infra configuration files within a Geodesic image (and are you still using that approach?), versus treating them as two distinct entities (that could still be versioned side-by-side within the same repo and used together in a pipeline)?

We are moving our CI/CD pipelines from Jenkins X (which is 100% Gitops driven) to Codefresh, where we have the ease of use of shared configs and secrets that we can manage easily via the UI and inject into our pipelines as environment variables. However we realize that such configs and secrets are not version-controlled and may sometimes be tightly coupled with the pipelines as they evolve. If for some reason we need to rollback our pipelines, all related configurations will not follow accordingly. What are your thoughts and experience about such external configurations that escape the Gitops domain?

wow! we have a lot of interesting talking points today. excited 😃

Just another heads up, we've had to enable passwords on the Zoom calls (zoom forcing our hand on this). The password is sweetops if you're prompted for it...

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Marc Tanne has joined Public "Office Hours"

Robert Horrox has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

Mukul Garg has joined Public "Office Hours"

zloeber has joined Public "Office Hours"

Adam Crown has joined Public "Office Hours"

Jie Chen has joined Public "Office Hours"

Mathieu Frenette has joined Public "Office Hours"

Adrian Todorov has joined Public "Office Hours"

Marcin Branski has joined Public "Office Hours"

Dale-Kurt Murray has joined Public "Office Hours"

eddie.wizelman has joined Public "Office Hours"

Neil Gealy has joined Public "Office Hours"

Alex Siegman has joined Public "Office Hours"

Pierre has joined Public "Office Hours"

Neil Gealy has joined Public "Office Hours"

Pierre has joined Public "Office Hours"

cho has joined Public "Office Hours"

Brian Tai has joined Public "Office Hours"

Andrew Elkins has joined Public "Office Hours"

Marc Tamsky has joined Public "Office Hours"

Prasanna Pawar has joined Public "Office Hours"

sri has joined Public "Office Hours"

what is the meeting password?

rohit g has joined Public "Office Hours"

José Netto has joined Public "Office Hours"

sri has joined Public "Office Hours"

Sorry I couldnt make it today, I miss you guys.
Homeschooling in the time of covid....

we had an absolutely amazing office hours today! recording will be posted in a few hours.

👉️ New Zoom Recording from our Office Hours session on 2020-05-20 is now available.

Btw, we're also uploading all our office hours to youtube!

if you haven't already subscribed to our channel, it would be a big help! we need to reach 100 subscribers to claim our URL.

Thanks for bringing up my questions! I didn’t have a chance to join the call, but it was a pleasure to watch.

Regarding unanswered question on Tech Radar. I can elaborate a bit and probably it can be a topic for the next session.

What ThoughtWorks says now is that:

We recommend caution in managing stateful systems via container orchestration platforms such as Kubernetes. Some databases are not built with native support for orchestration — they don’t expect a scheduler to kill and relocate them to a different host. Building a highly available service on top of such databases is not trivial, and we still recommend running them on bare metal hosts or a virtual machine (VM) rather than to force-fit them into a container orchestration platform

Kinda a warning. And I know some cases when clients want to do such a move no matter what (I mean to migrate databases to K8s). There might be plenty of databases especially when it is a single tenant app and a bunch of microservices around. What’s your experience with managing databases (Postgres, MariaDB) in K8s given a current state of tooling? Managed services vs operators vs helm charts?

suggested topic: (via @Zachary Loeber) https://sweetops.slack.com/archives/CBW699XE0/p1590086472292600

Heads up! next wednesday on June 3rd (not this week), we'll have a guest speaker to answer any/all your questions on Cloud Formation.

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

rohit g has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

Marc Tanne has joined Public "Office Hours"

Eric Berg has joined Public "Office Hours"

Ianculov Vucomir has joined Public "Office Hours"

Robert Horrox has joined Public "Office Hours"

Matt Gowie has joined Public "Office Hours"

Walter Sosa has joined Public "Office Hours"

Hilal Jaffan has joined Public "Office Hours"

Neil Gealy has joined Public "Office Hours"

Alex Siegman has joined Public "Office Hours"

Haroon Rasheed has joined Public "Office Hours"

Daniel Blue has joined Public "Office Hours"

Please I need help joining the meeting, The meeting link is requesting password

Adedayo Akinpelu has joined Public "Office Hours"

Michael Martin has joined Public "Office Hours"

zloeber has joined Public "Office Hours"

Andrea Bolandrina has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Michael Martin has joined Public "Office Hours"

eddie.wizelman has joined Public "Office Hours"

Jeremy Schuller has joined Public "Office Hours"

Mike Marseglia has joined Public "Office Hours"

PePe Amengual has joined Public "Office Hours"

Jie Chen has joined Public "Office Hours"

Vijay Ravi has joined Public "Office Hours"

Jeremy Schuller has joined Public "Office Hours"

Brian Tai has joined Public "Office Hours"

gemini has joined Public "Office Hours"

Jeremy Schuller has joined Public "Office Hours"

Juan Soto has joined Public "Office Hours"

1. ThoughtWorks now recommends caution in managing stateful systems via container orchestration platforms such as Kubernetes.
2. https://www.thoughtworks.com/radar/techniques/managing-stateful-systems-via-container-orchestration
3. Our retort: https://cloudposse.com/devops/should-you-run-stateful-systems-via-container-orchestration/

1. https://kubedb.com/
2. https://vitess.io/
3. https://cloud.google.com/blog/products/databases/to-run-or-not-to-run-a-database-on-kubernetes-what-to-consider

Michael Martin has joined Public "Office Hours"

Specifically: https://github.com/juliosueiras/vscode-languageclient-terraform

@Erik Osterman (Cloud Posse) didn't you have a "things to think about when choosing a ci/cd platform" article/spreadhseet/list/whatnot you shared a while back?

@Alex Siegman - we do - let me dig that up. Thanks for reminding me.

Might help folks form their own ideas about choosing codefresh vs jenkins vs whatever 😃

@Andrew Roth FYI, unless you pay a base licensing cost for "Enterprise" per month/year, which you probably would anyways for self-hosted, codefresh does charge per user as well as per concurrency. I've been through that with them before 😃 Then again, I make no secret that I'm very anti-per-user pricing.

Here are some ways to control your AWS costs: https://cloudposse.com/aws-cost-controls/

👉️ New Zoom Recording from our Office Hours session on 2020-05-27 is now available.

Hello, my co-worker linked the above office hours video where he asked the question about NAT networks. Is it appropriate to ask a question in this channel about the above video?