#office-hours - November 2022

Q: Before deploying to production/merging into the main branch: How do you test changes made to a service defined in terraform? (or other IaC).

I’d be interested in hearing how people approach the developer workflow for services defined with terraform, in particular how are changes (hopefully automatically, but perhaps manually) tested before they are merged into the main branch and/or deployed to production?

Terraform validation/planning are useful but don’t cover the service functionality. I’ve found Terratest great to test individual or small groups of terraform modules that deploy/undeploy quickly, but I’m wondering how folks approach higher-level or even end-to-end regression tests, in relatively complex services with resources potentially deployed cross-account.

For discussion: https://www.pulumi.com/blog/pulumi-yaml-ga/

@here office hours is starting in 30 minutes! Remember to post your questions here.

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Robert Jordan has joined Public "Office Hours"

Tony Scott has joined Public "Office Hours"

Linda Pham (Cloud Posse) has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Martin Weber has joined Public "Office Hours"

Isaac M has joined Public "Office Hours"

Robert Jordan has joined Public "Office Hours"

Leonor Daniel has joined Public "Office Hours"

Gabriel has joined Public "Office Hours"

David Hawthorne has joined Public "Office Hours"

Bridget Royer has joined Public "Office Hours"

Hugo Samayoa III has joined Public "Office Hours"

Tim Gourley has joined Public "Office Hours"

Charles Smith has joined Public "Office Hours"

Michael Jenkins has joined Public "Office Hours"

Ralf Pieper has joined Public "Office Hours"

Joe Caulfield has joined Public "Office Hours"

Soren Jensen has joined Public "Office Hours"

PePe Amengual has joined Public "Office Hours"

Maura Rowell has joined Public "Office Hours"

Salvador Montiel has joined Public "Office Hours"

Brian Pauley has joined Public "Office Hours"

Jared Richards has joined Public "Office Hours"

Jared Richards has joined Public "Office Hours"

Mazin Ahmed has joined Public "Office Hours"

Ozzy has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

venkata mutyala has joined Public "Office Hours"

Maged Abdelmoeti has joined Public "Office Hours"

Oskar Maria Grande has joined Public "Office Hours"

links from office hours:
https://github.blog/changelog/2022-11-01-github-actions-restrict-workflows-to-specific-runners-using-runner-group-names/
https://github.com/FiloSottile/mkcert
https://github.com/badarsebard/terraforge
https://github.com/cloudposse/terraform-aws-network-firewall

Hey folks — Does anyone happen to know which office hours we discussed different branching strategies (e.g. trunk vs gitflow vs github flow etc) for infrastructure? We’ve talked about it a number of times in Office Hours, but I just went to go and search for it on YouTube and can’t seem to find it. I know it’s a long shot, but if anyone can point me towards that I’d appreciate it

This might be kinda cool:
https://investors.datadoghq.com/news-releases/news-release-details/datadog-acquires-cloudcraft-create-live-cloud-architecture

Does anyone here backup their git repos? If so what service do you use? My team and I do all of our development in the cloud via codespaces so unlike many development teams we don't have a backup in the event we do a bad rebase or in the chance something were to happen to github.

Today I learned about the cluster API: https://cluster-api.sigs.k8s.io/#why-build-cluster-api

Anyone here use it before?

Anyone knows ways to test GitHub actions locally?

@here office hours is starting in 30 minutes! Remember to post your questions here.

Hey, we’ve been trying out Spacelift and it obviously rocks. It seems to think in pure Terraform so I would love to know/see how you dovetail it with Atmos, if possible. Thanks!

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

sri nandu has joined Public "Office Hours"

Vlad Ionescu has joined Public "Office Hours"

Andrew Hall has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

Oliver Schoenborn has joined Public "Office Hours"

Andrew Vitko has joined Public "Office Hours"

Renesh G has joined Public "Office Hours"

Ralf Pieper has joined Public "Office Hours"

Linda Pham (Cloud Posse) has joined Public "Office Hours"

Hugo Samayoa III has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Brian Pauley has joined Public "Office Hours"

venkata mutyala has joined Public "Office Hours"

sri nandu has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Reed Hanger has joined Public "Office Hours"

Johnmary Odenigbo has joined Public "Office Hours"

Arthur Dent has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Dave Gregory has joined Public "Office Hours"

Johnmary Odenigbo has joined Public "Office Hours"

Dave Gregory has joined Public "Office Hours"

Joe Caulfield has joined Public "Office Hours"

Stelios Latsinoglou has joined Public "Office Hours"

Joe Caulfield has joined Public "Office Hours"

Zachary Loeber has joined Public "Office Hours"

Yusuf has joined Public "Office Hours"

Having issues, implementing varnish cache for some next.js application on Kubernetes cluster. Anyone done that before, who can point me in the right direction. Thanks

Tim Gourley has joined Public "Office Hours"

Michael Pursifull has joined Public "Office Hours"

Speaking of GitHub, it's GitHub Universe 2022 today and tomorrow.

Dave Gregory has joined Public "Office Hours"

Links from office hours:
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-cloudtrail-delegated-account-support-aws-organizations/
https://aws.amazon.com/about-aws/whats-new/2022/11/announcing-aws-resource-explorer/
https://github.com/orgs/community/discussions/31#discussioncomment-4048867
https://ossinsight.io/2022/#the-most-active-repositories
https://cloudposse.com/careers/

Really appreciated the Atmos+Spacelift demo last week! Any chance of something similar this week to demonstrate/explain the way you spin up a new AWS account in an org in the CloudPosse/SweetOps model? Thanks!

@Erik Osterman (Cloud Posse) https://github.com/cresta/atlantis-drift-detection

FYI: I won't make it to today's call 😞

@here office hours is starting in 30 minutes! Remember to post your questions here.

Nicolás de la Torre has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Brian Choate has joined Public "Office Hours"

Michael Pursifull has joined Public "Office Hours"

Alex Atkinson has joined Public "Office Hours"

Jose Figueredo has joined Public "Office Hours"

Susie Heilman has joined Public "Office Hours"

Isaac M has joined Public "Office Hours"

Jan Niederhumer has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Kaya Winn has joined Public "Office Hours"

Charles Smith has joined Public "Office Hours"

Alex Siegman has joined Public "Office Hours"

Brian Pauley has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Hugo Samayoa III has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Oliver Schoenborn has joined Public "Office Hours"

Arthur Dent has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Stelios Latsinoglou has joined Public "Office Hours"

Jeremy White has joined Public "Office Hours"

Paul Bullock has joined Public "Office Hours"

Shaun Wang has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Oliver Schoenborn has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Michael Jenkins has joined Public "Office Hours"

I forgot to ask, does anyone know what the main reasons were for switching atmos docs to docusaurus (and what was the previous doc system used)?

links from today's call:
https://github.blog/2022-11-15-the-journey-of-your-work-has-never-been-clearer/
https://spacelift.io/blog/spaces-by-spacelift
https://github.blog/changelog/2022-11-14-github-actions-require-approval-for-running-workflows-from-private-forks/
https://docs.github.com/en/actions/migrating-to-github-actions/automating-migration-with-github-actions-importer
https://github.com/cresta/atlantis-drift-detection
http://terraform-provider-environment
https://slack.engineering/how-we-use-terraform-at-slack/
https://atmos.tools/
https://cloudposse.com/careers/

Something interesting to cover tomorrow would be Karpenter's newly-released Spot Instance Interruption-handling feature, which makes cost savings with spot instances more viable for critical workloads.

@here office hours is starting in 30 minutes! Remember to post your questions here.

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Allan Mohr has joined Public "Office Hours"

Vlad Ionescu has joined Public "Office Hours"

Linda Pham (Cloud Posse) has joined Public "Office Hours"

Mikael Fridh has joined Public "Office Hours"

Andrew Vitko has joined Public "Office Hours"

Brian Pauley has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Alex Atkinson has joined Public "Office Hours"

Reed Hanger has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

Michael Pursifull has joined Public "Office Hours"

Precious has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

Brett Seals has joined Public "Office Hours"

Guillermo Gutierrez has joined Public "Office Hours"

Jeremy Bouse has joined Public "Office Hours"

Ben Smith (Cloud Posse) has joined Public "Office Hours"

Charles Smith has joined Public "Office Hours"

Yusuf has joined Public "Office Hours"

Antarr Byrd has joined Public "Office Hours"

Steven Vargas has joined Public "Office Hours"

Dave Gregory has joined Public "Office Hours"

Joe Caulfield has joined Public "Office Hours"

dag viggo lokoeen has joined Public "Office Hours"

For continuity, the issue to watch is https://github.com/aws/containers-roadmap/issues/876 🙂

Links from today's office hours:
https://github.com/tailscale/github-action
https://tailscale.com/blog/2021-05-github-actions-and-tailscale/
https://www.robert-jensen.dk/posts/2022-using-github-actions-with-tailscale-to-deploy-locally
https://gist.github.com/AlexAtkinson/73b8fde4c010e5983cfc22e0928dfc5c
https://sweetops.slack.com/archives/CHDR1EWNA/p1669114607374279
https://sweetops.slack.com/archives/CHDR1EWNA/p1669231281395509?thread_ts=1669230039.133869&cid=CHDR1EWNA
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-identity-access-management-multi-factor-authentication-devices/
https://github.com/kubeshark/kubeshark
https://github.com/busser/tftree
https://blog.cloudflare.com/terraforming-cloudflare-at-cloudflare/
https://github.blog/changelog/2022-11-22-webhook-enhancements-for-environment-protection-rules/
https://docs.github.com/en/developers/webhooks-and-events/webhooks/receiving-webhooks-with-the-github-cli

Anyone here using self-hosted opensearch in production over elasticsearch? I'm considering it as my centralized logging solution for kubernetes. I was also considering Loki but it seems a little immature right now.

@here office hours is starting in 30 minutes! Remember to post your questions here.

1. What do you think of AWS KMS External Key Store announcement, and what are some of the use-cases you can think of?

Linda Pham (Cloud Posse) has joined Public "Office Hours"

Dave Gregory has joined Public "Office Hours"

venkata mutyala has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Guillermo Gutierrez has joined Public "Office Hours"

Vlad Ionescu has joined Public "Office Hours"

Andrew Vitko has joined Public "Office Hours"

Hugo Samayoa III has joined Public "Office Hours"

Luis Masaya has joined Public "Office Hours"

Michael Jenkins has joined Public "Office Hours"

Charles Smith has joined Public "Office Hours"

Robert Jordan has joined Public "Office Hours"

David Hawthorne has joined Public "Office Hours"

Joe Caulfield has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Henrik Huitti has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Amer Zec has joined Public "Office Hours"

PePe Amengual has joined Public "Office Hours"

Sherif Abdel-Naby has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

Alex Siegman has joined Public "Office Hours"

Ajibola Oladele has joined Public "Office Hours"

Amer Zec has joined Public "Office Hours"

Isaac M has joined Public "Office Hours"

rik broers has joined Public "Office Hours"

Reminds me of a knock knock joke:

> Knock, knock.

< Who's there?

> ...

> ...

> ...

> ...

> ...

> ...

> ...

> ... java.

Gabriel Boie has joined Public "Office Hours"

Links from today's call:
https://github.com/bflad/tfproviderlint
https://github.com/awslabs/terraform-iam-policy-validator
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-config-rules-support-proactive-compliance/
https://aws.amazon.com/blogs/aws/new-fully-managed-blue-green-deployments-in-amazon-aurora-and-amazon-rds/
https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-cloudfront-continuous-deployment-support/
https://aws.amazon.com/blogs/aws/new-accelerate-your-lambda-functions-with-lambda-snapstart/
https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-security-lake-preview/
https://aws.amazon.com/blogs/aws/introducing-vpc-lattice-simplify-networking-for-service-to-service-communication-preview/
https://aws.amazon.com/about-aws/whats-new/2022/11/announcing-amazon-opensearch-serverless-preview/
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-announces-lower-latencies-amazon-elastic-file-system/
https://www.osohq.com/
https://www.microsoft.com/en-us/research/publication/description-cedar-language/
https://www.keycloak.org/