#codefresh - July 2020

Database maintenance
Jul 5, 08:20 UTC
Update - The platform will be shortly back up.Jul 5, 08:19 UTC
Investigating - We are performing Database maintenance.

Updates will be provided in the coming minutes.

Database maintenance
Jul 5, 08:54 UTC
Resolved - This incident has been resolved.Jul 5, 08:44 UTC
Monitoring - Incident has changed to moniotringJul 5, 08:43 UTC
Update - Platform is back upJul 5, 08:20 UTC
Update - The platform will be shortly back upJul 5, 08:19 UTC
Investigating - We are performing Database maintenance

Hey everyone, we just rebranded our “coffee with codefresh” and took many ideas from the great cloud posse team !

Feel free to join us on our open office hour this Thursday - https://codefresh.io/open-office-hours/

GitHub has reported an Incident.
Jul 13, 07:40 UTC
Identified - More information here:
https://www.githubstatus.com/incidents/j597fw8kv04c

GitHub has reported an Incident.
Jul 13, 08:00 UTC
Update - We are continuing to work on a fix for this issue.Jul 13, 07:40 UTC
Identified - More information here:
https://www.githubstatus.com/incidents/j597fw8kv04c

GitHub has reported an Incident.
Jul 13, 08:08 UTC
Update - Update from GitHub:
"Work continues on the recovery of our services."Jul 13, 07:40 UTC
Identified - More information here:
https://www.githubstatus.com/incidents/j597fw8kv04c

GitHub has reported an Incident.
Jul 13, 08:32 UTC
Resolved - This incident has been resolved.Jul 13, 08:08 UTC
Update - Update from GitHub:
"Work continues on the recovery of our services."Jul 13, 07:40 UTC
Identified - More information here:
https://www.githubstatus.com/incidents/j597fw8kv04c

Microservice guide - documentation ()
(Feed generated with FetchRSS)

Pull requests guide - documentation ()
(Feed generated with FetchRSS)

Creating Docker images guide - documentation ()
(Feed generated with FetchRSS)

Building apps guide - documentation ()
(Feed generated with FetchRSS)

GitHub has reported an Incident.
Jul 15, 15:41 UTC
Investigating - GitHub has reported an Incident.
Incident description from GitHub:
"We are investigating reports of degraded performance."

Pipelines relying on GitHub webhooks are afftected as well.

More information here:
https://www.githubstatus.com/incidents/phnch1rww464

GitHub has reported an Incident.
Jul 15, 18:26 UTC
Resolved - This incident has been resolved.Jul 15, 15:41 UTC
Investigating - GitHub has reported an Incident.
Incident description from GitHub:
"We are investigating reports of degraded performance."

Pipelines relying on GitHub webhooks are afftected as well.

More information here:
https://www.githubstatus.com/incidents/phnch1rww464

Check if a variable exists - documentation ()
(Feed generated with FetchRSS)

Codefresh UI Outage
Jul 17, 21:25 UTC
Investigating - We are currently investigating UI outage.

Cloudflare was having an outage which affected quite a few sites: https://www.cloudflarestatus.com/

Codefresh UI Outage
Jul 17, 21:43 UTC
Identified - We are currently experiencing an UI outage due to a Cloudflare outage. https://www.cloudflarestatus.com/incidents/b888fyhbygb8Jul 17, 21:25 UTC
Investigating - We are currently investigating UI outage.

Codefresh UI Outage
Jul 17, 22:03 UTC
Monitoring - codefresh.io is operational and we are monitoring the status.Jul 17, 21:43 UTC
Identified - We are currently experiencing an UI outage due to a Cloudflare outage. https://www.cloudflarestatus.com/incidents/b888fyhbygb8Jul 17, 21:25 UTC
Investigating - We are currently investigating UI outage.

Codefresh UI Outage
Jul 17, 23:18 UTC
Resolved - This incident has been resolved.Jul 17, 22:03 UTC
Monitoring - codefresh.io is operational and we are monitoring the status.Jul 17, 21:43 UTC
Identified - We are currently experiencing an UI outage due to a Cloudflare outage. https://www.cloudflarestatus.com/incidents/b888fyhbygb8Jul 17, 21:25 UTC
Investigating - We are currently investigating UI outage.

Using GitHub packages as Docker registry - documentation ()
(Feed generated with FetchRSS)

FYI: https://status.codefresh.io/
We are having issues with our Cloud Provider

Builds stuck in Pending
Jul 23, 19:35 UTC
Identified - There's an ongoing issue with one of our Cloud providers.
It's affecting builds that are running in our clusters hosted in AWS N. Virginia.

Builds running on Hybrid (Codefresh runner) are not affected.

More information about the issue: https://status.aws.amazon.com/

Builds stuck in Pending
Jul 23, 21:44 UTC
Monitoring - We have migrated our clusters to a different region.
Builds should be able to run without any issue.

We'll keep monitoring.Jul 23, 19:35 UTC
Identified - There's an ongoing issue with one of our Cloud providers.
It's affecting builds that are running in our clusters hosted in AWS N. Virginia.

Builds running on Hybrid (Codefresh runner) are not affected.

More information about the issue: https://status.aws.amazon.com/

Builds stuck in Pending
Jul 24, 03:38 UTC
Resolved - The incident has been resolved.
All clusters were migrated to the original AWS region.Jul 23, 21:44 UTC
Monitoring - We have migrated our clusters to a different region.
Builds should be able to run without any issue.

We'll keep monitoring.Jul 23, 19:35 UTC
Identified - There's an ongoing issue with one of our Cloud providers.
It's affecting builds that are running in our clusters hosted in AWS N. Virginia.

Builds running on Hybrid (Codefresh runner) are not...

@Erik Osterman (Cloud Posse) @Andriy Knysh (Cloud Posse) do you quote text like SLACK_TITLE or SLACK_FIELD_VALUE in the Codefresh.yml files using https://github.com/cloudposse/slack-notifier?

notify_slack:
    image: cloudposse/slack-notifier:0.3.0
    environment:
      - SLACK_TITLE="Repo is ${{CF_REPO_NAME}}"
vs
     - SLACK_TITLE=Repo is ${{CF_REPO_NAME}}

AWS has reported an incident
Jul 28, 10:04 UTC
Investigating - The following information is published by AWS:
We are investigating an increase in DNS lookup failures from EC2 instances in a single Availability Zone in the US-EAST-1 Region.
More information here:
https://status.aws.amazon.com/

AWS has reported an incident
Jul 28, 10:07 UTC
Update - An update from AWS:
2:57 AM PDT We are continuing to investigate increased DNS resolution errors from EC2 instances in a single Availability Zone of the US-EAST-1 Region. This could also impact functionality of other services that use EC2, such as App Mesh, Cloud9, ElasticSearch, EMR, Managed Blockchain, SageMaker, Transfer for SFTP, WorkMail, and Glue.Jul 28, 10:04 UTC
Investigating - The following information is published by AWS:
We are investigating an increase...

AWS has reported an incident
Jul 28, 10:54 UTC
Identified - An update from AWS:
3:44 AM PDT We are implementing a mitigation to the increased DNS resolution errors from EC2 instances in a single Availability Zone in the US-EAST-1 Region, and are starting to see recovery. This issue could also impact functionality of other services that use EC2, such as App Mesh, Cloud9, ElasticSearch, EMR, Managed Blockchain, SageMaker, Transfer for SFTP, WorkMail, RDS, and Glue.Jul 28, 10:07 UTC
Update - An update from AWS:
2:57 AM PDT...

AWS has reported an incident
Jul 28, 11:40 UTC
Resolved - The following information is published by AWS:
4:37 AM PDT Between 1:22 AM and 4:13 AM PDT, customers experienced an increase in DNS resolution errors from EC2 instances in a single Availability Zone of the US-EAST-1 Region. This could have also impacted functionality of other services that use EC2, such as RDS, SageMaker, EMR, WorkMail, MSK, AWS IoT Analytics Service, Amazon ElasticSearch, Cloud9, AppMesh, Amazon Managed Blockchain, Glue, and AWS Transfer. The...

Slow website loading
Jul 29, 20:33 UTC
Investigating - We're experiencing an issue with loading our website, and are currently looking into the issue.

Slow website loading
Jul 29, 20:50 UTC
Update - The issue has been resolved, but we continue to investigate the cause.Jul 29, 20:33 UTC
Investigating - We're experiencing an issue with loading our website, and are currently looking into the issue.

Slow website loading
Jul 29, 22:30 UTC
Resolved - The root cause of this issue has been identified.
It's related to a networking issue impacting GCP.
More information here:
https://status.cloud.google.com/incident/cloud-networking/20008

Their incident is already resolved, and our service is back to normal.Jul 29, 20:50 UTC
Update - The issue has been resolved, but we continue to investigate the cause.Jul 29, 20:33 UTC
Investigating - We're experiencing an issue with loading our website, and are currently looking...