#codefresh - June 2019 | Slack Archive

69 messages

Archive: https://archive.sweetops.com/codefresh/

May 2019

June 2019

Jul 2019

rssover 6 years ago

Codefresh availability
Jun 2, 19:05 UTC
Investigating - We are currently having an availability issue, from initial investigation this is happening due to Google Cloud Platform cross region issue. We are working to resolve the issue

rssover 6 years ago

Codefresh availability
Jun 2, 19:23 UTC
Monitoring - Issue have been resolved and system is fully operational, we're still monitoring the status
Jun 2, 19:05 UTC
Investigating - We are currently having an availability issue, from initial investigation this is happening due to Google Cloud Platform cross region issue. We are working to resolve the issue

rssover 6 years ago

Codefresh availability
Jun 2, 20:32 UTC
Update - We are still having issues due to a cross region incident over at GCP:
https://status.cloud.google.com/
Jun 2, 19:23 UTC
Monitoring - Issue have been resolved and system is fully operational, we're still monitoring the status
Jun 2, 19:05 UTC
Investigating - We are currently having an availability issue, from initial investigation this is happening due to Google Cloud Platform cross region issue. We are working to resolve the issue

rssover 6 years ago

Codefresh availability
Jun 3, 00:45 UTC
Resolved - GCP has updated its Status Page and has confirmed that the incident is resolved.
We validated that Codefresh is working as expected now.
The incident is resolved.

More information about GCP's incident here: https://status.cloud.google.com/incident/compute/19003
Jun 2, 20:32 UTC
Update - We are still having issues due to a cross region incident over at GCP:
https://status.cloud.google.com/
Jun 2, 19:23 UTC
Monitoring - Issue have been resolved and system is...

peteover 6 years ago

Hey ya'll. Running into a weird issue. I'm trying to run the following step in a freestyle project:

steps:
  install_deps:
    title: Install deps
    image: 'python:3'
    working_directory: ${{main_clone}}
    commands:
      - python3 -m venv venv
      - . venv/bin/activate
      - pip install -r requirements.txt
      - ./scripts/test.sh

And it falls on its face. It seems to be getting confused about the order in which the commands are supposed to be run? This runs perfectly fine on CircleCI.

How does CodeFresh run commands, does it use the shell of the image I specify, or something else?

Erik Osterman (Cloud Posse)over 6 years ago

Based on what you've shared, there's no main_clone step defined. I know that it used to be implicit, but I think that codefresh has been moving towards making that explicit.

Erik Osterman (Cloud Posse)over 6 years ago

Also, it helps if you share the literal error, otherwise we don't know what's broken.

Erik Osterman (Cloud Posse)over 6 years ago

https://github.com/cloudposse/example-app/blob/master/codefresh/build.yaml

Erik Osterman (Cloud Posse)over 6 years ago

Here's an example of the main_clone step

peteover 6 years ago

Sure thing, this is the error:

Traceback (most recent call last):                                                                                                       
  File "<string>", line 1, in <module>                                                                                                   
AttributeError: module 'nltk' has no attribute '__version__'                                                                             
Traceback (most recent call last):                                                                                                       
  File "<string>", line 1, in <module>                                                                                                   
AttributeError: module 'nltk' has no attribute 'download'                                                                                
Reading environment variable exporting file contents.                                                                                    
[SYSTEM]                                                                                                                                 
 Message             Failed to run freestyle step: Install deps                                                                          
 Caused by           Container for step title: Install deps, step type: freestyle, operation: Freestyle step failed                      
                     with exit code: 1                                                                                                   
 Documentation Link  <https://codefresh.io/docs/docs/codefresh-yaml/steps/freestyle/>                                                      
 Action Items        Fix command : ./scripts/test.sh                                                                            
 Exit code           1                                                                                                                   
 Name                NonZeroExitCodeError

Erik Osterman (Cloud Posse)over 6 years ago

Can you share your corresponding circle config?

peteover 6 years ago

Managed to get around it by moving the steps inside a Dockerfile instead of the codefresh.yml.

peteover 6 years ago

Still new to this platform so will post any other issues I encounter on here.

Erik Osterman (Cloud Posse)over 6 years ago

Public #office-hours starting now! Join us on Zoom if you have any questions. https://zoom.us/j/684901853

btaiover 6 years ago

is there a way to exec into the codefresh container in your pipeline?

btaiover 6 years ago(edited)

im trying to get the python kube client to run on the container and codfresh might be setting the kube-context up a little different. i wanted to avoid passing in the kube api token if possible

Erik Osterman (Cloud Posse)over 6 years ago

I have used tmate for this

jafowover 6 years ago

👋 hello I have question about running pipelines locally via codefresh CLI

rssover 6 years ago

Docker Hub Incident:
Jun 19, 15:23 UTC
Investigating - Docker Hub has reported an incident:
Components: Docker Hub Registry, Docker Hub Web
More info here: https://status.docker.com/pages/incident/533c6539221ae15e3f000031/5d0a4fd6b684ad142660aa9d

Erik Osterman (Cloud Posse)over 6 years ago

Codefresh Case Study with Cloud Posse

Erik Osterman (Cloud Posse)over 6 years ago

https://youtu.be/cbGGw7pyztg

Erik Osterman (Cloud Posse)over 6 years ago

#office-hours starting now! https://zoom.us/j/684901853

Have a demo of using Codefresh for ETL

Erik Osterman (Cloud Posse)over 6 years ago

These are the ETL jobs: https://github.com/singer-io

rssover 6 years ago

Docker Hub Incident:
Jun 19, 18:30 UTC
Identified - The issue has been identified and a fix is being implemented.Jun 19, 15:23 UTC
Investigating - Docker Hub has reported an incident:
Components: Docker Hub Registry, Docker Hub Web
More info here: https://status.docker.com/pages/incident/533c6539221ae15e3f000031/5d0a4fd6b684ad142660aa9d

Erik Osterman (Cloud Posse)over 6 years ago

How we run ETL jobs on codefresh: https://youtu.be/dSJzEOo37MA

Erik Osterman (Cloud Posse)over 6 years ago

How to bring up environments when GitHub labels are added or removed:

Erik Osterman (Cloud Posse)over 6 years ago

https://youtu.be/JltFH1OjUwQ

rssover 6 years ago

Docker Hub Incident:
Jun 19, 21:07 UTC
Resolved - Docker has reported the incident has been solved.Jun 19, 18:30 UTC
Identified - The issue has been identified and a fix is being implemented.Jun 19, 15:23 UTC
Investigating - Docker Hub has reported an incident:
Components: Docker Hub Registry, Docker Hub Web
More info here: https://status.docker.com/pages/incident/533c6539221ae15e3f000031/5d0a4fd6b684ad142660aa9d

peteover 6 years ago

Can you use integration secrets in a pipeline? Can't find anything in the docs. Might be completely off-base here, but I'm looking for a way to easily query ECR within a step.

Erik Osterman (Cloud Posse)over 6 years ago

sorry, so many terms and they can be overloaded

Erik Osterman (Cloud Posse)over 6 years ago

by integration secrets, do you mean what codefresh calls in their UI "Shared Configurations" (under "Account Settings")

Erik Osterman (Cloud Posse)over 6 years ago

These can have secrets

Erik Osterman (Cloud Posse)over 6 years ago

then you can "import configuration" to a pipeline.

Erik Osterman (Cloud Posse)over 6 years ago

(though "import" is a semi-misnomer. they are not copied, but linked to)

peteover 6 years ago(edited)

@Erik Osterman (Cloud Posse) Thanks for replying. Sorry about the lack of context. No, I meant to refer to the secrets that are part of the integrations, in the Integrations section. When you add an ECR registry, you add your AWS credentials. Was wondering if there was a way to access/use said creds in a pipeline.

Erik Osterman (Cloud Posse)over 6 years ago

Ahhhhaaa

Erik Osterman (Cloud Posse)over 6 years ago

Now I see what you mean. Yes, that would be nice.

Erik Osterman (Cloud Posse)over 6 years ago

sec

Erik Osterman (Cloud Posse)over 6 years ago

you can try something like this:

peteover 6 years ago

Figured it wasn't possible haha. Should be an enhancement though. If codefresh were to add secrets management that would be beyond great.

Erik Osterman (Cloud Posse)over 6 years ago


codefresh get context github --decrypt -o yaml | yq -y .spec.data.auth.password

Erik Osterman (Cloud Posse)over 6 years ago

See https://codefresh.io/docs/docs/codefresh-yaml/steps/git-clone/#reuse-a-git-token-from-codefresh-integrations

Erik Osterman (Cloud Posse)over 6 years ago

Now this example is for the github integration

Erik Osterman (Cloud Posse)over 6 years ago

I've never tried it for the docker registry integrations

Erik Osterman (Cloud Posse)over 6 years ago

Lmk if you still want/need any pointers

Brandon Wilsonover 6 years ago(edited)

but I realised that `master` != `prod

That statement may have just changed my mind on how I usually name my master aws accounts. Maybe root is the better name for it.

Erik Osterman (Cloud Posse)over 6 years ago

It's a little bit of a mindwarp the first time!

btaiover 6 years ago

do you guys have multiple pipelines for deploying to dev, qa, prod for a specific service. or one single long running pipeline?

Erik Osterman (Cloud Posse)over 6 years ago(edited)

So what works for us is to reuse the same deploy.yml (manifest) but define the pipeline multiple times for each environment or cluster

Erik Osterman (Cloud Posse)over 6 years ago(edited)

e.g. deploy-testing would have environment variables setup for deploying perhaps to the staging cluster in the testing namespace.

Erik Osterman (Cloud Posse)over 6 years ago

then all of those pipelines can be triggered at once by calling the codefresh cli from inside of a deploy pipeline

Erik Osterman (Cloud Posse)over 6 years ago

and those can be concurrent or serial

btaiover 6 years ago

sweet

btaiover 6 years ago

thats exactly what i was going to do

btaiover 6 years ago

less so

btaiover 6 years ago

the triggering them all at once part. it was going to be more serial for us

btaiover 6 years ago

merge into develop -> deploy dev
merge into master -> deploy qa
create git release off mater -> deploy prod

Erik Osterman (Cloud Posse)over 6 years ago

yea, makes sense

Erik Osterman (Cloud Posse)over 6 years ago

in fact, you can create one pipeline now that calls each one of those pipelines serially with an approval step in between

Erik Osterman (Cloud Posse)over 6 years ago

on an unrelated note, new codefresh pricing is online

Erik Osterman (Cloud Posse)over 6 years ago

https://codefresh.io/pricing/

btaiover 6 years ago

i saw

Erik Osterman (Cloud Posse)over 6 years ago

it was updated a couple weeks ago

btaiover 6 years ago

they reached out a week or two ago

btaiover 6 years ago

its nice

erikover 6 years ago

Erik Osterman (Cloud Posse)over 6 years ago

much more palatable pricing

btaiover 6 years ago

oh yeah

Erik Osterman (Cloud Posse)over 6 years ago

https://www.youtube.com/watch?v=hb7RarfvWaM

May 2019 Browse by date July 2019