Add staging repositories from stagingyum.theforeman.org that come fro…

[ehelms]

…m Copr

[ekohl]

I don't know how we're going to switch. Are we going to build staging repos for all supported versions or say < x.y on koji, >= x.y on stagingyum? For the latter we should also clean up the old yum_repository resources.

[ehelms]

There are a couple options on how we can proceed for switching. Functionally, my intent is to switch nightly+ first and foremost. Unless there is a compelling reason to rebuild older releases, I do not intend to touch them (the most compelling reason I think would be to shut down Koji).

Mechanically here has been my thinking:

Option 1: Complete parallel pipelines

With this option I spin up completely new parallel pipelines for Koji vs Copr and allow them to run independently of one another. This allows us to switch from one to the other fluidly, but comes at the cost of overhead of managing and running two sets of everything. There is a challenge here as well -- only one can be the source of truth that promotes staging to production. That part cannot be done in parallel unless we were to introduce dnf.theforeman.org for Copr+ things.

Option 2: Nightly switchover

With this option we get everything in place and then we make a small adjustment to the Forklift code so that all of our existing nightly pipelines point at stagingyum. This requires no duplication of pipelines and code and takes our current mechanisms and just flips to pulling from Copr rather than Koji.

[evgeni]

I don't see a big benefit in doing parallel jobs (option 1), and this PR effectively does option 2 already (minus setting the var correctly depending on version).

The only missing piece is the "promote to yum.tfm.o" source selection, but you have that covered in theforeman/foreman-infra#1875?

[ehelms]

@evgeni I ran this through some local testing, ready now for review.

I could not find a non-invasive way to swap to these repositories for tests the way our CI jobs work on a conditional basis as I have laid it out here -- https://github.com/theforeman/jenkins-jobs/pull/349/files

[evgeni]

generally ACK, comments present :)

[evgeni]

will the candlepin repo keep the katello versioning, or should this be candlepin_repositories_version, maybe even in an own role? (no need to solve now, nightly is nightly, but keep in mind)

[ehelms]

Should go to it's own role once I finish sorting that (e.g. #1712)

[Odilhao]

The pulpcore part is ok for me.