I swapped the paths in `for endpoint in` because there may not be a centos/9 repo. That means `$version` gets left unset and isn't available to `get-tarballs.sh` later in the script.
Signed-off-by: David Galloway <dgallowa@redhat.com>
Kefu Chai [Sat, 20 Aug 2022 00:17:45 +0000 (08:17 +0800)]
ceph-windows: remove installed packages
`ceph-windows/run_tests` installs client side dependencies using
`cephadm install ceph-common`, which leaves us with a bunch ceph
packages after the test finishes. and they inteferes with succeeding
tests which, for instance, try to import python modules from test's
building directory.
but they end up with importing the python modules installed in system.
in this change, the installed package and its ceph dependencies are
removed in the cleanup script. the list of packages is collected by
inspecting `/var/log/dpkg.log` on the system where the test failures
were spotted and `ceph/debian/control` 's "ceph-common" section.
David Galloway [Wed, 10 Aug 2022 18:41:35 +0000 (14:41 -0400)]
ceph-docs-rtd: Create job to keep releases docs up-to-date
See ceph/ceph#46917
This Jenkins job will receive webhooks from the github plugin. It will then check if the main branch is what was updated and if the `doc/releases` dir was updated.
If true, it will trigger a build for each active Ceph release's docs.
ceph/ceph#47442
ceph/ceph#47443
ceph/ceph#47444
Signed-off-by: David Galloway <dgallowa@redhat.com>
David Galloway [Wed, 10 Aug 2022 17:29:01 +0000 (13:29 -0400)]
ceph*build: Do not build containers on CentOS9 for now
ceph-container isn't ready yet. There is work being done in https://github.com/ceph/ceph-container/pull/2038 but our build scripts still need a lot of adjustments.
Signed-off-by: David Galloway <dgallowa@redhat.com>
David Galloway [Wed, 10 Aug 2022 17:19:02 +0000 (13:19 -0400)]
ceph-pr-api: Avoid artifact archive plugin hang
More often than not, docs-only PRs hang during this job for 45-50 minutes then crash like this:
```
+ '[' true = true ']'
+ echo 'Only the doc/ dir changed. No need to run make check or API tests.'
Only the doc/ dir changed. No need to run make check or API tests.
+ exit 0
[PostBuildScript] - [INFO] Executing post build scripts.
[PostBuildScript] - [INFO] Build does not have any of the results [ABORTED]. Did not execute build step #0.
Archiving artifacts
java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.Arrays.copyOf(Arrays.java:3689)
at java.base/java.util.Vector.grow(Vector.java:261)
at java.base/java.util.Vector.ensureCapacity(Vector.java:241)
at org.apache.tools.ant.util.VectorSet.doAdd(VectorSet.java:86)
at org.apache.tools.ant.util.VectorSet.addElement(VectorSet.java:98)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1245)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1194)
at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1156)
at org.apache.tools.ant.DirectoryScanner.checkIncludePatterns(DirectoryScanner.java:954)
at org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:912)
at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:528)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:3159)
Caused: java.io.IOException: Remote call on JNLP4-connect connection from 8.43.84.3/8.43.84.3:42699 failed
at hudson.remoting.Channel.call(Channel.java:1004)
at hudson.FilePath.act(FilePath.java:1194)
at hudson.FilePath.act(FilePath.java:1183)
at hudson.FilePath.validateAntFileMask(FilePath.java:3095)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:271)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:79)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:816)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:765)
at hudson.model.Build$BuildExecution.post2(Build.java:179)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:709)
at hudson.model.Run.execute(Run.java:1922)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
No artifacts found that match the file pattern "build/out/mgr.*.log". Configuration error?
```
Signed-off-by: David Galloway <dgallowa@redhat.com>
Kefu Chai [Mon, 8 Aug 2022 16:04:17 +0000 (00:04 +0800)]
dashboard-cephadm-e2e: bump node version to 14
as node.js 12 is being deprecated. and the oldest node.js which is
packaged by https://github.com/nodesource is node.js 14. see
https://github.com/nodesource/distributions#debinstall
Ionut Balutoiu [Mon, 8 Aug 2022 11:10:52 +0000 (14:10 +0300)]
Improve Windows libvirt VM IP detection
On some of the KVM hosts targeted by the Windows jobs, the main
interface within the VM will have a different NIC name.
Therefore, the command:
```
virsh domifaddr --source agent --interface Ethernet --full $VM_NAME
```
will not return anything, since the NIC name is not guaranteed to
have `Ethernet` name.
These changes improve how the VM IP is detected, by filtering the
guest NICs via MAC address to find the proper NIC. Furthermore, the
VM address belonging to the `default` virsh network is returned.
Nizamudeen A [Tue, 26 Jul 2022 05:31:46 +0000 (11:01 +0530)]
dashboard-cephadm-e2e: update runc version
cephadm dashboard e2e's were throwing this error in some machines (eg: braggi16)
```docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "error adding seccomp filter rule for syscall clone3: requested action matches default action of filter": unknown```
Upon further debugging it was related to the runc version where in the
error prone machines the runc version is 1.01 while as per some recent
threads docker needs runc version of 1.02.
https://github.com/containerd/containerd/issues/6203#issuecomment-1006713706
David Galloway [Wed, 20 Jul 2022 17:05:32 +0000 (13:05 -0400)]
ceph-dev: Keep 14 days' worth of builds
multijob projects only keep the lowest number of builds specified in build-discarder config. So we only had 25 builds. That only correlates to 3-5 days which isn't log enough to debug failed builds from a week ago, for example.
Signed-off-by: David Galloway <dgallowa@redhat.com>
build_utils: do not pass -DWITH_SEASTAR=ON for building crimson flavor
CEPH_EXTRA_RPMBUILD_ARGS="--with seastar" should suffice for building
rpm. while DEB_BUILD_PROFILES="pkg.ceph.crimson" should be enough for
building deb packages.
projects / ceph-build.git / log