Add KinD test verifying the source deploys and becomes ready

[Cali0707]

Overview

We recently found that even though build and unit tests had been passing, the receive adapter panicked when it started when you actually deployed the gitlab source. To address this, we should add a KinD test job that will:

1. Install eventing and the gitlab source
2. Create a gitlab source
3. Verify that the source becomes ready

More info

These resources will likely be helpful while working on this:

• https://github.com/knative/eventing/blob/main/.github/workflows/kind-e2e.yaml
• https://github.com/knative-extensions/reconciler-test
• https://github.com/knative/eventing/tree/main/test/rekt

[Cali0707]

/help

[knative-prow]

@Cali0707:
This request has been marked as needing help from a contributor.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

Details

In response to this:

/help

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[github-actions]

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.

[Cali0707]

/remove-lifecycle stale
/triage accepted

[harsh098]

Hi @Cali0707
I am trying to take a knack on this issue. I am trying to implement this small test on my own repo.
I went through

• Knative End to End Testing Framework

Is there a design document on how the eventing extensions are structured in general ?
That would really speed up the process.
I am having a little friction in understanding the moving parts of the repo. My only source of understanding things as of now is going through the knative.dev/pkg docs.
Looking forward.

[Cali0707]

cc @pierDipi @creydr

[harsh098]

For the test should I deploy gitlab on the cluster on the test KiND cluster as the example shown in https://github.com/knative/eventing/blob/main/.github/workflows/kind-e2e.yaml or use an external repo ?

[creydr]

Hey @harsh098,
thanks for checking on this. Yes, you need to deploy the needed knative-gitlab artifacts on top of an eventing installation. Therefor I see the following to do:

1. Add the eventing nightly builds into this repo (e.g. into a third_party folder). In the eventing-kafka-broker repo we do the same. Therefor you need to update the update-nightlies job, which will take the nightlies and push them into this repo. Check for example, how this is done for eventing-kafka-broker here
2. Add an e2e test which installs a Gitlab source and checks if it becomes ready (this can be verified locally already). Check out for example some e2e tests in the eventing repo, which installs a pingsourcesource and checks if it becomes ready: https://github.com/knative/eventing/blob/36e0721b385204978e4eeb9e2321613090a82346/test/rekt/features/pingsource/readyness.go#L28.
3. Create a new Github workflow for the end to end tests which installs KinD, deploys the eventing-core artifacts (from the third_party directory), then checks out the eventing-gitlab sources and installs it into the cluster and finally runs the e2e tests. You can check for example

I hope this helps to get started, otherwise let us know

[harsh098]

Thanks a lot progressing in this direction now.

[harsh098]

/assign