Skip to content

Conversation

hsinfang
Copy link
Collaborator

No description provided.

Copy link
Member

@kfindeisen kfindeisen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure I understand the Kafdrop instructions; can you clarify?

In the future, please put changes about different topics on separate commits.

doc/playbook.rst Outdated
.. code-block:: sh
kubectl port-forward svc/kafdrop -n kafka 9000:9000
Then messages can be viewed locally via Kafdrop at `http://127.0.0.1:9000/topic/rubin-prompt-processing`_.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does "locally" mean? Do you run these on USDF?

Is this better than using https://usdf-rsp.slac.stanford.edu/kafdrop/topic/lsst.sal.ScriptQueue.logevent_nextVisit?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This would be one way to check the file arrival notifications from the bucket, not the nextVisit messages. If I understand correctly, they are on separate kafkas (nextVisit from sasquatch's and prompt processing has its own).

I got the tip from this slack thread when we were debugging some ceph setup. I swear it was working at one point, probably from my laptop.

However, it seems no longer working probably because we didn't move the service to phalanx when we transitioned. I'll check with Dan. I'll leave out this part as it isn't really relevant to this ticket anyway.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My mistake with mixing up the two Kafkas. Unfortunately, the instructions on the Slack thread also don't make it clear which system you're supposed to do what on...

@hsinfang
Copy link
Collaborator Author

Funny thing is I originally had each topic on separate commits and squashed them thinking it was too many. They are now separate again.

@hsinfang hsinfang force-pushed the tickets/DM-41591 branch 2 times, most recently from 8cebbbf to f20c6be Compare December 13, 2023 21:50
@hsinfang hsinfang merged commit e299c31 into main Dec 13, 2023
@hsinfang hsinfang deleted the tickets/DM-41591 branch December 13, 2023 23:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants