You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Someties orleans-grains(microsoft_orleans_orleans_grains) metric repot negative values in our environment.
I was not able to find anything in common for those types of grains i've seen, so presumably it can happen with any grain type (I've seen both ordinary and stateless workers)
We are using Orleans 8.0.0 with multiple silos, but it doesn't matter. The same happens on single silo from time to time.
Here is a screen from our prod env for last 6 hours (some graphs represent same GrainType but on different silos):
And this screen was reported in Discord:
And it can happen on system grains (this is single silo run):
The text was updated successfully, but these errors were encountered:
Someties
orleans-grains(microsoft_orleans_orleans_grains)
metric repot negative values in our environment.I was not able to find anything in common for those types of grains i've seen, so presumably it can happen with any grain type (I've seen both ordinary and stateless workers)
We are using Orleans 8.0.0 with multiple silos, but it doesn't matter. The same happens on single silo from time to time.
Here is a screen from our prod env for last 6 hours (some graphs represent same GrainType but on different silos):
![image](https://private-user-images.githubusercontent.com/6619090/313815318-ca856434-b4ad-42e1-b3c1-bf827f399269.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE2OTM5NzQsIm5iZiI6MTcyMTY5MzY3NCwicGF0aCI6Ii82NjE5MDkwLzMxMzgxNTMxOC1jYTg1NjQzNC1iNGFkLTQyZTEtYjNjMS1iZjgyN2YzOTkyNjkucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MjNUMDAxNDM0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjgxZDI0YWU2YjFkZjZiNWJhZTg4YjhiY2M3MjY1YmU0MmVmODEwM2Y5NzY4ZDkxMTBmYzU1ODMzZDY4N2IwMSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.dSHFlJtI86ZZ1SiDJNL00NQHiX1Qsxlqa264iHYWtFw)
And this screen was reported in Discord:
![image](https://private-user-images.githubusercontent.com/6619090/313814207-1570757d-c8dc-45f3-a389-caef73df0d26.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE2OTM5NzQsIm5iZiI6MTcyMTY5MzY3NCwicGF0aCI6Ii82NjE5MDkwLzMxMzgxNDIwNy0xNTcwNzU3ZC1jOGRjLTQ1ZjMtYTM4OS1jYWVmNzNkZjBkMjYucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MjNUMDAxNDM0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjlhMTgxNGE2NTUxNWZkMmI4MGQwZjc2YzQ4NDY5MTk1ZGU4ZjE4NjcyODJkOTMyZTEzOTUxNDM1Yjg2YTY2OCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.zN49g-dDa-AznhX36ZCObTv5AQz8CsvAq-FJ1Y2EDiE)
And it can happen on system grains (this is single silo run):
![image](https://private-user-images.githubusercontent.com/6619090/313819326-2658cc41-2424-44e5-8995-e71a1b79ce53.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE2OTM5NzQsIm5iZiI6MTcyMTY5MzY3NCwicGF0aCI6Ii82NjE5MDkwLzMxMzgxOTMyNi0yNjU4Y2M0MS0yNDI0LTQ0ZTUtODk5NS1lNzFhMWI3OWNlNTMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MjNUMDAxNDM0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OGI4YmI2Y2E2ZjNlZmNiOTlhOTQ2MzNhODA3MmFhNzRjY2FiYTEyZTVmOTFkN2VjNGE5Yzc5NWIzMjc4ZGNmMyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.ta3TJ-RmLxo4_eI9XzzWp1vxE_sXcLcc6Sw3dWwfipg)
The text was updated successfully, but these errors were encountered: