Skip to content

Retry GitHub stats queries #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 52 commits into
base: main
Choose a base branch
from
Draft

Conversation

mashehu
Copy link
Contributor

@mashehu mashehu commented Jun 23, 2025

No description provided.

Copy link

netlify bot commented Jun 23, 2025

Deploy Preview for nf-core-stats failed. Why did it fail? →

Name Link
🔨 Latest commit 1cf82a0
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-stats/deploys/6864031af398030008053068

@edmundmiller
Copy link
Collaborator

@mashehu is this ready for review?

@mashehu mashehu added the WIP Work in progress label Jun 24, 2025
mashehu and others added 18 commits June 24, 2025 18:03
… documentation

- Introduced a new SQL query to track pipeline development periods in `pipeline_timeline.sql`.
- Added a new timeline page in `timeline.md` to visualize pipeline development cycles.
- Updated `index.md` to link to the new timeline documentation.
- Marked an extraneous dependency in `package-lock.json`.
- Created a new configuration file for MCP servers in `mcp.json`.
- Changed SQL queries to create a stacked bar chart for pipeline lifecycle, showing development and released time.
- Updated the data structure for the timeline visualization to reflect the new lifecycle data.
- Added a new SQL query for a comprehensive lifecycle summary of each pipeline.
- Enhanced the development vs released time analysis with additional statistics.
…e visualization

- Updated section titles and descriptions for clarity on pipeline lifecycle.
- Simplified SQL queries for lifecycle summary and adjusted data structure for better visualization.
- Enhanced DataTable to include detailed columns for development and release durations with appropriate bar colors.
- Adjusted SQL queries to improve the calculation of development and release durations.
- Modified the timeline documentation to reflect changes in the SQL structure and data retrieval.
- Changed the date filtering in the SQL query to start from 2017 for a broader data range.
…ocus on first release dates

- Revised documentation to clarify that the timeline now tracks time to **first release** instead of last release.
- Adjusted SQL queries to calculate development durations based on **first release** dates.
- Enhanced insights section to reflect the importance of first release analysis in understanding pipeline development.
…guration

- Removed redundant section header for Pipeline Lifecycle Summary.
- Added title to DataTable for clarity.
- Adjusted DataTable to display 20 rows for improved data visibility.
… scheme

- Updated color descriptions for timeline bar charts to improve clarity.
- Adjusted bar colors in DataTable to align with nf-core branding for better visualization of development and release durations.
…tion

- Added grouping by year in SQL query to improve data organization.
- Updated DataTable title for clarity and adjusted grouping settings for better visualization.
- Enhanced column titles with icons for improved user experience.
- Updated date formatting in DataTable for consistency and clarity.
- Enhanced SQL query to include median, min, and max development days for released pipelines.
- Added new sections for development time trends and comparative analysis to provide deeper insights into pipeline performance.
- Added date formatting for x-axis in DataTable to ensure consistency across visualizations.
- Enhanced column definition for 'Year' to include formatting for improved clarity.
- Modified SQL query to cast start_year as an integer and added a new column for truncated year date.
- Enhanced clarity in data representation for better trend analysis.
…se timing

- Revised terminology in the documentation to specify "days until first release" instead of "average development times."
- Updated DataTable column titles to reflect the new focus on release timing, enhancing clarity in data representation.
@edmundmiller edmundmiller marked this pull request as draft June 26, 2025 17:59
@mashehu
Copy link
Contributor Author

mashehu commented Jul 1, 2025

okay, looks like we are now making too many api calls for one token...

@edmundmiller
Copy link
Collaborator

okay, looks like we are now making too many api calls for one token...

https://dlthub.com/docs/general-usage/http/requests#retry-rules
dlt should handle these gracefully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
WIP Work in progress
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants