Skip to content
master
Switch branches/tags
Code

Latest commit

* Adding a new company: Linagora (#74)

Hi, 
I am a community manager at Linagora which is a French open-source software company. I noticed that it was missing from the list of companies. 
Request to merge this PR.

* Add PingCAP (#75)

* Add LINE Corporation (#76)

* added Sony to the company domain match list (#78)

Co-authored-by: Shivam Chauhan <shivamchauhan80@gmail.com>
Co-authored-by: jinqueeny <jinqueeny@gmail.com>
Co-authored-by: Seo-yeon Lee <sylee9223@gmail.com>
Co-authored-by: Hiro Fukuchi <hfukuchih@gmail.com>
2e4e01c

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
cli
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

OSCI Logo

OSCI, the Open Source Contributor Index

What is OSCI?

  • OSCI ranks corporate contributions to open source based on the organization’s number of Active Contributors to GitHub
  • OSCI also tracks the Total Community of open source contributors for these companies
  • The OSCI rankings are published monthly to dynamically track corporate contributions to GitHub. The latest result can be found at EPAM SolutionsHub website's OSCI page

News update

April 5th 2021

The OSCI ranking has now been updated with the data for March 2021.

The latest ranking can be viewed on the OSCI page. Alternatively the updated ranking can be downloaded (Excel format) from our Archive folder: 2021.03 OSCI Ranking.xlsx.

This month Microsoft has reached the top spot in the ranking. Huawei, Tencent and Alibaba climbed in to the Top 20 following a strong upwards trend in activity from the start of the year.

Take a look at our latest article: Programming Language Popularity on GitHub.

News update

March 3rd 2021

The OSCI ranking has now been updated with the data for February 2021.

The latest ranking can be viewed on the OSCI page. Alternatively the updated ranking can be downloaded (Excel format) from our Archive folder: 2021.02 OSCI Ranking.xlsx.

A significant observation this month is the overall increase in the level of engagement compared to February 2020; suggesting a long-term upward trend in the growth of corporate Open Source activity.

Take a look at our latest article: Programming Language Popularity on GitHub.

Previous updates

News update

February 10th 2021

The OSCI ranking has now been updated with the data for January 2021.

The latest ranking can be viewed on the EPAM SolutionsHub OSCI page. Alternatively the updated ranking can be downloaded (Excel format) from our Archive folder: 2021.01 OSCI Ranking.xlsx.

We’ve started the new year with an improved algorithm that considers Open Source licenses as a factor of measuring contributions. We’re looking forward to seeing which organisations continue their commitment to Open Source this year and which new comers climb the rankings.

Take a look at our latest article: Programming Language Popularity on GitHub.

Previous updates

How does OSCI work?

  • OSCI analyses push event data from GH Archive
  • The Author Email address field in the commit event data is used to identify the organization to which the commit author belongs
  • OSCI measures the Active Community (10+ commits) and the Total Community (1+ commit) at each organization
  • Analysis is done for the current year-to-date
  • OSCI’s algorithm is transparently published as an open source project on GitHub

GitHub OSCI Schematic Diagram

How did we decide on the ranking logic?

We realize that there are many approaches which could be used to develop this ranking. We experimented extensively with these before arriving at the logic now used.

We concluded the Author's Email Domain in the Push Event data is the most reliable way to identify the organization to which a commit author belongs. It is a single unambiguous identifier. It is true that many people on GitHub do not use the email address of their employer or keep it private, but it is still a more reliable single measure compared with alternatives. The org of the repo is not a good measure of the employer of an individual because the employees of most companies maintain projects in multiple GitHub orgs.

We concluded that 10+ commits in a year - while arbitrary - is a reasonable measure of whether a person is an active contributor to GitHub. It is interesting to compare this with the size of the broader community at an organization - this is why we also record the number of people with just 1 or more commits in the time period.

We decided to base the ranking on the number of people making commits, rather than the number of commits. The GitHub push event data includes large numbers of pushes made by automated processes using an email domain from an organization. Counting the number of pushes is not a good measure of the community at an organization, when the results are considerably skewed by these automated processes.

Our technical design assessed multiple source of data and we concluded that GHArchive is best suited for our needs, based on ease of access to the data, the amount of data it records, and the size of the data. GHTorrent is also very interesting for future use, since it contains a richer set of data, however the data sizes are considerably larger which drove our decision to go with GHArchive.

What does OSCI not do?

OSCI does not include educational and research institutions, contributions from free email providers, etc. The focus is on commercial organizations.

Prior work in this area

Our inspiration for OSCI is the work done earlier in the Open Source community, so we wish to give credit to these:

Where can I see the latest rankings

This project is created by EPAM Systems and the latest results are visible on the EPAM SolutionsHub OSCI page. The results will be updated and published each month.

How I can contribute to OSCI

If you would like to contribute to OSCI, please take a look at our guidelines here.

What if your think your organization is missing or you believe there is an error in our logic

This is a new project. We are more than happy to listen to any feedback which will help us improve. Contact us at OSCI@epam.com or modify the companies filter yourself.

How can I add a company which is missing from the OSCI ranking

The goal of the OSCI is to rank the GitHub contributions by companies (commercial organizations).

In order to add a company to the OSCI ranking, do the following:

  1. Check whether the organization you propose to add matches our definition of a company:
  • is not an educational, governmental, non-profit or research institution;
  • is not a free-mail, like gmail.com, yahoo.com, hotmail.com, etc;
  • is a registered, commercial company;
  • a simple "rule of thumb" - does the organization's website sell a product or service? If not, it is probably not a company by our definition.
  1. Create a new pull request.

  2. Go to company domain match list (company_domain_match_list.yaml)

  3. Confirm that the company you wish to add is not listed.

  4. Add the main domain of the company and the company name to the table. For example:

    - company: Facebook
      domains:
        - fb.com
      regex:
  5. If the company has more than 1 email domain for its employees, add all of them to block domains (or regex for using regular expression). For example:

    - company: Facebook
      domains:
        - fb.com
        - facebook.com
      regex:
        - ^.*\.fb\.com$
        - ^.*\.facebook\.com$

We will review your pull request and if it matches our requirements, we will merge it.

QuickStart

Technical Note

We built OSCI this an Azure cloud environment using Azure DataFactory, Azure Function and Azure HDInsight. The code published here on GitHub does not require the Azure cloud. You can reproduce everything in the corresponding instruction with the CLI (command line interface).

Installation

  1. Clone repository
         git clone https://github.com/epam/OSCI.git
  2. Go to project directory
         cd OSCI
  3. Install requirements
         pip install -r requirements.txt

Configuration

Create a file local.yml (by default this file added to .gitignore) in the directory __app__/config/files. A sample file default.yml is included, please don't change values in this file

Sample run

  1. Run script to download data from archive (for example for 01 January 2020)
         python3 osci.py get-github-daily-push-events -d 2020-01-01
  2. Run script to add company field (matched by domain) (for example for 01 January 2020)
         python3 osci.py process-github-daily-push-events -d 2020-01-01
  3. Run script to add company field (matched by domain) (for example for 01 January 2020)
         python3 osci.py daily-osci-rankings -td 2020-01-02

License

OSCI is licensed under the GNU General Public License v3.0.

About

Open Source Contributor Index

Resources

License

Releases

No releases published

Packages

No packages published