Get Involved
Getting Started
Follow these seven steps to become part of the MLCommons® community and get access to meetings, documents, and code.
-
Please use your organizational (e.g., corporate or academic) email account to join all mailing lists. If you do not have an organizational email address, please contact participation@mlcommons.org.
-
Associate a GSuite account with your email address so you can access meetings and documents. You can skip this step if your email address is provided by GSuite.
-
Join the public@mlcommons.org mailing list. Click the mailing list, then the "Ask to Join" button. Note that personal email addresses are allowed on this mailing list. Joining this group will give you access to the portions of the Google drive that are available to the public and working groups with no access requirements (be sure to check that Google drive is on your allow list for corporate accounts).
-
Consider becoming a Member or Affiliate of MLCommons. Some lists and working groups require you to join as a Member or register as an Affiliate. Your organization might already be a Member; check the logos on the MLCommons homepage. Membership is free for academics. To join as a Member or register as an Affiliate, contact participation@mlcommons.org.
-
If you or your organization are a Member or Affiliate, join the community@mlcommons.org mailing list. Joining this group will give you access to the portions of the Google drive that are available to all Affiliates and Members (be sure to check that Google drive is on your allow list for corporate accounts).
-
Join working groups you are interested in below. Requests are manually reviewed, so please be patient.
- If you want to contribute code, you or your org must sign the CLA which is located on the MLCommons Policies page. Contact support@mlcommons.org for more information.
Join our Discord server
MLCommons uses Discord for group collaboration and communication. The invite code for our Discord server is https://discord.gg/emD2ge5EjG and the server name is “MLCommons”.
Once you have joined the server, you will need to accept the server rules, which include the MLCommons Code of Conduct.
The Discord server is organized into many different channels, and each Working Group has a channel. Access to channels is controlled via Roles. Some channels have no requirements and are open to anyone (e.g., #general-chat). Some channels do have specific requirements (e.g., #training-chat and Training VC requires that you be a Member or Affiliate). When you are assigned a Role (e.g., Member) it will enable you to access channels associated with that Role.
Roles are assigned by an administrator and common Roles include Member and Affiliate (for people who are Members or Affiliates of MLCommons). The Member and Affiliate Roles will give access to the vast majority of channels. Typically, you will also be assigned a Role corresponding to your employer, so that everyone can see who you are representing.
Public Calendar
This calendar includes all of the public MLCommons meetings and events.
Attend Events
MLCommons organizes community meetings every quarter, typically in the San Francisco Bay Area. As a global organization, we also host annual community events in the Asia-Pacific (APAC) and Europe-Middle East-Africa (EMEA) regions to reach everyone regardless of geography. The meetings are open to anyone (by joining as a MLCommons Member, registering as an Affiliates, or signing up for the public mailing list). The dates and locations are shown below. More specific information is available on the public MLCommons mailing list.
| Community Meeting Date | Location | Slides |
|---|---|---|
| Thursday, February 14, 2019 | Xilinx, San Jose | slides |
| Thursday, April 4, 2019 | Synopsys, San Jose | slides |
| Thursday, June 6, 2019 | AMD, Santa Clara | slides |
| Thursday, August 8, 2019 | Cadence, San Jose | slides |
| Thursday, October 10, 2019 | Samsung, San Jose | slides |
| Thursday, December 12, 2019 | Facebook, Menlo Park | slides |
| Thursday, March 12, 2020 | Virtual | slides |
| Thursday, May 28, 2020 | Virtual | slides |
| Thursday, December 17, 2020 | Virtual | slides |
| Thursday, April 22, 2021 | Virtual | slides |
| Thursday, July 15, 2021 | Virtual | slides |
| Thursday, September 30, 2021 | Virtual | slides |
| Thursday, December 9, 2021 | Virtual | slides |
| Thursday, April 21, 2022 | Virtual | slides |
| Thursday, July 14, 2022 | Hybrid | slides |
| Thursday, September 22, 2022 | Hybrid | slides |
| Thursday, December 8, 2022 | Hybrid | slides |
During the COVID-19 pandemic, our community meetings have been converted to virtual events.
Become a Member
MLCommons is a community-driven and community-funded effort and we are proud to include a variety of Members and Affiliates from across the globe. As an open engineering consortium, Member or Affiliate status is available on a non-discriminatory basis to all organizations, corporations, academic researchers, nonprofits, government organizations, and individuals.
Membership offers several benefits
- Access to and influence on all working groups, including MLPerf™ Training and Inference, Datasets, and Best Practices
- MLPerf Training, Inference, and Mobile require Membership to submit results
- Representatives of voting Members are eligible to run for and vote in elections for the board of directors
- MLCommons Members get a voice in the direction of the organization
- All paid MLCommons Members are listed on the website
If you are interested in Membership, please contact participation@mlcommons.org.
BIS-listed entities can join MLCommons as Members and enjoy nearly all of the benefits, but cannot participate in closed activities.
Closed activities are activities and information reserved solely for members and staff, including the following:
- Non-public benchmark review process
- Inference Mobile working group
- Datasets working group
- Serving as a working group chair or on the board of directors
Become an Affiliate
Affiliates have access to all working groups and associated GitHub repositories, mailing lists, meetings, events, documents, and files, excluding closed activities (as defined below). If you or your organization is interested in becoming an Affiliate, please contact participation@mlcommons.org.
BIS-listed entities can join MLCommons as Affiliates and enjoy nearly all of the benefits, but cannot participate in closed activities.
Submit MLPerf Results
If you are interested in submitting MLPerf benchmark results, please join the appropriate working group. Typically, the registration deadline is several weeks in advance of submission to ensure that all submitters are aware of benchmark requirements and to provision the necessary resources.
Submitting MLPerf benchmarks requires:
- A signed CLA to enable contributing code, logs, etc. to MLCommons repos
- Membership in MLCommons OR a signed Non-member Test Agreement
- A signed trademark license agreement (either the member OR non-member version, as appropriate)
Membership is required for most benchmark working groups (e.g., Training, Inference, Mobile). Some benchmark working groups are public and have no access requirements (see the list above for examples) and non-members may submit to the benchmark by first signing a Non-member Test Agreement (found at Policies). Both the member and non-member trademark agreements are available upon request to support@mlcommons.org.
Use MLPerf Results
MLPerf is a trademark of MLCommons. The use of the MLPerf results and trademark are described in our Policies.
Sign or Get Authorized on the CLA
Generally we encourage people to become Members if they wish to contribute to MLCommons projects. However, if you are interested in contributing to one of our open source projects and do not think your organization would be a good fit as a Member, please fill out this CLA sign up form.
If your organization is already a Member of MLCommons, you can also use the CLA sign up form to request authorization to commit code in accordance with the CLA.
Contact
We are a pretty friendly organization and easy to contact.
For any Membership or Affiliate questions, please contact participation@mlcommons.org.
For technical issues around MLCommons projects, please file GitHub issues.
For technical assistance with MLCommons infrastructure such as Google Groups, please contact support@mlcommons.org.