DRAFT Only. DRAFT Only. DRAFT Only. DRAFT Only.
LLVM Developer Policy
Contents
- Introduction
- Terminology
- General Policies
- Stay Informed
- Starting New Work
- Code Reviews
- Incremental Development
- Quality
- Test Cases
- Patch Policies
- Patch Form
- Patch Testing
- Patch Submission
- After Submission
- Obtaining Commit Access
- New Committers
- Copyright and License
- Attribution
- Copyright
- License
- Developer Agreements
Written by LLVM Oversight Team
|
This document contains the LLVM Developer Policy which defines the
project's policy towards developers and their contributions. The intent of
this policy is to eliminate mis-communication, rework, and confusion that
might arise from the distributed nature of LLVM's development. By stating
the policy in clear terms, we hope each developer can know ahead of time
what to expect when making LLVM contributions.
So that the policies defined in the next sections are clear, we first
define some terms here.
- Change
- Any modification to LLVM including documentation, tests, build system,
etc. either in patch or
commit form.
- Commit
-
- A change submitted directly to LLVM software
repository via the cvs commit command.
- Developer
- Anyone who submits a change to LLVM.
- Increment
- A change or set of changes, whether by
patch or commit, that are
related by a single common purpose. Increments are atomic as they
leave LLVM in a stable state (both compiling and working properly).
- Must
- When used in a policy statement, the term must implies a
non-optional requirement on the developer.
- Patch
- A change submitted by email in patch (diff)
format generated by the cvs diff command.
- Should
- When used in a policy statement, the term should implies a
recommended but optional requirement on the developer.
|
This section contains policies that pertain generally to LLVM developers.
LLVM Developers are expected to meet the following obligations in order
for LLVM to maintain a high standard of quality.
Developers should stay informed by reading at least the
llvmdev email list. If you are doing
anything more than just casual work on LLVM, it is highly suggested that you
also subscribe to the llvm-commits list and pay attention to changes being
made by others.
We recommend that active developers register an email account with
LLVM Bugzilla and preferably subscribe to
the llvm-bugs
email list to keep track of bugs and enhancements occurring in LLVM.
When a developer begins a major new project with the aim of contributing
it back to LLVM, s/he should inform the community with an email to
the llvm-dev
email list, to the extent possible. The reason for this is to:
- keep the community informed about future changes to LLVM,
- avoid duplication of effort by having multiple parties working on the
same thing and not knowing about it, and
- ensure that any issues around the proposed work are discussed and
resolved before any significant work is accomplished.
The design of LLVM is carefully controlled to ensure that all the pieces
fit together well. If you plan to make a major change to the way LLVM works or
a major new extension, it is a good idea to get consensus with the development
community before you start working on it.
LLVM has a code review policy. Code review is an excellent way to ensure
high quality in the software. The following policies apply:
- All developers are required to have any significant changes reviewed
before they are committed to the repository.
- Code reviews are conducted by email.
- Code can be reviewed either before it is committed or after.
- The developer responsible for a code change is also responsible for
making all necessary review changes.
- Developers should participate in code reviews as both a reviewer and
a reviewee. We don't have a dedicated team of reviewers. If someone is
kind enough to review your code, you should return the favor for someone
else.
LLVM uses an incremental development style and all developers are expected
to follow this practice. Incremental development is a big key to LLVM's
success and it is essential that developers submit incremental patches. The
following defines the incremental development approach:
- The first task is to define the increment and get consensus (with the
LLVM development community) on what the end goal of the change is. Making
random small changes that go nowhere is not useful for anyone.
- An increment is the smallest patch size necessary to effect one change
in LLVM.
- Increments can be stand alone (e.g. to fix a bug), or part of a planned
series of increments towards some development goal.
- Increments should be kept as small as possible. This simplifies your
work (into a logical progression), simplifies code review and reduces the
chance that you will get negative feedback on the change. Small increments
also facilitate the maintenance of a high quality code base.
The minimum quality standards for any change to the main development
branch are:
- Code must adhere to the
LLVM Coding Standards.
- Code must compile cleanly (no errors, no warnings) on at least one
platform.
- Code must pass the deja gnu (llvm/test) test suite.
Additionally, the committer is responsible for addressing all of the
following items (preferably before submission):
- The code should compile cleanly on all platforms.
- The changes should not cause regressions in the llvm-test
suite including SPEC CINT2000, SPEC CFP2000, SPEC CINT2006, and
SPEC CFP2006.
- The change set should not cause performance or correctness regressions
for the LLVM tools.
- The changes should not cause performance or correctness regressions in
code compiled with LLVM on all applicable targets.
Developers are required to create test cases for regressions and new
features and include them with their changes. The following policies
apply:
- All feature and regression test cases must be added to the
llvm/test directory. The appropriate sub-directory should be
selected (see the Testing Guide for
details).
- Test cases should be written in LLVM assembly language unless the
feature or regression being tested requires another language (e.g. the
bug being fixed or feature being implemented is in the lvm-gcc C++
front-end).
- Test cases, especially for regressions, should be much as reduced as
possible, by bugpoint or
manually. It is unacceptable
to place an entire failing program into llvm/test as this creates
a time-to-test burden on all developers. Keep them short!
- More extensive test cases (applications, benchmarks, etc.) should be
added to the llvm-test test suite. This test suite is for
coverage not features or regressions.
This section contains policies that pertain to submitting patches
to LLVM and committing code to the repository
When submitting a patch, developers must follow these rules:
- Patches must be made against the CVS HEAD (main development trunk),
not a branch.
- Patches should be made with this command:
cvs diff -Ntdup -5
or with the utility utils/mkpatch.
- Patches should not include differences in generated code such as the
code generated by flex, bison or tblgen. The
utils/mkpatch utility takes care of this for you.
Before a patch is submitted for review, it should be tested to ensure
that:
- The patch must compile against the CVS HEAD cleanly (zero warnings, zero
errors).
- All the llvm/test (Deja Gnu) tests must pass.
- All the llvm-test tests must pass on at least one platform.
When a patch is ready to be submitted, these policies apply:
- Patches should be submitted immediately after they are generated. Stale
patches may not apply correctly if the underlying code changes between the
time the patch was created and the time it is applied.
- Patches should be submitted by e-mail to the
llvm-commits list.
After a patch has been submitted, these policies apply:
- The patch is subject to review by anyone on the llvm-commits email list.
- Changes recommended by a reviewer should be incorporated into your
patch or you should explain why the reviewer is incorrect. This process
iterates until there are no more review comments.
- If the submitter believes the review comment is in error, a response to
the
llvm-commits list should be made explaining why the recommendation
cannot be followed.
After a patch has been committed, these policies apply:
- The patch is subject to further review by anyone on the llvm-commits
email list.
- The patch submitter is responsible for all aspects of the patch per
the quality policy above.
- If the patch is discovered to not meet the
quality standards standards within a reasonable time
frame (24 hours), it may be subject to reversal.
Commit access to the repository is granted according to this policy:
- Commit access is not granted to anyone unless they specifically ask for
it.
- Requests for commit access must be sent to the
LLVM Oversight Group.
- Granting commit access is at the sole discretion of the LLVM Oversight
Group.
Submitting patches to LLVM via the patch policy above will greatly
increase the chance that your request for commit access is granted. Getting
to know the members of the LLVM community (email, IRC, in person contact,
etc.) will also increase your chances.
For those who have recently obtained commit access, the following policies
apply:
- You are granted commit-after-approval to all parts of LLVM.
To get approval, submit a patch to
llvm-commits
per the patch policies above. When approved you may commit it
yourself.
- You are allowed to commit patches without approval which you think are
obvious. This is clearly a subjective decision. We simply expect you to
use good judgement.
- You are granted commit-without-approval to those portions of LLVM
that you own (contributed) or maintain (have been assigned responsibility
for), with the proviso that such commits must not break the build. This is
a "trust but verify" policy and commits of this nature are reviewed after
they are committed.
- Commits that violate the quality standards may
be reverted. This is necessary when the change blocks other developers from
making progress. The developers is welcome to re-commit the change after
the problem has been fixed.
- Multiple violations of these policies or a single egregious violation
may cause commit access to be revoked.
We address here the issues of copyright and license for the LLVM project.
The object of the copyright and license is the LLVM source and documentation.
Currently, the University of Illinois is the LLVM copyright holder and the
terms of its license to LLVM users and developers is the
University of
Illinois/NCSA Open Source License.
NOTE: This section deals with legal matters but does not provide legal
advice. It is intended only as a general guideline.
The LLVM project believes in correct attribution of contributions to
their contributors, as follows:
- Developers who originate new files in LLVM should place their name at
the top of the file per the
Coding Standards.
- There should be only one name at the top of the file and it should be
the person who created the file.
- Placing your name in the file does not imply copyright but does
correctly attribute the file to its author.
- Developers should be aware that after some time has passed, the name at
the top of a file may become meaningless as maintenance/ownership of files
changes.
- Developers should submit or commit patches to the
CREDITS.txt
file to summarize their contributions.
- Commit comments should contain correct attribution of the person who s
submitted the patch if that person is not the committer (i.e. when a
developer with commit privileges commits a patch for someone else).
However, for consistency and ease of management, the project requires the
copyright for all LLVM software to be held by a single copyright holder.
Although UIUC may assign the copyright of the software to another entity,
the intent for the project is to always have a single entity hold the copy
rights to LLVM at any given time.
Having multiple copyright holders for various portions of LLVM is
problematic in the management of the software. Having a single copyright
holder is in the best interests of all developers and users as it greatly
reduces the managerial burden for any kind of administrative or technical
decisions about LLVM.
LLVM licensing decisions will be made by the LLVM Oversight Group. Any
issues, comments or suggestions with the licensing should be sent to the
LLVM Oversight Group.
The LLVM Oversight Group intends to keep LLVM perpetually open source
and to use liberal open source licenses. The current license is the
University of Illinois Open Source License (see LICENSE.TXT), which boils
down to this:
- You can freely distribute LLVM.
- You must retain the copyright notice if you redistribute LLVM.
- Binaries derived from LLVM must reproduce the copyright notice.
- You can't use our names to promote your LLVM derived products.
- There's no warranty on LLVM at all.
We believe this fosters the widest adoption of LLVM because it allows
commercial products to be derived from LLVM with few restrictions and
without a requirement for making any derived works also open source. We
suggest that you read the
License if
further clarification is needed.
With regards to the LLVM copyright and licensing, developers agree to:
- assign their copy rights to UIUC for any contribution made so that
the entire software base can be managed by a single copyright holder.
- allow their contribution(s) to be licensed as open source by the then
current license chosen by the LLVM Oversight Group.
This section contains some notes on policy topics that need to be
resolved and incorporated into the main body of the document above.
- When to open a new bug and when to re-use an existing one. For example
PR1158. If the same assertion happens do you open a new bug or reopen
1158?
Written By: the
LLVM Oversight Group
The LLVM Compiler Infrastructure
Last modified: $Date$