87c605fad5a6df19d9f49b8f2bd7b106af95f388
   1Git User's Manual
   2_________________
   3
   4This manual is designed to be readable by someone with basic unix
   5commandline skills, but no previous knowledge of git.
   6
   7Chapter 1 gives a brief overview of git commands, without any
   8explanation; you may prefer to skip to chapter 2 on a first reading.
   9
  10Chapters 2 and 3 explain how to fetch and study a project using
  11git--the tools you'd need to build and test a particular version of a
  12software project, to search for regressions, and so on.
  13
  14Chapter 4 explains how to do development with git, and chapter 5 how
  15to share that development with others.
  16
  17Further chapters cover more specialized topics.
  18
  19Comprehensive reference documentation is available through the man
  20pages.  For a command such as "git clone", just use
  21
  22------------------------------------------------
  23$ man git-clone
  24------------------------------------------------
  25
  26Git Quick Start
  27===============
  28
  29This is a quick summary of the major commands; the following chapters
  30will explain how these work in more detail.
  31
  32Creating a new repository
  33-------------------------
  34
  35From a tarball:
  36
  37-----------------------------------------------
  38$ tar xzf project.tar.gz
  39$ cd project
  40$ git init
  41Initialized empty Git repository in .git/
  42$ git add .
  43$ git commit
  44-----------------------------------------------
  45
  46From a remote repository:
  47
  48-----------------------------------------------
  49$ git clone git://example.com/pub/project.git
  50$ cd project
  51-----------------------------------------------
  52
  53Managing branches
  54-----------------
  55
  56-----------------------------------------------
  57$ git branch         # list all branches in this repo
  58$ git checkout test  # switch working directory to branch "test"
  59$ git branch new     # create branch "new" starting at current HEAD
  60$ git branch -d new  # delete branch "new"
  61-----------------------------------------------
  62
  63Instead of basing new branch on current HEAD (the default), use:
  64
  65-----------------------------------------------
  66$ git branch new test    # branch named "test"
  67$ git branch new v2.6.15 # tag named v2.6.15
  68$ git branch new HEAD^   # commit before the most recent
  69$ git branch new HEAD^^  # commit before that
  70$ git branch new test~10 # ten commits before tip of branch "test"
  71-----------------------------------------------
  72
  73Create and switch to a new branch at the same time:
  74
  75-----------------------------------------------
  76$ git checkout -b new v2.6.15
  77-----------------------------------------------
  78
  79Update and examine branches from the repository you cloned from:
  80
  81-----------------------------------------------
  82$ git fetch             # update
  83$ git branch -r         # list
  84  origin/master
  85  origin/next
  86  ...
  87$ git branch checkout -b masterwork origin/master
  88-----------------------------------------------
  89
  90Fetch a branch from a different repository, and give it a new
  91name in your repository:
  92
  93-----------------------------------------------
  94$ git fetch git://example.com/project.git theirbranch:mybranch
  95$ git fetch git://example.com/project.git v2.6.15:mybranch
  96-----------------------------------------------
  97
  98Keep a list of repositories you work with regularly:
  99
 100-----------------------------------------------
 101$ git remote add example git://example.com/project.git
 102$ git remote                    # list remote repositories
 103example
 104origin
 105$ git remote show example       # get details
 106* remote example
 107  URL: git://example.com/project.git
 108  Tracked remote branches
 109    master next ...
 110$ git fetch example             # update branches from example
 111$ git branch -r                 # list all remote branches
 112-----------------------------------------------
 113
 114
 115Exploring history
 116-----------------
 117
 118-----------------------------------------------
 119$ gitk                      # visualize and browse history
 120$ git log                   # list all commits
 121$ git log src/              # ...modifying src/
 122$ git log v2.6.15..v2.6.16  # ...in v2.6.16, not in v2.6.15
 123$ git log master..test      # ...in branch test, not in branch master
 124$ git log test..master      # ...in branch master, but not in test
 125$ git log test...master     # ...in one branch, not in both
 126$ git log -S'foo()'         # ...where difference contain "foo()"
 127$ git log --since="2 weeks ago"
 128$ git log -p                # show patches as well
 129$ git show                  # most recent commit
 130$ git diff v2.6.15..v2.6.16 # diff between two tagged versions
 131$ git diff v2.6.15..HEAD    # diff with current head
 132$ git grep "foo()"          # search working directory for "foo()"
 133$ git grep v2.6.15 "foo()"  # search old tree for "foo()"
 134$ git show v2.6.15:a.txt    # look at old version of a.txt
 135-----------------------------------------------
 136
 137Search for regressions:
 138
 139-----------------------------------------------
 140$ git bisect start
 141$ git bisect bad                # current version is bad
 142$ git bisect good v2.6.13-rc2   # last known good revision
 143Bisecting: 675 revisions left to test after this
 144                                # test here, then:
 145$ git bisect good               # if this revision is good, or
 146$ git bisect bad                # if this revision is bad.
 147                                # repeat until done.
 148-----------------------------------------------
 149
 150Making changes
 151--------------
 152
 153Make sure git knows who to blame:
 154
 155------------------------------------------------
 156$ cat >~/.gitconfig <<\EOF
 157[user]
 158name = Your Name Comes Here
 159email = you@yourdomain.example.com
 160EOF
 161------------------------------------------------
 162
 163Select file contents to include in the next commit, then make the
 164commit:
 165
 166-----------------------------------------------
 167$ git add a.txt    # updated file
 168$ git add b.txt    # new file
 169$ git rm c.txt     # old file
 170$ git commit
 171-----------------------------------------------
 172
 173Or, prepare and create the commit in one step:
 174
 175-----------------------------------------------
 176$ git commit d.txt # use latest content only of d.txt
 177$ git commit -a    # use latest content of all tracked files
 178-----------------------------------------------
 179
 180Merging
 181-------
 182
 183-----------------------------------------------
 184$ git merge test   # merge branch "test" into the current branch
 185$ git pull git://example.com/project.git master
 186                   # fetch and merge in remote branch
 187$ git pull . test  # equivalent to git merge test
 188-----------------------------------------------
 189
 190Sharing your changes
 191--------------------
 192
 193Importing or exporting patches:
 194
 195-----------------------------------------------
 196$ git format-patch origin..HEAD # format a patch for each commit
 197                                # in HEAD but not in origin
 198$ git-am mbox # import patches from the mailbox "mbox"
 199-----------------------------------------------
 200
 201Fetch a branch in a different git repository, then merge into the
 202current branch:
 203
 204-----------------------------------------------
 205$ git pull git://example.com/project.git theirbranch
 206-----------------------------------------------
 207
 208Store the fetched branch into a local branch before merging into the
 209current branch:
 210
 211-----------------------------------------------
 212$ git pull git://example.com/project.git theirbranch:mybranch
 213-----------------------------------------------
 214
 215After creating commits on a local branch, update the remote
 216branch with your commits:
 217
 218-----------------------------------------------
 219$ git push ssh://example.com/project.git mybranch:theirbranch
 220-----------------------------------------------
 221
 222When remote and local branch are both named "test":
 223
 224-----------------------------------------------
 225$ git push ssh://example.com/project.git test
 226-----------------------------------------------
 227
 228Shortcut version for a frequently used remote repository:
 229
 230-----------------------------------------------
 231$ git remote add example ssh://example.com/project.git
 232$ git push example test
 233-----------------------------------------------
 234
 235Repository maintenance
 236----------------------
 237
 238Check for corruption:
 239
 240-----------------------------------------------
 241$ git fsck-objects
 242-----------------------------------------------
 243
 244Recompress, remove unused cruft:
 245
 246-----------------------------------------------
 247$ git gc
 248-----------------------------------------------
 249
 250Repositories and Branches
 251=========================
 252
 253How to get a git repository
 254---------------------------
 255
 256It will be useful to have a git repository to experiment with as you
 257read this manual.
 258
 259The best way to get one is by using the gitlink:git-clone[1] command
 260to download a copy of an existing repository for a project that you
 261are interested in.  If you don't already have a project in mind, here
 262are some interesting examples:
 263
 264------------------------------------------------
 265        # git itself (approx. 10MB download):
 266$ git clone git://git.kernel.org/pub/scm/git/git.git
 267        # the linux kernel (approx. 150MB download):
 268$ git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git
 269------------------------------------------------
 270
 271The initial clone may be time-consuming for a large project, but you
 272will only need to clone once.
 273
 274The clone command creates a new directory named after the project
 275("git" or "linux-2.6" in the examples above).  After you cd into this
 276directory, you will see that it contains a copy of the project files,
 277together with a special top-level directory named ".git", which
 278contains all the information about the history of the project.
 279
 280In most of the following, examples will be taken from one of the two
 281repositories above.
 282
 283How to check out a different version of a project
 284-------------------------------------------------
 285
 286Git is best thought of as a tool for storing the history of a
 287collection of files.  It stores the history as a compressed
 288collection of interrelated snapshots (versions) of the project's
 289contents.
 290
 291A single git repository may contain multiple branches.  Each branch
 292is a bookmark referencing a particular point in the project history.
 293The gitlink:git-branch[1] command shows you the list of branches:
 294
 295------------------------------------------------
 296$ git branch
 297* master
 298------------------------------------------------
 299
 300A freshly cloned repository contains a single branch, named "master",
 301and the working directory contains the version of the project
 302referred to by the master branch.
 303
 304Most projects also use tags.  Tags, like branches, are references
 305into the project's history, and can be listed using the
 306gitlink:git-tag[1] command:
 307
 308------------------------------------------------
 309$ git tag -l
 310v2.6.11
 311v2.6.11-tree
 312v2.6.12
 313v2.6.12-rc2
 314v2.6.12-rc3
 315v2.6.12-rc4
 316v2.6.12-rc5
 317v2.6.12-rc6
 318v2.6.13
 319...
 320------------------------------------------------
 321
 322Tags are expected to always point at the same version of a project,
 323while branches are expected to advance as development progresses.
 324
 325Create a new branch pointing to one of these versions and check it
 326out using gitlink:git-checkout[1]:
 327
 328------------------------------------------------
 329$ git checkout -b new v2.6.13
 330------------------------------------------------
 331
 332The working directory then reflects the contents that the project had
 333when it was tagged v2.6.13, and gitlink:git-branch[1] shows two
 334branches, with an asterisk marking the currently checked-out branch:
 335
 336------------------------------------------------
 337$ git branch
 338  master
 339* new
 340------------------------------------------------
 341
 342If you decide that you'd rather see version 2.6.17, you can modify
 343the current branch to point at v2.6.17 instead, with
 344
 345------------------------------------------------
 346$ git reset --hard v2.6.17
 347------------------------------------------------
 348
 349Note that if the current branch was your only reference to a
 350particular point in history, then resetting that branch may leave you
 351with no way to find the history it used to point to; so use this
 352command carefully.
 353
 354Understanding History: Commits
 355------------------------------
 356
 357Every change in the history of a project is represented by a commit.
 358The gitlink:git-show[1] command shows the most recent commit on the
 359current branch:
 360
 361------------------------------------------------
 362$ git show
 363commit 2b5f6dcce5bf94b9b119e9ed8d537098ec61c3d2
 364Author: Jamal Hadi Salim <hadi@cyberus.ca>
 365Date:   Sat Dec 2 22:22:25 2006 -0800
 366
 367    [XFRM]: Fix aevent structuring to be more complete.
 368    
 369    aevents can not uniquely identify an SA. We break the ABI with this
 370    patch, but consensus is that since it is not yet utilized by any
 371    (known) application then it is fine (better do it now than later).
 372    
 373    Signed-off-by: Jamal Hadi Salim <hadi@cyberus.ca>
 374    Signed-off-by: David S. Miller <davem@davemloft.net>
 375
 376diff --git a/Documentation/networking/xfrm_sync.txt b/Documentation/networking/xfrm_sync.txt
 377index 8be626f..d7aac9d 100644
 378--- a/Documentation/networking/xfrm_sync.txt
 379+++ b/Documentation/networking/xfrm_sync.txt
 380@@ -47,10 +47,13 @@ aevent_id structure looks like:
 381 
 382    struct xfrm_aevent_id {
 383              struct xfrm_usersa_id           sa_id;
 384+             xfrm_address_t                  saddr;
 385              __u32                           flags;
 386+             __u32                           reqid;
 387    };
 388...
 389------------------------------------------------
 390
 391As you can see, a commit shows who made the latest change, what they
 392did, and why.
 393
 394Every commit has a 40-hexdigit id, sometimes called the "object name"
 395or the "SHA1 id", shown on the first line of the "git show" output.
 396You can usually refer to a commit by a shorter name, such as a tag or a
 397branch name, but this longer name can also be useful.  Most
 398importantly, it is a globally unique name for this commit: so if you
 399tell somebody else the object name (for example in email), then you are
 400guaranteed that name will refer to the same commit in their repository
 401that you it does in yours (assuming their repository has that commit at
 402all).
 403
 404Understanding history: commits, parents, and reachability
 405~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 406
 407Every commit (except the very first commit in a project) also has a
 408parent commit which shows what happened before this commit.
 409Following the chain of parents will eventually take you back to the
 410beginning of the project.
 411
 412However, the commits do not form a simple list; git allows lines of
 413development to diverge and then reconverge, and the point where two
 414lines of development reconverge is called a "merge".  The commit
 415representing a merge can therefore have more than one parent, with
 416each parent representing the most recent commit on one of the lines
 417of development leading to that point.
 418
 419The best way to see how this works is using the gitlink:gitk[1]
 420command; running gitk now on a git repository and looking for merge
 421commits will help understand how the git organizes history.
 422
 423In the following, we say that commit X is "reachable" from commit Y
 424if commit X is an ancestor of commit Y.  Equivalently, you could say
 425that Y is a descendent of X, or that there is a chain of parents
 426leading from commit Y to commit X.
 427
 428Undestanding history: History diagrams
 429~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 430
 431We will sometimes represent git history using diagrams like the one
 432below.  Commits are shown as "o", and the links between them with
 433lines drawn with - / and \.  Time goes left to right:
 434
 435         o--o--o <-- Branch A
 436        /
 437 o--o--o <-- master
 438        \
 439         o--o--o <-- Branch B
 440
 441If we need to talk about a particular commit, the character "o" may
 442be replaced with another letter or number.
 443
 444Understanding history: What is a branch?
 445~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 446
 447Though we've been using the word "branch" to mean a kind of reference
 448to a particular commit, the word branch is also commonly used to
 449refer to the line of commits leading up to that point.  In the
 450example above, git may think of the branch named "A" as just a
 451pointer to one particular commit, but we may refer informally to the
 452line of three commits leading up to that point as all being part of
 453"branch A".
 454
 455If we need to make it clear that we're just talking about the most
 456recent commit on the branch, we may refer to that commit as the
 457"head" of the branch.
 458
 459Manipulating branches
 460---------------------
 461
 462Creating, deleting, and modifying branches is quick and easy; here's
 463a summary of the commands:
 464
 465git branch::
 466        list all branches
 467git branch <branch>::
 468        create a new branch named <branch>, referencing the same
 469        point in history as the current branch
 470git branch <branch> <start-point>::
 471        create a new branch named <branch>, referencing
 472        <start-point>, which may be specified any way you like,
 473        including using a branch name or a tag name
 474git branch -d <branch>::
 475        delete the branch <branch>; if the branch you are deleting
 476        points to a commit which is not reachable from this branch,
 477        this command will fail with a warning.
 478git branch -D <branch>::
 479        even if the branch points to a commit not reachable
 480        from the current branch, you may know that that commit
 481        is still reachable from some other branch or tag.  In that
 482        case it is safe to use this command to force git to delete
 483        the branch.
 484git checkout <branch>::
 485        make the current branch <branch>, updating the working
 486        directory to reflect the version referenced by <branch>
 487git checkout -b <new> <start-point>::
 488        create a new branch <new> referencing <start-point>, and
 489        check it out.
 490
 491It is also useful to know that the special symbol "HEAD" can always
 492be used to refer to the current branch.
 493
 494Examining branches from a remote repository
 495-------------------------------------------
 496
 497The "master" branch that was created at the time you cloned is a copy
 498of the HEAD in the repository that you cloned from.  That repository
 499may also have had other branches, though, and your local repository
 500keeps branches which track each of those remote branches, which you
 501can view using the "-r" option to gitlink:git-branch[1]:
 502
 503------------------------------------------------
 504$ git branch -r
 505  origin/HEAD
 506  origin/html
 507  origin/maint
 508  origin/man
 509  origin/master
 510  origin/next
 511  origin/pu
 512  origin/todo
 513------------------------------------------------
 514
 515You cannot check out these remote-tracking branches, but you can
 516examine them on a branch of your own, just as you would a tag:
 517
 518------------------------------------------------
 519$ git checkout -b my-todo-copy origin/todo
 520------------------------------------------------
 521
 522Note that the name "origin" is just the name that git uses by default
 523to refer to the repository that you cloned from.
 524
 525[[how-git-stores-references]]
 526Naming branches, tags, and other references
 527-------------------------------------------
 528
 529Branches, remote-tracking branches, and tags are all references to
 530commits.  All references are named with a slash-separated path name
 531starting with "refs"; the names we've been using so far are actually
 532shorthand:
 533
 534        - The branch "test" is short for "refs/heads/test".
 535        - The tag "v2.6.18" is short for "refs/tags/v2.6.18".
 536        - "origin/master" is short for "refs/remotes/origin/master".
 537
 538The full name is occasionally useful if, for example, there ever
 539exists a tag and a branch with the same name.
 540
 541As another useful shortcut, if the repository "origin" posesses only
 542a single branch, you can refer to that branch as just "origin".
 543
 544More generally, if you have defined a remote repository named
 545"example", you can refer to the branch in that repository as
 546"example".  And for a repository with multiple branches, this will
 547refer to the branch designated as the "HEAD" branch.
 548
 549For the complete list of paths which git checks for references, and
 550the order it uses to decide which to choose when there are multiple
 551references with the same shorthand name, see the "SPECIFYING
 552REVISIONS" section of gitlink:git-rev-parse[1].
 553
 554[[Updating-a-repository-with-git-fetch]]
 555Updating a repository with git fetch
 556------------------------------------
 557
 558Eventually the developer cloned from will do additional work in her
 559repository, creating new commits and advancing the branches to point
 560at the new commits.
 561
 562The command "git fetch", with no arguments, will update all of the
 563remote-tracking branches to the latest version found in her
 564repository.  It will not touch any of your own branches--not even the
 565"master" branch that was created for you on clone.
 566
 567Fetching branches from other repositories
 568-----------------------------------------
 569
 570You can also track branches from repositories other than the one you
 571cloned from, using gitlink:git-remote[1]:
 572
 573-------------------------------------------------
 574$ git remote add linux-nfs git://linux-nfs.org/pub/nfs-2.6.git
 575$ git fetch
 576* refs/remotes/linux-nfs/master: storing branch 'master' ...
 577  commit: bf81b46
 578-------------------------------------------------
 579
 580New remote-tracking branches will be stored under the shorthand name
 581that you gave "git remote add", in this case linux-nfs:
 582
 583-------------------------------------------------
 584$ git branch -r
 585linux-nfs/master
 586origin/master
 587-------------------------------------------------
 588
 589If you run "git fetch <remote>" later, the tracking branches for the
 590named <remote> will be updated.
 591
 592If you examine the file .git/config, you will see that git has added
 593a new stanza:
 594
 595-------------------------------------------------
 596$ cat .git/config
 597...
 598[remote "linux-nfs"]
 599        url = git://linux-nfs.org/~bfields/git.git
 600        fetch = +refs/heads/*:refs/remotes/linux-nfs-read/*
 601...
 602-------------------------------------------------
 603
 604This is what causes git to track the remote's branches; you may
 605modify or delete these configuration options by editing .git/config
 606with a text editor.
 607
 608Exploring git history
 609=====================
 610
 611Git is best thought of as a tool for storing the history of a
 612collection of files.  It does this by storing compressed snapshots of
 613the contents of a file heirarchy, together with "commits" which show
 614the relationships between these snapshots.
 615
 616Git provides extremely flexible and fast tools for exploring the
 617history of a project.
 618
 619We start with one specialized tool which is useful for finding the
 620commit that introduced a bug into a project.
 621
 622How to use bisect to find a regression
 623--------------------------------------
 624
 625Suppose version 2.6.18 of your project worked, but the version at
 626"master" crashes.  Sometimes the best way to find the cause of such a
 627regression is to perform a brute-force search through the project's
 628history to find the particular commit that caused the problem.  The
 629gitlink:git-bisect[1] command can help you do this:
 630
 631-------------------------------------------------
 632$ git bisect start
 633$ git bisect good v2.6.18
 634$ git bisect bad master
 635Bisecting: 3537 revisions left to test after this
 636[65934a9a028b88e83e2b0f8b36618fe503349f8e] BLOCK: Make USB storage depend on SCSI rather than selecting it [try #6]
 637-------------------------------------------------
 638
 639If you run "git branch" at this point, you'll see that git has
 640temporarily moved you to a new branch named "bisect".  This branch
 641points to a commit (with commit id 65934...) that is reachable from
 642v2.6.19 but not from v2.6.18.  Compile and test it, and see whether
 643it crashes.  Assume it does crash.  Then:
 644
 645-------------------------------------------------
 646$ git bisect bad
 647Bisecting: 1769 revisions left to test after this
 648[7eff82c8b1511017ae605f0c99ac275a7e21b867] i2c-core: Drop useless bitmaskings
 649-------------------------------------------------
 650
 651checks out an older version.  Continue like this, telling git at each
 652stage whether the version it gives you is good or bad, and notice
 653that the number of revisions left to test is cut approximately in
 654half each time.
 655
 656After about 13 tests (in this case), it will output the commit id of
 657the guilty commit.  You can then examine the commit with
 658gitlink:git-show[1], find out who wrote it, and mail them your bug
 659report with the commit id.  Finally, run
 660
 661-------------------------------------------------
 662$ git bisect reset
 663-------------------------------------------------
 664
 665to return you to the branch you were on before and delete the
 666temporary "bisect" branch.
 667
 668Note that the version which git-bisect checks out for you at each
 669point is just a suggestion, and you're free to try a different
 670version if you think it would be a good idea.  For example,
 671occasionally you may land on a commit that broke something unrelated;
 672run
 673
 674-------------------------------------------------
 675$ git bisect-visualize
 676-------------------------------------------------
 677
 678which will run gitk and label the commit it chose with a marker that
 679says "bisect".  Chose a safe-looking commit nearby, note its commit
 680id, and check it out with:
 681
 682-------------------------------------------------
 683$ git reset --hard fb47ddb2db...
 684-------------------------------------------------
 685
 686then test, run "bisect good" or "bisect bad" as appropriate, and
 687continue.
 688
 689Naming commits
 690--------------
 691
 692We have seen several ways of naming commits already:
 693
 694        - 40-hexdigit SHA1 id
 695        - branch name: refers to the commit at the head of the given
 696          branch
 697        - tag name: refers to the commit pointed to by the given tag
 698          (we've seen branches and tags are special cases of
 699          <<how-git-stores-references,references>>).
 700        - HEAD: refers to the head of the current branch
 701
 702There are many more; see the "SPECIFYING REVISIONS" section of the
 703gitlink:git-rev-parse[1] man page for the complete list of ways to
 704name revisions.  Some examples:
 705
 706-------------------------------------------------
 707$ git show fb47ddb2 # the first few characters of the SHA1 id
 708                    # are usually enough to specify it uniquely
 709$ git show HEAD^    # the parent of the HEAD commit
 710$ git show HEAD^^   # the grandparent
 711$ git show HEAD~4   # the great-great-grandparent
 712-------------------------------------------------
 713
 714Recall that merge commits may have more than one parent; by default,
 715^ and ~ follow the first parent listed in the commit, but you can
 716also choose:
 717
 718-------------------------------------------------
 719$ git show HEAD^1   # show the first parent of HEAD
 720$ git show HEAD^2   # show the second parent of HEAD
 721-------------------------------------------------
 722
 723In addition to HEAD, there are several other special names for
 724commits:
 725
 726Merges (to be discussed later), as well as operations such as
 727git-reset, which change the currently checked-out commit, generally
 728set ORIG_HEAD to the value HEAD had before the current operation.
 729
 730The git-fetch operation always stores the head of the last fetched
 731branch in FETCH_HEAD.  For example, if you run git fetch without
 732specifying a local branch as the target of the operation
 733
 734-------------------------------------------------
 735$ git fetch git://example.com/proj.git theirbranch
 736-------------------------------------------------
 737
 738the fetched commits will still be available from FETCH_HEAD.
 739
 740When we discuss merges we'll also see the special name MERGE_HEAD,
 741which refers to the other branch that we're merging in to the current
 742branch.
 743
 744The gitlink:git-rev-parse[1] command is a low-level command that is
 745occasionally useful for translating some name for a commit to the SHA1 id for
 746that commit:
 747
 748-------------------------------------------------
 749$ git rev-parse origin
 750e05db0fd4f31dde7005f075a84f96b360d05984b
 751-------------------------------------------------
 752
 753Creating tags
 754-------------
 755
 756We can also create a tag to refer to a particular commit; after
 757running
 758
 759-------------------------------------------------
 760$ git-tag stable-1 1b2e1d63ff
 761-------------------------------------------------
 762
 763You can use stable-1 to refer to the commit 1b2e1d63ff.
 764
 765This creates a "lightweight" tag.  If the tag is a tag you wish to
 766share with others, and possibly sign cryptographically, then you
 767should create a tag object instead; see the gitlink:git-tag[1] man
 768page for details.
 769
 770Browsing revisions
 771------------------
 772
 773The gitlink:git-log[1] command can show lists of commits.  On its
 774own, it shows all commits reachable from the parent commit; but you
 775can also make more specific requests:
 776
 777-------------------------------------------------
 778$ git log v2.5..        # commits since (not reachable from) v2.5
 779$ git log test..master  # commits reachable from master but not test
 780$ git log master..test  # ...reachable from test but not master
 781$ git log master...test # ...reachable from either test or master,
 782                        #    but not both
 783$ git log --since="2 weeks ago" # commits from the last 2 weeks
 784$ git log Makefile      # commits which modify Makefile
 785$ git log fs/           # ... which modify any file under fs/
 786$ git log -S'foo()'     # commits which add or remove any file data
 787                        # matching the string 'foo()'
 788-------------------------------------------------
 789
 790And of course you can combine all of these; the following finds
 791commits since v2.5 which touch the Makefile or any file under fs:
 792
 793-------------------------------------------------
 794$ git log v2.5.. Makefile fs/
 795-------------------------------------------------
 796
 797You can also ask git log to show patches:
 798
 799-------------------------------------------------
 800$ git log -p
 801-------------------------------------------------
 802
 803See the "--pretty" option in the gitlink:git-log[1] man page for more
 804display options.
 805
 806Note that git log starts with the most recent commit and works
 807backwards through the parents; however, since git history can contain
 808multiple independant lines of development, the particular order that
 809commits are listed in may be somewhat arbitrary.
 810
 811Generating diffs
 812----------------
 813
 814You can generate diffs between any two versions using
 815gitlink:git-diff[1]:
 816
 817-------------------------------------------------
 818$ git diff master..test
 819-------------------------------------------------
 820
 821Sometimes what you want instead is a set of patches:
 822
 823-------------------------------------------------
 824$ git format-patch master..test
 825-------------------------------------------------
 826
 827will generate a file with a patch for each commit reachable from test
 828but not from master.  Note that if master also has commits which are
 829not reachable from test, then the combined result of these patches
 830will not be the same as the diff produced by the git-diff example.
 831
 832Viewing old file versions
 833-------------------------
 834
 835You can always view an old version of a file by just checking out the
 836correct revision first.  But sometimes it is more convenient to be
 837able to view an old version of a single file without checking
 838anything out; this command does that:
 839
 840-------------------------------------------------
 841$ git show v2.5:fs/locks.c
 842-------------------------------------------------
 843
 844Before the colon may be anything that names a commit, and after it
 845may be any path to a file tracked by git.
 846
 847Examples
 848--------
 849
 850Check whether two branches point at the same history
 851~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 852
 853Suppose you want to check whether two branches point at the same point
 854in history.
 855
 856-------------------------------------------------
 857$ git diff origin..master
 858-------------------------------------------------
 859
 860will tell you whether the contents of the project are the same at the
 861two branches; in theory, however, it's possible that the same project
 862contents could have been arrived at by two different historical
 863routes.  You could compare the SHA1 id's:
 864
 865-------------------------------------------------
 866$ git rev-list origin
 867e05db0fd4f31dde7005f075a84f96b360d05984b
 868$ git rev-list master
 869e05db0fd4f31dde7005f075a84f96b360d05984b
 870-------------------------------------------------
 871
 872Or you could recall that the ... operator selects all commits
 873contained reachable from either one reference or the other but not
 874both: so
 875
 876-------------------------------------------------
 877$ git log origin...master
 878-------------------------------------------------
 879
 880will return no commits when the two branches are equal.
 881
 882Find first tagged version including a given fix
 883~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 884
 885Suppose you know that the commit e05db0fd fixed a certain problem.
 886You'd like to find the earliest tagged release that contains that
 887fix.
 888
 889Of course, there may be more than one answer--if the history branched
 890after commit e05db0fd, then there could be multiple "earliest" tagged
 891releases.
 892
 893You could just visually inspect the commits since e05db0fd:
 894
 895-------------------------------------------------
 896$ gitk e05db0fd..
 897-------------------------------------------------
 898
 899Or you can use gitlink:git-name-rev[1], which will give the commit a
 900name based on any tag it finds pointing to one of the commit's
 901descendants:
 902
 903-------------------------------------------------
 904$ git name-rev e05db0fd
 905e05db0fd tags/v1.5.0-rc1^0~23
 906-------------------------------------------------
 907
 908The gitlink:git-describe[1] command does the opposite, naming the
 909revision using a tag on which the given commit is based:
 910
 911-------------------------------------------------
 912$ git describe e05db0fd
 913v1.5.0-rc0-ge05db0f
 914-------------------------------------------------
 915
 916but that may sometimes help you guess which tags might come after the
 917given commit.
 918
 919If you just want to verify whether a given tagged version contains a
 920given commit, you could use gitlink:git-merge-base[1]:
 921
 922-------------------------------------------------
 923$ git merge-base e05db0fd v1.5.0-rc1
 924e05db0fd4f31dde7005f075a84f96b360d05984b
 925-------------------------------------------------
 926
 927The merge-base command finds a common ancestor of the given commits,
 928and always returns one or the other in the case where one is a
 929descendant of the other; so the above output shows that e05db0fd
 930actually is an ancestor of v1.5.0-rc1.
 931
 932Alternatively, note that
 933
 934-------------------------------------------------
 935$ git log v1.5.0-rc1..305db0fd
 936-------------------------------------------------
 937
 938will produce empty output if and only if v1.5.0-rc1 includes 305db0fd,
 939because it outputs only commits that are not reachable from v1.5.0-rc1.
 940
 941Developing with git
 942===================
 943
 944Telling git your name
 945---------------------
 946
 947Before creating any commits, you should introduce yourself to git.  The
 948easiest way to do so is:
 949
 950------------------------------------------------
 951$ cat >~/.gitconfig <<\EOF
 952[user]
 953        name = Your Name Comes Here
 954        email = you@yourdomain.example.com
 955EOF
 956------------------------------------------------
 957
 958
 959Creating a new repository
 960-------------------------
 961
 962Creating a new repository from scratch is very easy:
 963
 964-------------------------------------------------
 965$ mkdir project
 966$ cd project
 967$ git init
 968-------------------------------------------------
 969
 970If you have some initial content (say, a tarball):
 971
 972-------------------------------------------------
 973$ tar -xzvf project.tar.gz
 974$ cd project
 975$ git init
 976$ git add . # include everything below ./ in the first commit:
 977$ git commit
 978-------------------------------------------------
 979
 980[[how-to-make-a-commit]]
 981how to make a commit
 982--------------------
 983
 984Creating a new commit takes three steps:
 985
 986        1. Making some changes to the working directory using your
 987           favorite editor.
 988        2. Telling git about your changes.
 989        3. Creating the commit using the content you told git about
 990           in step 2.
 991
 992In practice, you can interleave and repeat steps 1 and 2 as many
 993times as you want: in order to keep track of what you want committed
 994at step 3, git maintains a snapshot of the tree's contents in a
 995special staging area called "the index."
 996
 997At the beginning, the content of the index will be identical to
 998that of the HEAD.  The command "git diff --cached", which shows
 999the difference between the HEAD and the index, should therefore
1000produce no output at that point.
1001
1002Modifying the index is easy:
1003
1004To update the index with the new contents of a modified file, use
1005
1006-------------------------------------------------
1007$ git add path/to/file
1008-------------------------------------------------
1009
1010To add the contents of a new file to the index, use
1011
1012-------------------------------------------------
1013$ git add path/to/file
1014-------------------------------------------------
1015
1016To remove a file from the index and from the working tree,
1017
1018-------------------------------------------------
1019$ git rm path/to/file
1020-------------------------------------------------
1021
1022After each step you can verify that
1023
1024-------------------------------------------------
1025$ git diff --cached
1026-------------------------------------------------
1027
1028always shows the difference between the HEAD and the index file--this
1029is what you'd commit if you created the commit now--and that
1030
1031-------------------------------------------------
1032$ git diff
1033-------------------------------------------------
1034
1035shows the difference between the working tree and the index file.
1036
1037Note that "git add" always adds just the current contents of a file
1038to the index; further changes to the same file will be ignored unless
1039you run git-add on the file again.
1040
1041When you're ready, just run
1042
1043-------------------------------------------------
1044$ git commit
1045-------------------------------------------------
1046
1047and git will prompt you for a commit message and then create the new
1048commmit.  Check to make sure it looks like what you expected with
1049
1050-------------------------------------------------
1051$ git show
1052-------------------------------------------------
1053
1054As a special shortcut,
1055                
1056-------------------------------------------------
1057$ git commit -a
1058-------------------------------------------------
1059
1060will update the index with any files that you've modified or removed
1061and create a commit, all in one step.
1062
1063A number of commands are useful for keeping track of what you're
1064about to commit:
1065
1066-------------------------------------------------
1067$ git diff --cached # difference between HEAD and the index; what
1068                    # would be commited if you ran "commit" now.
1069$ git diff          # difference between the index file and your
1070                    # working directory; changes that would not
1071                    # be included if you ran "commit" now.
1072$ git status        # a brief per-file summary of the above.
1073-------------------------------------------------
1074
1075creating good commit messages
1076-----------------------------
1077
1078Though not required, it's a good idea to begin the commit message
1079with a single short (less than 50 character) line summarizing the
1080change, followed by a blank line and then a more thorough
1081description.  Tools that turn commits into email, for example, use
1082the first line on the Subject line and the rest of the commit in the
1083body.
1084
1085how to merge
1086------------
1087
1088You can rejoin two diverging branches of development using
1089gitlink:git-merge[1]:
1090
1091-------------------------------------------------
1092$ git merge branchname
1093-------------------------------------------------
1094
1095merges the development in the branch "branchname" into the current
1096branch.  If there are conflicts--for example, if the same file is
1097modified in two different ways in the remote branch and the local
1098branch--then you are warned; the output may look something like this:
1099
1100-------------------------------------------------
1101$ git pull . next
1102Trying really trivial in-index merge...
1103fatal: Merge requires file-level merging
1104Nope.
1105Merging HEAD with 77976da35a11db4580b80ae27e8d65caf5208086
1106Merging:
110715e2162 world
110877976da goodbye
1109found 1 common ancestor(s):
1110d122ed4 initial
1111Auto-merging file.txt
1112CONFLICT (content): Merge conflict in file.txt
1113Automatic merge failed; fix conflicts and then commit the result.
1114-------------------------------------------------
1115
1116Conflict markers are left in the problematic files, and after
1117you resolve the conflicts manually, you can update the index
1118with the contents and run git commit, as you normally would when
1119creating a new file.
1120
1121If you examine the resulting commit using gitk, you will see that it
1122has two parents, one pointing to the top of the current branch, and
1123one to the top of the other branch.
1124
1125In more detail:
1126
1127[[resolving-a-merge]]
1128Resolving a merge
1129-----------------
1130
1131When a merge isn't resolved automatically, git leaves the index and
1132the working tree in a special state that gives you all the
1133information you need to help resolve the merge.
1134
1135Files with conflicts are marked specially in the index, so until you
1136resolve the problem and update the index, git commit will fail:
1137
1138-------------------------------------------------
1139$ git commit
1140file.txt: needs merge
1141-------------------------------------------------
1142
1143Also, git status will list those files as "unmerged".
1144
1145All of the changes that git was able to merge automatically are
1146already added to the index file, so gitlink:git-diff[1] shows only
1147the conflicts.  Also, it uses a somewhat unusual syntax:
1148
1149-------------------------------------------------
1150$ git diff
1151diff --cc file.txt
1152index 802992c,2b60207..0000000
1153--- a/file.txt
1154+++ b/file.txt
1155@@@ -1,1 -1,1 +1,5 @@@
1156++<<<<<<< HEAD:file.txt
1157 +Hello world
1158++=======
1159+ Goodbye
1160++>>>>>>> 77976da35a11db4580b80ae27e8d65caf5208086:file.txt
1161-------------------------------------------------
1162
1163Recall that the commit which will be commited after we resolve this
1164conflict will have two parents instead of the usual one: one parent
1165will be HEAD, the tip of the current branch; the other will be the
1166tip of the other branch, which is stored temporarily in MERGE_HEAD.
1167
1168The diff above shows the differences between the working-tree version
1169of file.txt and two previous version: one version from HEAD, and one
1170from MERGE_HEAD.  So instead of preceding each line by a single "+"
1171or "-", it now uses two columns: the first column is used for
1172differences between the first parent and the working directory copy,
1173and the second for differences between the second parent and the
1174working directory copy.  Thus after resolving the conflict in the
1175obvious way, the diff will look like:
1176
1177-------------------------------------------------
1178$ git diff
1179diff --cc file.txt
1180index 802992c,2b60207..0000000
1181--- a/file.txt
1182+++ b/file.txt
1183@@@ -1,1 -1,1 +1,1 @@@
1184- Hello world
1185 -Goodbye
1186++Goodbye world
1187-------------------------------------------------
1188
1189This shows that our resolved version deleted "Hello world" from the
1190first parent, deleted "Goodbye" from the second parent, and added
1191"Goodbye world", which was previously absent from both.
1192
1193The gitlink:git-log[1] command also provides special help for merges:
1194
1195-------------------------------------------------
1196$ git log --merge
1197-------------------------------------------------
1198
1199This will list all commits which exist only on HEAD or on MERGE_HEAD,
1200and which touch an unmerged file.
1201
1202We can now add the resolved version to the index and commit:
1203
1204-------------------------------------------------
1205$ git add file.txt
1206$ git commit
1207-------------------------------------------------
1208
1209Note that the commit message will already be filled in for you with
1210some information about the merge.  Normally you can just use this
1211default message unchanged, but you may add additional commentary of
1212your own if desired.
1213
1214[[undoing-a-merge]]
1215undoing a merge
1216---------------
1217
1218If you get stuck and decide to just give up and throw the whole mess
1219away, you can always return to the pre-merge state with
1220
1221-------------------------------------------------
1222$ git reset --hard HEAD
1223-------------------------------------------------
1224
1225Or, if you've already commited the merge that you want to throw away,
1226
1227-------------------------------------------------
1228$ git reset --hard HEAD^
1229-------------------------------------------------
1230
1231However, this last command can be dangerous in some cases--never
1232throw away a commit you have already committed if that commit may
1233itself have been merged into another branch, as doing so may confuse
1234further merges.
1235
1236Fast-forward merges
1237-------------------
1238
1239There is one special case not mentioned above, which is treated
1240differently.  Normally, a merge results in a merge commit, with two
1241parents, one pointing at each of the two lines of development that
1242were merged.
1243
1244However, if one of the two lines of development is completely
1245contained within the other--so every commit present in the one is
1246already contained in the other--then git just performs a
1247<<fast-forwards,fast forward>>; the head of the current branch is
1248moved forward to point at the head of the merged-in branch, without
1249any new commits being created.
1250
1251Fixing mistakes
1252---------------
1253
1254If you've messed up the working tree, but haven't yet committed your
1255mistake, you can return the entire working tree to the last committed
1256state with
1257
1258-------------------------------------------------
1259$ git reset --hard HEAD
1260-------------------------------------------------
1261
1262If you make a commit that you later wish you hadn't, there are two
1263fundamentally different ways to fix the problem:
1264
1265        1. You can create a new commit that undoes whatever was done
1266        by the previous commit.  This is the correct thing if your
1267        mistake has already been made public.
1268
1269        2. You can go back and modify the old commit.  You should
1270        never do this if you have already made the history public;
1271        git does not normally expect the "history" of a project to
1272        change, and cannot correctly perform repeated merges from
1273        a branch that has had its history changed.
1274
1275Fixing a mistake with a new commit
1276~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1277
1278Creating a new commit that reverts an earlier change is very easy;
1279just pass the gitlink:git-revert[1] command a reference to the bad
1280commit; for example, to revert the most recent commit:
1281
1282-------------------------------------------------
1283$ git revert HEAD
1284-------------------------------------------------
1285
1286This will create a new commit which undoes the change in HEAD.  You
1287will be given a chance to edit the commit message for the new commit.
1288
1289You can also revert an earlier change, for example, the next-to-last:
1290
1291-------------------------------------------------
1292$ git revert HEAD^
1293-------------------------------------------------
1294
1295In this case git will attempt to undo the old change while leaving
1296intact any changes made since then.  If more recent changes overlap
1297with the changes to be reverted, then you will be asked to fix
1298conflicts manually, just as in the case of <<resolving-a-merge,
1299resolving a merge>>.
1300
1301Fixing a mistake by editing history
1302~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1303
1304If the problematic commit is the most recent commit, and you have not
1305yet made that commit public, then you may just
1306<<undoing-a-merge,destroy it using git-reset>>.
1307
1308Alternatively, you
1309can edit the working directory and update the index to fix your
1310mistake, just as if you were going to <<how-to-make-a-commit,create a
1311new commit>>, then run
1312
1313-------------------------------------------------
1314$ git commit --amend
1315-------------------------------------------------
1316
1317which will replace the old commit by a new commit incorporating your
1318changes, giving you a chance to edit the old commit message first.
1319
1320Again, you should never do this to a commit that may already have
1321been merged into another branch; use gitlink:git-revert[1] instead in
1322that case.
1323
1324It is also possible to edit commits further back in the history, but
1325this is an advanced topic to be left for
1326<<cleaning-up-history,another chapter>>.
1327
1328Checking out an old version of a file
1329~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1330
1331In the process of undoing a previous bad change, you may find it
1332useful to check out an older version of a particular file using
1333gitlink:git-checkout[1].  We've used git checkout before to switch
1334branches, but it has quite different behavior if it is given a path
1335name: the command
1336
1337-------------------------------------------------
1338$ git checkout HEAD^ path/to/file
1339-------------------------------------------------
1340
1341replaces path/to/file by the contents it had in the commit HEAD^, and
1342also updates the index to match.  It does not change branches.
1343
1344If you just want to look at an old version of the file, without
1345modifying the working directory, you can do that with
1346gitlink:git-show[1]:
1347
1348-------------------------------------------------
1349$ git show HEAD^ path/to/file
1350-------------------------------------------------
1351
1352which will display the given version of the file.
1353
1354Ensuring good performance
1355-------------------------
1356
1357On large repositories, git depends on compression to keep the history
1358information from taking up to much space on disk or in memory.
1359
1360This compression is not performed automatically.  Therefore you
1361should occasionally run gitlink:git-gc[1]:
1362
1363-------------------------------------------------
1364$ git gc
1365-------------------------------------------------
1366
1367to recompress the archive.  This can be very time-consuming, so
1368you may prefer to run git-gc when you are not doing other work.
1369
1370Ensuring reliability
1371--------------------
1372
1373Checking the repository for corruption
1374~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1375
1376TODO:
1377        git-fsck
1378        "dangling objects" explanation
1379                Brief explanation here,
1380                include forward reference to longer explanation from
1381                        Linus, to be added to later chapter
1382
1383Recovering lost changes
1384~~~~~~~~~~~~~~~~~~~~~~~
1385
1386TODO:
1387        reflog
1388        git-fsck
1389        low-level examination of objects
1390
1391Sharing development with others
1392===============================
1393
1394[[getting-updates-with-git-pull]]
1395Getting updates with git pull
1396-----------------------------
1397
1398After you clone a repository and make a few changes of your own, you
1399may wish to check the original repository for updates and merge them
1400into your own work.
1401
1402We have already seen <<Updating-a-repository-with-git-fetch,how to
1403keep remote tracking branches up to date>> with gitlink:git-fetch[1],
1404and how to merge two branches.  So you can merge in changes from the
1405original repository's master branch with:
1406
1407-------------------------------------------------
1408$ git fetch
1409$ git merge origin/master
1410-------------------------------------------------
1411
1412However, the gitlink:git-pull[1] command provides a way to do this in
1413one step:
1414
1415-------------------------------------------------
1416$ git pull origin master
1417-------------------------------------------------
1418
1419In fact, "origin" is normally the default repository to pull from,
1420and the default branch is normally the HEAD of the remote repository,
1421so often you can accomplish the above with just
1422
1423-------------------------------------------------
1424$ git pull
1425-------------------------------------------------
1426
1427See the descriptions of the branch.<name>.remote and
1428branch.<name>.merge options in gitlink:git-repo-config[1] to learn
1429how to control these defaults depending on the current branch.
1430
1431In addition to saving you keystrokes, "git pull" also helps you by
1432producing a default commit message documenting the branch and
1433repository that you pulled from.
1434
1435(But note that no such commit will be created in the case of a
1436<<fast-forwards,fast forward>>; instead, your branch will just be
1437updated to point to the latest commit from the upstream branch).
1438
1439The git-pull command can also be given "." as the "remote" repository, in
1440which case it just merges in a branch from the current repository; so
1441the commands
1442
1443-------------------------------------------------
1444$ git pull . branch
1445$ git merge branch
1446-------------------------------------------------
1447
1448are roughly equivalent.  The former is actually very commonly used.
1449
1450Submitting patches to a project
1451-------------------------------
1452
1453If you just have a few changes, the simplest way to submit them may
1454just be to send them as patches in email:
1455
1456First, use gitlink:git-format-patches[1]; for example:
1457
1458-------------------------------------------------
1459$ git format-patch origin
1460-------------------------------------------------
1461
1462will produce a numbered series of files in the current directory, one
1463for each patch in the current branch but not in origin/HEAD.
1464
1465You can then import these into your mail client and send them by
1466hand.  However, if you have a lot to send at once, you may prefer to
1467use the gitlink:git-send-email[1] script to automate the process.
1468Consult the mailing list for your project first to determine how they
1469prefer such patches be handled.
1470
1471Importing patches to a project
1472------------------------------
1473
1474Git also provides a tool called gitlink:git-am[1] (am stands for
1475"apply mailbox"), for importing such an emailed series of patches.
1476Just save all of the patch-containing messages, in order, into a
1477single mailbox file, say "patches.mbox", then run
1478
1479-------------------------------------------------
1480$ git am -3 patches.mbox
1481-------------------------------------------------
1482
1483Git will apply each patch in order; if any conflicts are found, it
1484will stop, and you can fix the conflicts as described in
1485"<<resolving-a-merge,Resolving a merge>>".  (The "-3" option tells
1486git to perform a merge; if you would prefer it just to abort and
1487leave your tree and index untouched, you may omit that option.)
1488
1489Once the index is updated with the results of the conflict
1490resolution, instead of creating a new commit, just run
1491
1492-------------------------------------------------
1493$ git am --resolved
1494-------------------------------------------------
1495
1496and git will create the commit for you and continue applying the
1497remaining patches from the mailbox.
1498
1499The final result will be a series of commits, one for each patch in
1500the original mailbox, with authorship and commit log message each
1501taken from the message containing each patch.
1502
1503[[setting-up-a-public-repository]]
1504Setting up a public repository
1505------------------------------
1506
1507Another way to submit changes to a project is to simply tell the
1508maintainer of that project to pull from your repository, exactly as
1509you did in the section "<<getting-updates-with-git-pull, Getting
1510updates with git pull>>".
1511
1512If you and maintainer both have accounts on the same machine, then
1513then you can just pull changes from each other's repositories
1514directly; note that all of the command (gitlink:git-clone[1],
1515git-fetch[1], git-pull[1], etc.) which accept a URL as an argument
1516will also accept a local file patch; so, for example, you can
1517use
1518
1519-------------------------------------------------
1520$ git clone /path/to/repository
1521$ git pull /path/to/other/repository
1522-------------------------------------------------
1523
1524If this sort of setup is inconvenient or impossible, another (more
1525common) option is to set up a public repository on a public server.
1526This also allows you to cleanly separate private work in progress
1527from publicly visible work.
1528
1529You will continue to do your day-to-day work in your personal
1530repository, but periodically "push" changes from your personal
1531repository into your public repository, allowing other developers to
1532pull from that repository.  So the flow of changes, in a situation
1533where there is one other developer with a public repository, looks
1534like this:
1535
1536                        you push
1537  your personal repo ------------------> your public repo
1538        ^                                     |
1539        |                                     |
1540        | you pull                            | they pull
1541        |                                     |
1542        |                                     |
1543        |               they push             V
1544  their public repo <------------------- their repo
1545
1546Now, assume your personal repository is in the directory ~/proj.  We
1547first create a new clone of the repository:
1548
1549-------------------------------------------------
1550$ git clone --bare proj-clone.git
1551-------------------------------------------------
1552
1553The resulting directory proj-clone.git will contains a "bare" git
1554repository--it is just the contents of the ".git" directory, without
1555a checked-out copy of a working directory.
1556
1557Next, copy proj-clone.git to the server where you plan to host the
1558public repository.  You can use scp, rsync, or whatever is most
1559convenient.
1560
1561If somebody else maintains the public server, they may already have
1562set up a git service for you, and you may skip to the section
1563"<<pushing-changes-to-a-public-repository,Pushing changes to a public
1564repository>>", below.
1565
1566Otherwise, the following sections explain how to export your newly
1567created public repository:
1568
1569[[exporting-via-http]]
1570Exporting a git repository via http
1571-----------------------------------
1572
1573The git protocol gives better performance and reliability, but on a
1574host with a web server set up, http exports may be simpler to set up.
1575
1576All you need to do is place the newly created bare git repository in
1577a directory that is exported by the web server, and make some
1578adjustments to give web clients some extra information they need:
1579
1580-------------------------------------------------
1581$ mv proj.git /home/you/public_html/proj.git
1582$ cd proj.git
1583$ git update-server-info
1584$ chmod a+x hooks/post-update
1585-------------------------------------------------
1586
1587(For an explanation of the last two lines, see
1588gitlink:git-update-server-info[1], and the documentation
1589link:hooks.txt[Hooks used by git].)
1590
1591Advertise the url of proj.git.  Anybody else should then be able to
1592clone or pull from that url, for example with a commandline like:
1593
1594-------------------------------------------------
1595$ git clone http://yourserver.com/~you/proj.git
1596-------------------------------------------------
1597
1598(See also
1599link:howto/setup-git-server-over-http.txt[setup-git-server-over-http]
1600for a slightly more sophisticated setup using WebDAV which also
1601allows pushing over http.)
1602
1603[[exporting-via-git]]
1604Exporting a git repository via the git protocol
1605-----------------------------------------------
1606
1607This is the preferred method.
1608
1609For now, we refer you to the gitlink:git-daemon[1] man page for
1610instructions.  (See especially the examples section.)
1611
1612[[pushing-changes-to-a-public-repository]]
1613Pushing changes to a public repository
1614--------------------------------------
1615
1616Note that the two techniques outline above (exporting via
1617<<exporting-via-http,http>> or <<exporting-via-git,git>>) allow other
1618maintainers to fetch your latest changes, but they do not allow write
1619access, which you will need to update the public repository with the
1620latest changes created in your private repository.
1621
1622The simplest way to do this is using gitlink:git-push[1] and ssh; to
1623update the remote branch named "master" with the latest state of your
1624branch named "master", run
1625
1626-------------------------------------------------
1627$ git push ssh://yourserver.com/~you/proj.git master:master
1628-------------------------------------------------
1629
1630or just
1631
1632-------------------------------------------------
1633$ git push ssh://yourserver.com/~you/proj.git master
1634-------------------------------------------------
1635
1636As with git-fetch, git-push will complain if this does not result in
1637a <<fast-forwards,fast forward>>.  Normally this is a sign of
1638something wrong.  However, if you are sure you know what you're
1639doing, you may force git-push to perform the update anyway by
1640proceeding the branch name by a plus sign:
1641
1642-------------------------------------------------
1643$ git push ssh://yourserver.com/~you/proj.git +master
1644-------------------------------------------------
1645
1646As with git-fetch, you may also set up configuration options to
1647save typing; so, for example, after
1648
1649-------------------------------------------------
1650$ cat >.git/config <<EOF
1651[remote "public-repo"]
1652        url = ssh://yourserver.com/~you/proj.git
1653EOF
1654-------------------------------------------------
1655
1656you should be able to perform the above push with just
1657
1658-------------------------------------------------
1659$ git push public-repo master
1660-------------------------------------------------
1661
1662See the explanations of the remote.<name>.url, branch.<name>.remote,
1663and remote.<name>.push options in gitlink:git-repo-config[1] for
1664details.
1665
1666Setting up a shared repository
1667------------------------------
1668
1669Another way to collaborate is by using a model similar to that
1670commonly used in CVS, where several developers with special rights
1671all push to and pull from a single shared repository.  See
1672link:cvs-migration.txt[git for CVS users] for instructions on how to
1673set this up.
1674
1675Allow web browsing of a repository
1676----------------------------------
1677
1678TODO: Brief setup-instructions for gitweb
1679
1680Examples
1681--------
1682
1683TODO: topic branches, typical roles as in everyday.txt, ?
1684
1685
1686Working with other version control systems
1687==========================================
1688
1689TODO: CVS, Subversion, series-of-release-tarballs, etc.
1690
1691[[cleaning-up-history]]
1692Rewriting history and maintaining patch series
1693==============================================
1694
1695Normally commits are only added to a project, never taken away or
1696replaced.  Git is designed with this assumption, and violating it will
1697cause git's merge machinery (for example) to do the wrong thing.
1698
1699However, there is a situation in which it can be useful to violate this
1700assumption.
1701
1702Creating the perfect patch series
1703---------------------------------
1704
1705Suppose you are a contributor to a large project, and you want to add a
1706complicated feature, and to present it to the other developers in a way
1707that makes it easy for them to read your changes, verify that they are
1708correct, and understand why you made each change.
1709
1710If you present all of your changes as a single patch (or commit), they
1711may find it is too much to digest all at once.
1712
1713If you present them with the entire history of your work, complete with
1714mistakes, corrections, and dead ends, they may be overwhelmed.
1715
1716So the ideal is usually to produce a series of patches such that:
1717
1718        1. Each patch can be applied in order.
1719
1720        2. Each patch includes a single logical change, together with a
1721           message explaining the change.
1722
1723        3. No patch introduces a regression: after applying any initial
1724           part of the series, the resulting project still compiles and
1725           works, and has no bugs that it didn't have before.
1726
1727        4. The complete series produces the same end result as your own
1728           (probably much messier!) development process did.
1729
1730We will introduce some tools that can help you do this, explain how to
1731use them, and then explain some of the problems that can arise because
1732you are rewriting history.
1733
1734Keeping a patch series up to date using git-rebase
1735--------------------------------------------------
1736
1737Suppose you have a series of commits in a branch "mywork", which
1738originally branched off from "origin".
1739
1740Suppose you create a branch "mywork" on a remote-tracking branch
1741"origin", and created some commits on top of it:
1742
1743-------------------------------------------------
1744$ git checkout -b mywork origin
1745$ vi file.txt
1746$ git commit
1747$ vi otherfile.txt
1748$ git commit
1749...
1750-------------------------------------------------
1751
1752You have performed no merges into mywork, so it is just a simple linear
1753sequence of patches on top of "origin":
1754
1755
1756 o--o--o <-- origin
1757        \
1758         o--o--o <-- mywork
1759
1760Some more interesting work has been done in the upstream project, and
1761"origin" has advanced:
1762
1763 o--o--O--o--o--o <-- origin
1764        \
1765         a--b--c <-- mywork
1766
1767At this point, you could use "pull" to merge your changes back in;
1768the result would create a new merge commit, like this:
1769
1770
1771 o--o--O--o--o--o <-- origin
1772        \        \
1773         a--b--c--m <-- mywork
1774 
1775However, if you prefer to keep the history in mywork a simple series of
1776commits without any merges, you may instead choose to use
1777gitlink:git-rebase[1]:
1778
1779-------------------------------------------------
1780$ git checkout mywork
1781$ git rebase origin
1782-------------------------------------------------
1783
1784This will remove each of your commits from mywork, temporarily saving
1785them as patches (in a directory named ".dotest"), update mywork to
1786point at the latest version of origin, then apply each of the saved
1787patches to the new mywork.  The result will look like:
1788
1789
1790 o--o--O--o--o--o <-- origin
1791                 \
1792                  a'--b'--c' <-- mywork
1793
1794In the process, it may discover conflicts.  In that case it will stop
1795and allow you to fix the conflicts; after fixing conflicts, use "git
1796add" to update the index with those contents, and then, instead of
1797running git-commit, just run
1798
1799-------------------------------------------------
1800$ git rebase --continue
1801-------------------------------------------------
1802
1803and git will continue applying the rest of the patches.
1804
1805At any point you may use the --abort option to abort this process and
1806return mywork to the state it had before you started the rebase:
1807
1808-------------------------------------------------
1809$ git rebase --abort
1810-------------------------------------------------
1811
1812Reordering or selecting from a patch series
1813-------------------------------------------
1814
1815Given one existing commit, the gitlink:git-cherry-pick[1] command
1816allows you to apply the change introduced by that commit and create a
1817new commit that records it.  So, for example, if "mywork" points to a
1818series of patches on top of "origin", you might do something like:
1819
1820-------------------------------------------------
1821$ git checkout -b mywork-new origin
1822$ gitk origin..mywork &
1823-------------------------------------------------
1824
1825And browse through the list of patches in the mywork branch using gitk,
1826applying them (possibly in a different order) to mywork-new using
1827cherry-pick, and possibly modifying them as you go using commit
1828--amend.
1829
1830Another technique is to use git-format-patch to create a series of
1831patches, then reset the state to before the patches:
1832
1833-------------------------------------------------
1834$ git format-patch origin
1835$ git reset --hard origin
1836-------------------------------------------------
1837
1838Then modify, reorder, or eliminate patches as preferred before applying
1839them again with gitlink:git-am[1].
1840
1841Other tools
1842-----------
1843
1844There are numerous other tools, such as stgit, which exist for the
1845purpose of maintaining a patch series.  These are out of the scope of
1846this manual.
1847
1848Problems with rewriting history
1849-------------------------------
1850
1851The primary problem with rewriting the history of a branch has to do
1852with merging.  Suppose somebody fetches your branch and merges it into
1853their branch, with a result something like this:
1854
1855 o--o--O--o--o--o <-- origin
1856        \        \
1857         t--t--t--m <-- their branch:
1858
1859Then suppose you modify the last three commits:
1860
1861         o--o--o <-- new head of origin
1862        /
1863 o--o--O--o--o--o <-- old head of origin
1864
1865If we examined all this history together in one repository, it will
1866look like:
1867
1868         o--o--o <-- new head of origin
1869        /
1870 o--o--O--o--o--o <-- old head of origin
1871        \        \
1872         t--t--t--m <-- their branch:
1873
1874Git has no way of knowing that the new head is an updated version of
1875the old head; it treats this situation exactly the same as it would if
1876two developers had independently done the work on the old and new heads
1877in parallel.  At this point, if someone attempts to merge the new head
1878in to their branch, git will attempt to merge together the two (old and
1879new) lines of development, instead of trying to replace the old by the
1880new.  The results are likely to be unexpected.
1881
1882You may still choose to publish branches whose history is rewritten,
1883and it may be useful for others to be able to fetch those branches in
1884order to examine or test them, but they should not attempt to pull such
1885branches into their own work.
1886
1887For true distributed development that supports proper merging,
1888published branches should never be rewritten.
1889
1890Advanced branch management
1891==========================
1892
1893Fetching individual branches
1894----------------------------
1895
1896Instead of using gitlink:git-remote[1], you can also choose just
1897to update one branch at a time, and to store it locally under an
1898arbitrary name:
1899
1900-------------------------------------------------
1901$ git fetch origin todo:my-todo-work
1902-------------------------------------------------
1903
1904The first argument, "origin", just tells git to fetch from the
1905repository you originally cloned from.  The second argument tells git
1906to fetch the branch named "todo" from the remote repository, and to
1907store it locally under the name refs/heads/my-todo-work.
1908
1909You can also fetch branches from other repositories; so
1910
1911-------------------------------------------------
1912$ git fetch git://example.com/proj.git master:example-master
1913-------------------------------------------------
1914
1915will create a new branch named "example-master" and store in it the
1916branch named "master" from the repository at the given URL.  If you
1917already have a branch named example-master, it will attempt to
1918"fast-forward" to the commit given by example.com's master branch.  So
1919next we explain what a fast-forward is:
1920
1921[[fast-forwards]]
1922Understanding git history: fast-forwards
1923----------------------------------------
1924
1925In the previous example, when updating an existing branch, "git
1926fetch" checks to make sure that the most recent commit on the remote
1927branch is a descendant of the most recent commit on your copy of the
1928branch before updating your copy of the branch to point at the new
1929commit.  Git calls this process a "fast forward".
1930
1931A fast forward looks something like this:
1932
1933 o--o--o--o <-- old head of the branch
1934           \
1935            o--o--o <-- new head of the branch
1936
1937
1938In some cases it is possible that the new head will *not* actually be
1939a descendant of the old head.  For example, the developer may have
1940realized she made a serious mistake, and decided to backtrack,
1941resulting in a situation like:
1942
1943 o--o--o--o--a--b <-- old head of the branch
1944           \
1945            o--o--o <-- new head of the branch
1946
1947
1948
1949In this case, "git fetch" will fail, and print out a warning.
1950
1951In that case, you can still force git to update to the new head, as
1952described in the following section.  However, note that in the
1953situation above this may mean losing the commits labeled "a" and "b",
1954unless you've already created a reference of your own pointing to
1955them.
1956
1957Forcing git fetch to do non-fast-forward updates
1958------------------------------------------------
1959
1960If git fetch fails because the new head of a branch is not a
1961descendant of the old head, you may force the update with:
1962
1963-------------------------------------------------
1964$ git fetch git://example.com/proj.git +master:refs/remotes/example/master
1965-------------------------------------------------
1966
1967Note the addition of the "+" sign.  Be aware that commits which the
1968old version of example/master pointed at may be lost, as we saw in
1969the previous section.
1970
1971Configuring remote branches
1972---------------------------
1973
1974We saw above that "origin" is just a shortcut to refer to the
1975repository which you originally cloned from.  This information is
1976stored in git configuration variables, which you can see using
1977gitlink:git-repo-config[1]:
1978
1979-------------------------------------------------
1980$ git-repo-config -l
1981core.repositoryformatversion=0
1982core.filemode=true
1983core.logallrefupdates=true
1984remote.origin.url=git://git.kernel.org/pub/scm/git/git.git
1985remote.origin.fetch=+refs/heads/*:refs/remotes/origin/*
1986branch.master.remote=origin
1987branch.master.merge=refs/heads/master
1988-------------------------------------------------
1989
1990If there are other repositories that you also use frequently, you can
1991create similar configuration options to save typing; for example,
1992after
1993
1994-------------------------------------------------
1995$ git repo-config remote.example.url git://example.com/proj.git
1996-------------------------------------------------
1997
1998then the following two commands will do the same thing:
1999
2000-------------------------------------------------
2001$ git fetch git://example.com/proj.git master:refs/remotes/example/master
2002$ git fetch example master:refs/remotes/example/master
2003-------------------------------------------------
2004
2005Even better, if you add one more option:
2006
2007-------------------------------------------------
2008$ git repo-config remote.example.fetch master:refs/remotes/example/master
2009-------------------------------------------------
2010
2011then the following commands will all do the same thing:
2012
2013-------------------------------------------------
2014$ git fetch git://example.com/proj.git master:ref/remotes/example/master
2015$ git fetch example master:ref/remotes/example/master
2016$ git fetch example example/master
2017$ git fetch example
2018-------------------------------------------------
2019
2020You can also add a "+" to force the update each time:
2021
2022-------------------------------------------------
2023$ git repo-config remote.example.fetch +master:ref/remotes/example/master
2024-------------------------------------------------
2025
2026Don't do this unless you're sure you won't mind "git fetch" possibly
2027throwing away commits on mybranch.
2028
2029Also note that all of the above configuration can be performed by
2030directly editing the file .git/config instead of using
2031gitlink:git-repo-config[1].
2032
2033See gitlink:git-repo-config[1] for more details on the configuration
2034options mentioned above.
2035
2036
2037Git internals
2038=============
2039
2040There are two object abstractions: the "object database", and the
2041"current directory cache" aka "index".
2042
2043The Object Database
2044-------------------
2045
2046The object database is literally just a content-addressable collection
2047of objects.  All objects are named by their content, which is
2048approximated by the SHA1 hash of the object itself.  Objects may refer
2049to other objects (by referencing their SHA1 hash), and so you can
2050build up a hierarchy of objects.
2051
2052All objects have a statically determined "type" aka "tag", which is
2053determined at object creation time, and which identifies the format of
2054the object (i.e. how it is used, and how it can refer to other
2055objects).  There are currently four different object types: "blob",
2056"tree", "commit" and "tag".
2057
2058A "blob" object cannot refer to any other object, and is, like the type
2059implies, a pure storage object containing some user data.  It is used to
2060actually store the file data, i.e. a blob object is associated with some
2061particular version of some file. 
2062
2063A "tree" object is an object that ties one or more "blob" objects into a
2064directory structure. In addition, a tree object can refer to other tree
2065objects, thus creating a directory hierarchy. 
2066
2067A "commit" object ties such directory hierarchies together into
2068a DAG of revisions - each "commit" is associated with exactly one tree
2069(the directory hierarchy at the time of the commit). In addition, a
2070"commit" refers to one or more "parent" commit objects that describe the
2071history of how we arrived at that directory hierarchy.
2072
2073As a special case, a commit object with no parents is called the "root"
2074object, and is the point of an initial project commit.  Each project
2075must have at least one root, and while you can tie several different
2076root objects together into one project by creating a commit object which
2077has two or more separate roots as its ultimate parents, that's probably
2078just going to confuse people.  So aim for the notion of "one root object
2079per project", even if git itself does not enforce that. 
2080
2081A "tag" object symbolically identifies and can be used to sign other
2082objects. It contains the identifier and type of another object, a
2083symbolic name (of course!) and, optionally, a signature.
2084
2085Regardless of object type, all objects share the following
2086characteristics: they are all deflated with zlib, and have a header
2087that not only specifies their type, but also provides size information
2088about the data in the object.  It's worth noting that the SHA1 hash
2089that is used to name the object is the hash of the original data
2090plus this header, so `sha1sum` 'file' does not match the object name
2091for 'file'.
2092(Historical note: in the dawn of the age of git the hash
2093was the sha1 of the 'compressed' object.)
2094
2095As a result, the general consistency of an object can always be tested
2096independently of the contents or the type of the object: all objects can
2097be validated by verifying that (a) their hashes match the content of the
2098file and (b) the object successfully inflates to a stream of bytes that
2099forms a sequence of <ascii type without space> + <space> + <ascii decimal
2100size> + <byte\0> + <binary object data>. 
2101
2102The structured objects can further have their structure and
2103connectivity to other objects verified. This is generally done with
2104the `git-fsck-objects` program, which generates a full dependency graph
2105of all objects, and verifies their internal consistency (in addition
2106to just verifying their superficial consistency through the hash).
2107
2108The object types in some more detail:
2109
2110Blob Object
2111-----------
2112
2113A "blob" object is nothing but a binary blob of data, and doesn't
2114refer to anything else.  There is no signature or any other
2115verification of the data, so while the object is consistent (it 'is'
2116indexed by its sha1 hash, so the data itself is certainly correct), it
2117has absolutely no other attributes.  No name associations, no
2118permissions.  It is purely a blob of data (i.e. normally "file
2119contents").
2120
2121In particular, since the blob is entirely defined by its data, if two
2122files in a directory tree (or in multiple different versions of the
2123repository) have the same contents, they will share the same blob
2124object. The object is totally independent of its location in the
2125directory tree, and renaming a file does not change the object that
2126file is associated with in any way.
2127
2128A blob is typically created when gitlink:git-update-index[1]
2129is run, and its data can be accessed by gitlink:git-cat-file[1].
2130
2131Tree Object
2132-----------
2133
2134The next hierarchical object type is the "tree" object.  A tree object
2135is a list of mode/name/blob data, sorted by name.  Alternatively, the
2136mode data may specify a directory mode, in which case instead of
2137naming a blob, that name is associated with another TREE object.
2138
2139Like the "blob" object, a tree object is uniquely determined by the
2140set contents, and so two separate but identical trees will always
2141share the exact same object. This is true at all levels, i.e. it's
2142true for a "leaf" tree (which does not refer to any other trees, only
2143blobs) as well as for a whole subdirectory.
2144
2145For that reason a "tree" object is just a pure data abstraction: it
2146has no history, no signatures, no verification of validity, except
2147that since the contents are again protected by the hash itself, we can
2148trust that the tree is immutable and its contents never change.
2149
2150So you can trust the contents of a tree to be valid, the same way you
2151can trust the contents of a blob, but you don't know where those
2152contents 'came' from.
2153
2154Side note on trees: since a "tree" object is a sorted list of
2155"filename+content", you can create a diff between two trees without
2156actually having to unpack two trees.  Just ignore all common parts,
2157and your diff will look right.  In other words, you can effectively
2158(and efficiently) tell the difference between any two random trees by
2159O(n) where "n" is the size of the difference, rather than the size of
2160the tree.
2161
2162Side note 2 on trees: since the name of a "blob" depends entirely and
2163exclusively on its contents (i.e. there are no names or permissions
2164involved), you can see trivial renames or permission changes by
2165noticing that the blob stayed the same.  However, renames with data
2166changes need a smarter "diff" implementation.
2167
2168A tree is created with gitlink:git-write-tree[1] and
2169its data can be accessed by gitlink:git-ls-tree[1].
2170Two trees can be compared with gitlink:git-diff-tree[1].
2171
2172Commit Object
2173-------------
2174
2175The "commit" object is an object that introduces the notion of
2176history into the picture.  In contrast to the other objects, it
2177doesn't just describe the physical state of a tree, it describes how
2178we got there, and why.
2179
2180A "commit" is defined by the tree-object that it results in, the
2181parent commits (zero, one or more) that led up to that point, and a
2182comment on what happened.  Again, a commit is not trusted per se:
2183the contents are well-defined and "safe" due to the cryptographically
2184strong signatures at all levels, but there is no reason to believe
2185that the tree is "good" or that the merge information makes sense.
2186The parents do not have to actually have any relationship with the
2187result, for example.
2188
2189Note on commits: unlike real SCM's, commits do not contain
2190rename information or file mode change information.  All of that is
2191implicit in the trees involved (the result tree, and the result trees
2192of the parents), and describing that makes no sense in this idiotic
2193file manager.
2194
2195A commit is created with gitlink:git-commit-tree[1] and
2196its data can be accessed by gitlink:git-cat-file[1].
2197
2198Trust
2199-----
2200
2201An aside on the notion of "trust". Trust is really outside the scope
2202of "git", but it's worth noting a few things.  First off, since
2203everything is hashed with SHA1, you 'can' trust that an object is
2204intact and has not been messed with by external sources.  So the name
2205of an object uniquely identifies a known state - just not a state that
2206you may want to trust.
2207
2208Furthermore, since the SHA1 signature of a commit refers to the
2209SHA1 signatures of the tree it is associated with and the signatures
2210of the parent, a single named commit specifies uniquely a whole set
2211of history, with full contents.  You can't later fake any step of the
2212way once you have the name of a commit.
2213
2214So to introduce some real trust in the system, the only thing you need
2215to do is to digitally sign just 'one' special note, which includes the
2216name of a top-level commit.  Your digital signature shows others
2217that you trust that commit, and the immutability of the history of
2218commits tells others that they can trust the whole history.
2219
2220In other words, you can easily validate a whole archive by just
2221sending out a single email that tells the people the name (SHA1 hash)
2222of the top commit, and digitally sign that email using something
2223like GPG/PGP.
2224
2225To assist in this, git also provides the tag object...
2226
2227Tag Object
2228----------
2229
2230Git provides the "tag" object to simplify creating, managing and
2231exchanging symbolic and signed tokens.  The "tag" object at its
2232simplest simply symbolically identifies another object by containing
2233the sha1, type and symbolic name.
2234
2235However it can optionally contain additional signature information
2236(which git doesn't care about as long as there's less than 8k of
2237it). This can then be verified externally to git.
2238
2239Note that despite the tag features, "git" itself only handles content
2240integrity; the trust framework (and signature provision and
2241verification) has to come from outside.
2242
2243A tag is created with gitlink:git-mktag[1],
2244its data can be accessed by gitlink:git-cat-file[1],
2245and the signature can be verified by
2246gitlink:git-verify-tag[1].
2247
2248
2249The "index" aka "Current Directory Cache"
2250-----------------------------------------
2251
2252The index is a simple binary file, which contains an efficient
2253representation of a virtual directory content at some random time.  It
2254does so by a simple array that associates a set of names, dates,
2255permissions and content (aka "blob") objects together.  The cache is
2256always kept ordered by name, and names are unique (with a few very
2257specific rules) at any point in time, but the cache has no long-term
2258meaning, and can be partially updated at any time.
2259
2260In particular, the index certainly does not need to be consistent with
2261the current directory contents (in fact, most operations will depend on
2262different ways to make the index 'not' be consistent with the directory
2263hierarchy), but it has three very important attributes:
2264
2265'(a) it can re-generate the full state it caches (not just the
2266directory structure: it contains pointers to the "blob" objects so
2267that it can regenerate the data too)'
2268
2269As a special case, there is a clear and unambiguous one-way mapping
2270from a current directory cache to a "tree object", which can be
2271efficiently created from just the current directory cache without
2272actually looking at any other data.  So a directory cache at any one
2273time uniquely specifies one and only one "tree" object (but has
2274additional data to make it easy to match up that tree object with what
2275has happened in the directory)
2276
2277'(b) it has efficient methods for finding inconsistencies between that
2278cached state ("tree object waiting to be instantiated") and the
2279current state.'
2280
2281'(c) it can additionally efficiently represent information about merge
2282conflicts between different tree objects, allowing each pathname to be
2283associated with sufficient information about the trees involved that
2284you can create a three-way merge between them.'
2285
2286Those are the three ONLY things that the directory cache does.  It's a
2287cache, and the normal operation is to re-generate it completely from a
2288known tree object, or update/compare it with a live tree that is being
2289developed.  If you blow the directory cache away entirely, you generally
2290haven't lost any information as long as you have the name of the tree
2291that it described. 
2292
2293At the same time, the index is at the same time also the
2294staging area for creating new trees, and creating a new tree always
2295involves a controlled modification of the index file.  In particular,
2296the index file can have the representation of an intermediate tree that
2297has not yet been instantiated.  So the index can be thought of as a
2298write-back cache, which can contain dirty information that has not yet
2299been written back to the backing store.
2300
2301
2302
2303The Workflow
2304------------
2305
2306Generally, all "git" operations work on the index file. Some operations
2307work *purely* on the index file (showing the current state of the
2308index), but most operations move data to and from the index file. Either
2309from the database or from the working directory. Thus there are four
2310main combinations: 
2311
2312working directory -> index
2313~~~~~~~~~~~~~~~~~~~~~~~~~~
2314
2315You update the index with information from the working directory with
2316the gitlink:git-update-index[1] command.  You
2317generally update the index information by just specifying the filename
2318you want to update, like so:
2319
2320-------------------------------------------------
2321$ git-update-index filename
2322-------------------------------------------------
2323
2324but to avoid common mistakes with filename globbing etc, the command
2325will not normally add totally new entries or remove old entries,
2326i.e. it will normally just update existing cache entries.
2327
2328To tell git that yes, you really do realize that certain files no
2329longer exist, or that new files should be added, you
2330should use the `--remove` and `--add` flags respectively.
2331
2332NOTE! A `--remove` flag does 'not' mean that subsequent filenames will
2333necessarily be removed: if the files still exist in your directory
2334structure, the index will be updated with their new status, not
2335removed. The only thing `--remove` means is that update-cache will be
2336considering a removed file to be a valid thing, and if the file really
2337does not exist any more, it will update the index accordingly.
2338
2339As a special case, you can also do `git-update-index --refresh`, which
2340will refresh the "stat" information of each index to match the current
2341stat information. It will 'not' update the object status itself, and
2342it will only update the fields that are used to quickly test whether
2343an object still matches its old backing store object.
2344
2345index -> object database
2346~~~~~~~~~~~~~~~~~~~~~~~~
2347
2348You write your current index file to a "tree" object with the program
2349
2350-------------------------------------------------
2351$ git-write-tree
2352-------------------------------------------------
2353
2354that doesn't come with any options - it will just write out the
2355current index into the set of tree objects that describe that state,
2356and it will return the name of the resulting top-level tree. You can
2357use that tree to re-generate the index at any time by going in the
2358other direction:
2359
2360object database -> index
2361~~~~~~~~~~~~~~~~~~~~~~~~
2362
2363You read a "tree" file from the object database, and use that to
2364populate (and overwrite - don't do this if your index contains any
2365unsaved state that you might want to restore later!) your current
2366index.  Normal operation is just
2367
2368-------------------------------------------------
2369$ git-read-tree <sha1 of tree>
2370-------------------------------------------------
2371
2372and your index file will now be equivalent to the tree that you saved
2373earlier. However, that is only your 'index' file: your working
2374directory contents have not been modified.
2375
2376index -> working directory
2377~~~~~~~~~~~~~~~~~~~~~~~~~~
2378
2379You update your working directory from the index by "checking out"
2380files. This is not a very common operation, since normally you'd just
2381keep your files updated, and rather than write to your working
2382directory, you'd tell the index files about the changes in your
2383working directory (i.e. `git-update-index`).
2384
2385However, if you decide to jump to a new version, or check out somebody
2386else's version, or just restore a previous tree, you'd populate your
2387index file with read-tree, and then you need to check out the result
2388with
2389
2390-------------------------------------------------
2391$ git-checkout-index filename
2392-------------------------------------------------
2393
2394or, if you want to check out all of the index, use `-a`.
2395
2396NOTE! git-checkout-index normally refuses to overwrite old files, so
2397if you have an old version of the tree already checked out, you will
2398need to use the "-f" flag ('before' the "-a" flag or the filename) to
2399'force' the checkout.
2400
2401
2402Finally, there are a few odds and ends which are not purely moving
2403from one representation to the other:
2404
2405Tying it all together
2406~~~~~~~~~~~~~~~~~~~~~
2407
2408To commit a tree you have instantiated with "git-write-tree", you'd
2409create a "commit" object that refers to that tree and the history
2410behind it - most notably the "parent" commits that preceded it in
2411history.
2412
2413Normally a "commit" has one parent: the previous state of the tree
2414before a certain change was made. However, sometimes it can have two
2415or more parent commits, in which case we call it a "merge", due to the
2416fact that such a commit brings together ("merges") two or more
2417previous states represented by other commits.
2418
2419In other words, while a "tree" represents a particular directory state
2420of a working directory, a "commit" represents that state in "time",
2421and explains how we got there.
2422
2423You create a commit object by giving it the tree that describes the
2424state at the time of the commit, and a list of parents:
2425
2426-------------------------------------------------
2427$ git-commit-tree <tree> -p <parent> [-p <parent2> ..]
2428-------------------------------------------------
2429
2430and then giving the reason for the commit on stdin (either through
2431redirection from a pipe or file, or by just typing it at the tty).
2432
2433git-commit-tree will return the name of the object that represents
2434that commit, and you should save it away for later use. Normally,
2435you'd commit a new `HEAD` state, and while git doesn't care where you
2436save the note about that state, in practice we tend to just write the
2437result to the file pointed at by `.git/HEAD`, so that we can always see
2438what the last committed state was.
2439
2440Here is an ASCII art by Jon Loeliger that illustrates how
2441various pieces fit together.
2442
2443------------
2444
2445                     commit-tree
2446                      commit obj
2447                       +----+
2448                       |    |
2449                       |    |
2450                       V    V
2451                    +-----------+
2452                    | Object DB |
2453                    |  Backing  |
2454                    |   Store   |
2455                    +-----------+
2456                       ^
2457           write-tree  |     |
2458             tree obj  |     |
2459                       |     |  read-tree
2460                       |     |  tree obj
2461                             V
2462                    +-----------+
2463                    |   Index   |
2464                    |  "cache"  |
2465                    +-----------+
2466         update-index  ^
2467             blob obj  |     |
2468                       |     |
2469    checkout-index -u  |     |  checkout-index
2470             stat      |     |  blob obj
2471                             V
2472                    +-----------+
2473                    |  Working  |
2474                    | Directory |
2475                    +-----------+
2476
2477------------
2478
2479
2480Examining the data
2481------------------
2482
2483You can examine the data represented in the object database and the
2484index with various helper tools. For every object, you can use
2485gitlink:git-cat-file[1] to examine details about the
2486object:
2487
2488-------------------------------------------------
2489$ git-cat-file -t <objectname>
2490-------------------------------------------------
2491
2492shows the type of the object, and once you have the type (which is
2493usually implicit in where you find the object), you can use
2494
2495-------------------------------------------------
2496$ git-cat-file blob|tree|commit|tag <objectname>
2497-------------------------------------------------
2498
2499to show its contents. NOTE! Trees have binary content, and as a result
2500there is a special helper for showing that content, called
2501`git-ls-tree`, which turns the binary content into a more easily
2502readable form.
2503
2504It's especially instructive to look at "commit" objects, since those
2505tend to be small and fairly self-explanatory. In particular, if you
2506follow the convention of having the top commit name in `.git/HEAD`,
2507you can do
2508
2509-------------------------------------------------
2510$ git-cat-file commit HEAD
2511-------------------------------------------------
2512
2513to see what the top commit was.
2514
2515Merging multiple trees
2516----------------------
2517
2518Git helps you do a three-way merge, which you can expand to n-way by
2519repeating the merge procedure arbitrary times until you finally
2520"commit" the state.  The normal situation is that you'd only do one
2521three-way merge (two parents), and commit it, but if you like to, you
2522can do multiple parents in one go.
2523
2524To do a three-way merge, you need the two sets of "commit" objects
2525that you want to merge, use those to find the closest common parent (a
2526third "commit" object), and then use those commit objects to find the
2527state of the directory ("tree" object) at these points.
2528
2529To get the "base" for the merge, you first look up the common parent
2530of two commits with
2531
2532-------------------------------------------------
2533$ git-merge-base <commit1> <commit2>
2534-------------------------------------------------
2535
2536which will return you the commit they are both based on.  You should
2537now look up the "tree" objects of those commits, which you can easily
2538do with (for example)
2539
2540-------------------------------------------------
2541$ git-cat-file commit <commitname> | head -1
2542-------------------------------------------------
2543
2544since the tree object information is always the first line in a commit
2545object.
2546
2547Once you know the three trees you are going to merge (the one
2548"original" tree, aka the common case, and the two "result" trees, aka
2549the branches you want to merge), you do a "merge" read into the
2550index. This will complain if it has to throw away your old index contents, so you should
2551make sure that you've committed those - in fact you would normally
2552always do a merge against your last commit (which should thus match
2553what you have in your current index anyway).
2554
2555To do the merge, do
2556
2557-------------------------------------------------
2558$ git-read-tree -m -u <origtree> <yourtree> <targettree>
2559-------------------------------------------------
2560
2561which will do all trivial merge operations for you directly in the
2562index file, and you can just write the result out with
2563`git-write-tree`.
2564
2565
2566Merging multiple trees, continued
2567---------------------------------
2568
2569Sadly, many merges aren't trivial. If there are files that have
2570been added.moved or removed, or if both branches have modified the
2571same file, you will be left with an index tree that contains "merge
2572entries" in it. Such an index tree can 'NOT' be written out to a tree
2573object, and you will have to resolve any such merge clashes using
2574other tools before you can write out the result.
2575
2576You can examine such index state with `git-ls-files --unmerged`
2577command.  An example:
2578
2579------------------------------------------------
2580$ git-read-tree -m $orig HEAD $target
2581$ git-ls-files --unmerged
2582100644 263414f423d0e4d70dae8fe53fa34614ff3e2860 1       hello.c
2583100644 06fa6a24256dc7e560efa5687fa84b51f0263c3a 2       hello.c
2584100644 cc44c73eb783565da5831b4d820c962954019b69 3       hello.c
2585------------------------------------------------
2586
2587Each line of the `git-ls-files --unmerged` output begins with
2588the blob mode bits, blob SHA1, 'stage number', and the
2589filename.  The 'stage number' is git's way to say which tree it
2590came from: stage 1 corresponds to `$orig` tree, stage 2 `HEAD`
2591tree, and stage3 `$target` tree.
2592
2593Earlier we said that trivial merges are done inside
2594`git-read-tree -m`.  For example, if the file did not change
2595from `$orig` to `HEAD` nor `$target`, or if the file changed
2596from `$orig` to `HEAD` and `$orig` to `$target` the same way,
2597obviously the final outcome is what is in `HEAD`.  What the
2598above example shows is that file `hello.c` was changed from
2599`$orig` to `HEAD` and `$orig` to `$target` in a different way.
2600You could resolve this by running your favorite 3-way merge
2601program, e.g.  `diff3` or `merge`, on the blob objects from
2602these three stages yourself, like this:
2603
2604------------------------------------------------
2605$ git-cat-file blob 263414f... >hello.c~1
2606$ git-cat-file blob 06fa6a2... >hello.c~2
2607$ git-cat-file blob cc44c73... >hello.c~3
2608$ merge hello.c~2 hello.c~1 hello.c~3
2609------------------------------------------------
2610
2611This would leave the merge result in `hello.c~2` file, along
2612with conflict markers if there are conflicts.  After verifying
2613the merge result makes sense, you can tell git what the final
2614merge result for this file is by:
2615
2616-------------------------------------------------
2617$ mv -f hello.c~2 hello.c
2618$ git-update-index hello.c
2619-------------------------------------------------
2620
2621When a path is in unmerged state, running `git-update-index` for
2622that path tells git to mark the path resolved.
2623
2624The above is the description of a git merge at the lowest level,
2625to help you understand what conceptually happens under the hood.
2626In practice, nobody, not even git itself, uses three `git-cat-file`
2627for this.  There is `git-merge-index` program that extracts the
2628stages to temporary files and calls a "merge" script on it:
2629
2630-------------------------------------------------
2631$ git-merge-index git-merge-one-file hello.c
2632-------------------------------------------------
2633
2634and that is what higher level `git resolve` is implemented with.
2635
2636How git stores objects efficiently: pack files
2637----------------------------------------------
2638
2639We've seen how git stores each object in a file named after the
2640object's SHA1 hash.
2641
2642Unfortunately this system becomes inefficient once a project has a
2643lot of objects.  Try this on an old project:
2644
2645------------------------------------------------
2646$ git count-objects
26476930 objects, 47620 kilobytes
2648------------------------------------------------
2649
2650The first number is the number of objects which are kept in
2651individual files.  The second is the amount of space taken up by
2652those "loose" objects.
2653
2654You can save space and make git faster by moving these loose objects in
2655to a "pack file", which stores a group of objects in an efficient
2656compressed format; the details of how pack files are formatted can be
2657found in link:technical/pack-format.txt[technical/pack-format.txt].
2658
2659To put the loose objects into a pack, just run git repack:
2660
2661------------------------------------------------
2662$ git repack
2663Generating pack...
2664Done counting 6020 objects.
2665Deltifying 6020 objects.
2666 100% (6020/6020) done
2667Writing 6020 objects.
2668 100% (6020/6020) done
2669Total 6020, written 6020 (delta 4070), reused 0 (delta 0)
2670Pack pack-3e54ad29d5b2e05838c75df582c65257b8d08e1c created.
2671------------------------------------------------
2672
2673You can then run
2674
2675------------------------------------------------
2676$ git prune
2677------------------------------------------------
2678
2679to remove any of the "loose" objects that are now contained in the
2680pack.  This will also remove any unreferenced objects (which may be
2681created when, for example, you use "git reset" to remove a commit).
2682You can verify that the loose objects are gone by looking at the
2683.git/objects directory or by running
2684
2685------------------------------------------------
2686$ git count-objects
26870 objects, 0 kilobytes
2688------------------------------------------------
2689
2690Although the object files are gone, any commands that refer to those
2691objects will work exactly as they did before.
2692
2693The gitlink:git-gc[1] command performs packing, pruning, and more for
2694you, so is normally the only high-level command you need.
2695
2696Glossary of git terms
2697=====================
2698
2699include::glossary.txt[]
2700
2701Notes and todo list for this manual
2702===================================
2703
2704This is a work in progress.
2705
2706The basic requirements:
2707        - It must be readable in order, from beginning to end, by
2708          someone intelligent with a basic grasp of the unix
2709          commandline, but without any special knowledge of git.  If
2710          necessary, any other prerequisites should be specifically
2711          mentioned as they arise.
2712        - Whenever possible, section headings should clearly describe
2713          the task they explain how to do, in language that requires
2714          no more knowledge than necessary: for example, "importing
2715          patches into a project" rather than "the git-am command"
2716
2717Think about how to create a clear chapter dependency graph that will
2718allow people to get to important topics without necessarily reading
2719everything in between.
2720
2721Scan Documentation/ for other stuff left out; in particular:
2722        howto's
2723        README
2724        some of technical/?
2725        hooks
2726        etc.
2727
2728Scan email archives for other stuff left out
2729
2730Scan man pages to see if any assume more background than this manual
2731provides.
2732
2733Simplify beginning by suggesting disconnected head instead of
2734temporary branch creation?
2735
2736Explain how to refer to file stages in the "how to resolve a merge"
2737section: diff -1, -2, -3, --ours, --theirs :1:/path notation.  The
2738"git ls-files --unmerged --stage" thing is sorta useful too,
2739actually.  And note gitk --merge.
2740
2741Add more good examples.  Entire sections of just cookbook examples
2742might be a good idea; maybe make an "advanced examples" section a
2743standard end-of-chapter section?
2744
2745Include cross-references to the glossary, where appropriate.
2746
2747To document:
2748        reflogs, git reflog expire
2749        shallow clones??  See draft 1.5.0 release notes for some documentation.