Documentation / git-p4.txton commit graph: add commit graph design document (ae30d7b)
   1git-p4(1)
   2=========
   3
   4NAME
   5----
   6git-p4 - Import from and submit to Perforce repositories
   7
   8
   9SYNOPSIS
  10--------
  11[verse]
  12'git p4 clone' [<sync options>] [<clone options>] <p4 depot path>...
  13'git p4 sync' [<sync options>] [<p4 depot path>...]
  14'git p4 rebase'
  15'git p4 submit' [<submit options>] [<master branch name>]
  16
  17
  18DESCRIPTION
  19-----------
  20This command provides a way to interact with p4 repositories
  21using Git.
  22
  23Create a new Git repository from an existing p4 repository using
  24'git p4 clone', giving it one or more p4 depot paths.  Incorporate
  25new commits from p4 changes with 'git p4 sync'.  The 'sync' command
  26is also used to include new branches from other p4 depot paths.
  27Submit Git changes back to p4 using 'git p4 submit'.  The command
  28'git p4 rebase' does a sync plus rebases the current branch onto
  29the updated p4 remote branch.
  30
  31
  32EXAMPLE
  33-------
  34* Clone a repository:
  35+
  36------------
  37$ git p4 clone //depot/path/project
  38------------
  39
  40* Do some work in the newly created Git repository:
  41+
  42------------
  43$ cd project
  44$ vi foo.h
  45$ git commit -a -m "edited foo.h"
  46------------
  47
  48* Update the Git repository with recent changes from p4, rebasing your
  49  work on top:
  50+
  51------------
  52$ git p4 rebase
  53------------
  54
  55* Submit your commits back to p4:
  56+
  57------------
  58$ git p4 submit
  59------------
  60
  61
  62COMMANDS
  63--------
  64
  65Clone
  66~~~~~
  67Generally, 'git p4 clone' is used to create a new Git directory
  68from an existing p4 repository:
  69------------
  70$ git p4 clone //depot/path/project
  71------------
  72This:
  73
  741.   Creates an empty Git repository in a subdirectory called 'project'.
  75+
  762.   Imports the full contents of the head revision from the given p4
  77depot path into a single commit in the Git branch 'refs/remotes/p4/master'.
  78+
  793.   Creates a local branch, 'master' from this remote and checks it out.
  80
  81To reproduce the entire p4 history in Git, use the '@all' modifier on
  82the depot path:
  83------------
  84$ git p4 clone //depot/path/project@all
  85------------
  86
  87
  88Sync
  89~~~~
  90As development continues in the p4 repository, those changes can
  91be included in the Git repository using:
  92------------
  93$ git p4 sync
  94------------
  95This command finds new changes in p4 and imports them as Git commits.
  96
  97P4 repositories can be added to an existing Git repository using
  98'git p4 sync' too:
  99------------
 100$ mkdir repo-git
 101$ cd repo-git
 102$ git init
 103$ git p4 sync //path/in/your/perforce/depot
 104------------
 105This imports the specified depot into
 106'refs/remotes/p4/master' in an existing Git repository.  The
 107`--branch` option can be used to specify a different branch to
 108be used for the p4 content.
 109
 110If a Git repository includes branches 'refs/remotes/origin/p4', these
 111will be fetched and consulted first during a 'git p4 sync'.  Since
 112importing directly from p4 is considerably slower than pulling changes
 113from a Git remote, this can be useful in a multi-developer environment.
 114
 115If there are multiple branches, doing 'git p4 sync' will automatically
 116use the "BRANCH DETECTION" algorithm to try to partition new changes
 117into the right branch.  This can be overridden with the `--branch`
 118option to specify just a single branch to update.
 119
 120
 121Rebase
 122~~~~~~
 123A common working pattern is to fetch the latest changes from the p4 depot
 124and merge them with local uncommitted changes.  Often, the p4 repository
 125is the ultimate location for all code, thus a rebase workflow makes
 126sense.  This command does 'git p4 sync' followed by 'git rebase' to move
 127local commits on top of updated p4 changes.
 128------------
 129$ git p4 rebase
 130------------
 131
 132
 133Submit
 134~~~~~~
 135Submitting changes from a Git repository back to the p4 repository
 136requires a separate p4 client workspace.  This should be specified
 137using the `P4CLIENT` environment variable or the Git configuration
 138variable 'git-p4.client'.  The p4 client must exist, but the client root
 139will be created and populated if it does not already exist.
 140
 141To submit all changes that are in the current Git branch but not in
 142the 'p4/master' branch, use:
 143------------
 144$ git p4 submit
 145------------
 146
 147To specify a branch other than the current one, use:
 148------------
 149$ git p4 submit topicbranch
 150------------
 151
 152The upstream reference is generally 'refs/remotes/p4/master', but can
 153be overridden using the `--origin=` command-line option.
 154
 155The p4 changes will be created as the user invoking 'git p4 submit'. The
 156`--preserve-user` option will cause ownership to be modified
 157according to the author of the Git commit.  This option requires admin
 158privileges in p4, which can be granted using 'p4 protect'.
 159
 160To shelve changes instead of submitting, use `--shelve` and `--update-shelve`:
 161
 162----
 163$ git p4 submit --shelve
 164$ git p4 submit --update-shelve 1234 --update-shelve 2345
 165----
 166
 167OPTIONS
 168-------
 169
 170General options
 171~~~~~~~~~~~~~~~
 172All commands except clone accept these options.
 173
 174--git-dir <dir>::
 175        Set the `GIT_DIR` environment variable.  See linkgit:git[1].
 176
 177-v::
 178--verbose::
 179        Provide more progress information.
 180
 181Sync options
 182~~~~~~~~~~~~
 183These options can be used in the initial 'clone' as well as in
 184subsequent 'sync' operations.
 185
 186--branch <ref>::
 187        Import changes into <ref> instead of refs/remotes/p4/master.
 188        If <ref> starts with refs/, it is used as is.  Otherwise, if
 189        it does not start with p4/, that prefix is added.
 190+
 191By default a <ref> not starting with refs/ is treated as the
 192name of a remote-tracking branch (under refs/remotes/).  This
 193behavior can be modified using the --import-local option.
 194+
 195The default <ref> is "master".
 196+
 197This example imports a new remote "p4/proj2" into an existing
 198Git repository:
 199+
 200----
 201    $ git init
 202    $ git p4 sync --branch=refs/remotes/p4/proj2 //depot/proj2
 203----
 204
 205--detect-branches::
 206        Use the branch detection algorithm to find new paths in p4.  It is
 207        documented below in "BRANCH DETECTION".
 208
 209--changesfile <file>::
 210        Import exactly the p4 change numbers listed in 'file', one per
 211        line.  Normally, 'git p4' inspects the current p4 repository
 212        state and detects the changes it should import.
 213
 214--silent::
 215        Do not print any progress information.
 216
 217--detect-labels::
 218        Query p4 for labels associated with the depot paths, and add
 219        them as tags in Git. Limited usefulness as only imports labels
 220        associated with new changelists. Deprecated.
 221
 222--import-labels::
 223        Import labels from p4 into Git.
 224
 225--import-local::
 226        By default, p4 branches are stored in 'refs/remotes/p4/',
 227        where they will be treated as remote-tracking branches by
 228        linkgit:git-branch[1] and other commands.  This option instead
 229        puts p4 branches in 'refs/heads/p4/'.  Note that future
 230        sync operations must specify `--import-local` as well so that
 231        they can find the p4 branches in refs/heads.
 232
 233--max-changes <n>::
 234        Import at most 'n' changes, rather than the entire range of
 235        changes included in the given revision specifier. A typical
 236        usage would be use '@all' as the revision specifier, but then
 237        to use '--max-changes 1000' to import only the last 1000
 238        revisions rather than the entire revision history.
 239
 240--changes-block-size <n>::
 241        The internal block size to use when converting a revision
 242        specifier such as '@all' into a list of specific change
 243        numbers. Instead of using a single call to 'p4 changes' to
 244        find the full list of changes for the conversion, there are a
 245        sequence of calls to 'p4 changes -m', each of which requests
 246        one block of changes of the given size. The default block size
 247        is 500, which should usually be suitable.
 248
 249--keep-path::
 250        The mapping of file names from the p4 depot path to Git, by
 251        default, involves removing the entire depot path.  With this
 252        option, the full p4 depot path is retained in Git.  For example,
 253        path '//depot/main/foo/bar.c', when imported from
 254        '//depot/main/', becomes 'foo/bar.c'.  With `--keep-path`, the
 255        Git path is instead 'depot/main/foo/bar.c'.
 256
 257--use-client-spec::
 258        Use a client spec to find the list of interesting files in p4.
 259        See the "CLIENT SPEC" section below.
 260
 261-/ <path>::
 262        Exclude selected depot paths when cloning or syncing.
 263
 264Clone options
 265~~~~~~~~~~~~~
 266These options can be used in an initial 'clone', along with the 'sync'
 267options described above.
 268
 269--destination <directory>::
 270        Where to create the Git repository.  If not provided, the last
 271        component in the p4 depot path is used to create a new
 272        directory.
 273
 274--bare::
 275        Perform a bare clone.  See linkgit:git-clone[1].
 276
 277Submit options
 278~~~~~~~~~~~~~~
 279These options can be used to modify 'git p4 submit' behavior.
 280
 281--origin <commit>::
 282        Upstream location from which commits are identified to submit to
 283        p4.  By default, this is the most recent p4 commit reachable
 284        from `HEAD`.
 285
 286-M::
 287        Detect renames.  See linkgit:git-diff[1].  Renames will be
 288        represented in p4 using explicit 'move' operations.  There
 289        is no corresponding option to detect copies, but there are
 290        variables for both moves and copies.
 291
 292--preserve-user::
 293        Re-author p4 changes before submitting to p4.  This option
 294        requires p4 admin privileges.
 295
 296--export-labels::
 297        Export tags from Git as p4 labels. Tags found in Git are applied
 298        to the perforce working directory.
 299
 300-n::
 301--dry-run::
 302        Show just what commits would be submitted to p4; do not change
 303        state in Git or p4.
 304
 305--prepare-p4-only::
 306        Apply a commit to the p4 workspace, opening, adding and deleting
 307        files in p4 as for a normal submit operation.  Do not issue the
 308        final "p4 submit", but instead print a message about how to
 309        submit manually or revert.  This option always stops after the
 310        first (oldest) commit.  Git tags are not exported to p4.
 311
 312--shelve::
 313        Instead of submitting create a series of shelved changelists.
 314        After creating each shelve, the relevant files are reverted/deleted.
 315        If you have multiple commits pending multiple shelves will be created.
 316
 317--update-shelve CHANGELIST::
 318        Update an existing shelved changelist with this commit. Implies
 319        --shelve. Repeat for multiple shelved changelists.
 320
 321--conflict=(ask|skip|quit)::
 322        Conflicts can occur when applying a commit to p4.  When this
 323        happens, the default behavior ("ask") is to prompt whether to
 324        skip this commit and continue, or quit.  This option can be used
 325        to bypass the prompt, causing conflicting commits to be automatically
 326        skipped, or to quit trying to apply commits, without prompting.
 327
 328--branch <branch>::
 329        After submitting, sync this named branch instead of the default
 330        p4/master.  See the "Sync options" section above for more
 331        information.
 332
 333Rebase options
 334~~~~~~~~~~~~~~
 335These options can be used to modify 'git p4 rebase' behavior.
 336
 337--import-labels::
 338        Import p4 labels.
 339
 340DEPOT PATH SYNTAX
 341-----------------
 342The p4 depot path argument to 'git p4 sync' and 'git p4 clone' can
 343be one or more space-separated p4 depot paths, with an optional
 344p4 revision specifier on the end:
 345
 346"//depot/my/project"::
 347    Import one commit with all files in the '#head' change under that tree.
 348
 349"//depot/my/project@all"::
 350    Import one commit for each change in the history of that depot path.
 351
 352"//depot/my/project@1,6"::
 353    Import only changes 1 through 6.
 354
 355"//depot/proj1@all //depot/proj2@all"::
 356    Import all changes from both named depot paths into a single
 357    repository.  Only files below these directories are included.
 358    There is not a subdirectory in Git for each "proj1" and "proj2".
 359    You must use the `--destination` option when specifying more
 360    than one depot path.  The revision specifier must be specified
 361    identically on each depot path.  If there are files in the
 362    depot paths with the same name, the path with the most recently
 363    updated version of the file is the one that appears in Git.
 364
 365See 'p4 help revisions' for the full syntax of p4 revision specifiers.
 366
 367
 368CLIENT SPEC
 369-----------
 370The p4 client specification is maintained with the 'p4 client' command
 371and contains among other fields, a View that specifies how the depot
 372is mapped into the client repository.  The 'clone' and 'sync' commands
 373can consult the client spec when given the `--use-client-spec` option or
 374when the useClientSpec variable is true.  After 'git p4 clone', the
 375useClientSpec variable is automatically set in the repository
 376configuration file.  This allows future 'git p4 submit' commands to
 377work properly; the submit command looks only at the variable and does
 378not have a command-line option.
 379
 380The full syntax for a p4 view is documented in 'p4 help views'.  'git p4'
 381knows only a subset of the view syntax.  It understands multi-line
 382mappings, overlays with '+', exclusions with '-' and double-quotes
 383around whitespace.  Of the possible wildcards, 'git p4' only handles
 384'...', and only when it is at the end of the path.  'git p4' will complain
 385if it encounters an unhandled wildcard.
 386
 387Bugs in the implementation of overlap mappings exist.  If multiple depot
 388paths map through overlays to the same location in the repository,
 389'git p4' can choose the wrong one.  This is hard to solve without
 390dedicating a client spec just for 'git p4'.
 391
 392The name of the client can be given to 'git p4' in multiple ways.  The
 393variable 'git-p4.client' takes precedence if it exists.  Otherwise,
 394normal p4 mechanisms of determining the client are used:  environment
 395variable P4CLIENT, a file referenced by P4CONFIG, or the local host name.
 396
 397
 398BRANCH DETECTION
 399----------------
 400P4 does not have the same concept of a branch as Git.  Instead,
 401p4 organizes its content as a directory tree, where by convention
 402different logical branches are in different locations in the tree.
 403The 'p4 branch' command is used to maintain mappings between
 404different areas in the tree, and indicate related content.  'git p4'
 405can use these mappings to determine branch relationships.
 406
 407If you have a repository where all the branches of interest exist as
 408subdirectories of a single depot path, you can use `--detect-branches`
 409when cloning or syncing to have 'git p4' automatically find
 410subdirectories in p4, and to generate these as branches in Git.
 411
 412For example, if the P4 repository structure is:
 413----
 414//depot/main/...
 415//depot/branch1/...
 416----
 417
 418And "p4 branch -o branch1" shows a View line that looks like:
 419----
 420//depot/main/... //depot/branch1/...
 421----
 422
 423Then this 'git p4 clone' command:
 424----
 425git p4 clone --detect-branches //depot@all
 426----
 427produces a separate branch in 'refs/remotes/p4/' for //depot/main,
 428called 'master', and one for //depot/branch1 called 'depot/branch1'.
 429
 430However, it is not necessary to create branches in p4 to be able to use
 431them like branches.  Because it is difficult to infer branch
 432relationships automatically, a Git configuration setting
 433'git-p4.branchList' can be used to explicitly identify branch
 434relationships.  It is a list of "source:destination" pairs, like a
 435simple p4 branch specification, where the "source" and "destination" are
 436the path elements in the p4 repository.  The example above relied on the
 437presence of the p4 branch.  Without p4 branches, the same result will
 438occur with:
 439----
 440git init depot
 441cd depot
 442git config git-p4.branchList main:branch1
 443git p4 clone --detect-branches //depot@all .
 444----
 445
 446
 447PERFORMANCE
 448-----------
 449The fast-import mechanism used by 'git p4' creates one pack file for
 450each invocation of 'git p4 sync'.  Normally, Git garbage compression
 451(linkgit:git-gc[1]) automatically compresses these to fewer pack files,
 452but explicit invocation of 'git repack -adf' may improve performance.
 453
 454
 455CONFIGURATION VARIABLES
 456-----------------------
 457The following config settings can be used to modify 'git p4' behavior.
 458They all are in the 'git-p4' section.
 459
 460General variables
 461~~~~~~~~~~~~~~~~~
 462git-p4.user::
 463        User specified as an option to all p4 commands, with '-u <user>'.
 464        The environment variable 'P4USER' can be used instead.
 465
 466git-p4.password::
 467        Password specified as an option to all p4 commands, with
 468        '-P <password>'.
 469        The environment variable 'P4PASS' can be used instead.
 470
 471git-p4.port::
 472        Port specified as an option to all p4 commands, with
 473        '-p <port>'.
 474        The environment variable 'P4PORT' can be used instead.
 475
 476git-p4.host::
 477        Host specified as an option to all p4 commands, with
 478        '-h <host>'.
 479        The environment variable 'P4HOST' can be used instead.
 480
 481git-p4.client::
 482        Client specified as an option to all p4 commands, with
 483        '-c <client>', including the client spec.
 484
 485git-p4.retries::
 486        Specifies the number of times to retry a p4 command (notably,
 487        'p4 sync') if the network times out. The default value is 3.
 488        Set the value to 0 to disable retries or if your p4 version
 489        does not support retries (pre 2012.2).
 490
 491Clone and sync variables
 492~~~~~~~~~~~~~~~~~~~~~~~~
 493git-p4.syncFromOrigin::
 494        Because importing commits from other Git repositories is much faster
 495        than importing them from p4, a mechanism exists to find p4 changes
 496        first in Git remotes.  If branches exist under 'refs/remote/origin/p4',
 497        those will be fetched and used when syncing from p4.  This
 498        variable can be set to 'false' to disable this behavior.
 499
 500git-p4.branchUser::
 501        One phase in branch detection involves looking at p4 branches
 502        to find new ones to import.  By default, all branches are
 503        inspected.  This option limits the search to just those owned
 504        by the single user named in the variable.
 505
 506git-p4.branchList::
 507        List of branches to be imported when branch detection is
 508        enabled.  Each entry should be a pair of branch names separated
 509        by a colon (:).  This example declares that both branchA and
 510        branchB were created from main:
 511+
 512-------------
 513git config       git-p4.branchList main:branchA
 514git config --add git-p4.branchList main:branchB
 515-------------
 516
 517git-p4.ignoredP4Labels::
 518        List of p4 labels to ignore. This is built automatically as
 519        unimportable labels are discovered.
 520
 521git-p4.importLabels::
 522        Import p4 labels into git, as per --import-labels.
 523
 524git-p4.labelImportRegexp::
 525        Only p4 labels matching this regular expression will be imported. The
 526        default value is '[a-zA-Z0-9_\-.]+$'.
 527
 528git-p4.useClientSpec::
 529        Specify that the p4 client spec should be used to identify p4
 530        depot paths of interest.  This is equivalent to specifying the
 531        option `--use-client-spec`.  See the "CLIENT SPEC" section above.
 532        This variable is a boolean, not the name of a p4 client.
 533
 534git-p4.pathEncoding::
 535        Perforce keeps the encoding of a path as given by the originating OS.
 536        Git expects paths encoded as UTF-8. Use this config to tell git-p4
 537        what encoding Perforce had used for the paths. This encoding is used
 538        to transcode the paths to UTF-8. As an example, Perforce on Windows
 539        often uses "cp1252" to encode path names.
 540
 541git-p4.largeFileSystem::
 542        Specify the system that is used for large (binary) files. Please note
 543        that large file systems do not support the 'git p4 submit' command.
 544        Only Git LFS is implemented right now (see https://git-lfs.github.com/
 545        for more information). Download and install the Git LFS command line
 546        extension to use this option and configure it like this:
 547+
 548-------------
 549git config       git-p4.largeFileSystem GitLFS
 550-------------
 551
 552git-p4.largeFileExtensions::
 553        All files matching a file extension in the list will be processed
 554        by the large file system. Do not prefix the extensions with '.'.
 555
 556git-p4.largeFileThreshold::
 557        All files with an uncompressed size exceeding the threshold will be
 558        processed by the large file system. By default the threshold is
 559        defined in bytes. Add the suffix k, m, or g to change the unit.
 560
 561git-p4.largeFileCompressedThreshold::
 562        All files with a compressed size exceeding the threshold will be
 563        processed by the large file system. This option might slow down
 564        your clone/sync process. By default the threshold is defined in
 565        bytes. Add the suffix k, m, or g to change the unit.
 566
 567git-p4.largeFilePush::
 568        Boolean variable which defines if large files are automatically
 569        pushed to a server.
 570
 571git-p4.keepEmptyCommits::
 572        A changelist that contains only excluded files will be imported
 573        as an empty commit if this boolean option is set to true.
 574
 575git-p4.mapUser::
 576        Map a P4 user to a name and email address in Git. Use a string
 577        with the following format to create a mapping:
 578+
 579-------------
 580git config --add git-p4.mapUser "p4user = First Last <mail@address.com>"
 581-------------
 582+
 583A mapping will override any user information from P4. Mappings for
 584multiple P4 user can be defined.
 585
 586Submit variables
 587~~~~~~~~~~~~~~~~
 588git-p4.detectRenames::
 589        Detect renames.  See linkgit:git-diff[1].  This can be true,
 590        false, or a score as expected by 'git diff -M'.
 591
 592git-p4.detectCopies::
 593        Detect copies.  See linkgit:git-diff[1].  This can be true,
 594        false, or a score as expected by 'git diff -C'.
 595
 596git-p4.detectCopiesHarder::
 597        Detect copies harder.  See linkgit:git-diff[1].  A boolean.
 598
 599git-p4.preserveUser::
 600        On submit, re-author changes to reflect the Git author,
 601        regardless of who invokes 'git p4 submit'.
 602
 603git-p4.allowMissingP4Users::
 604        When 'preserveUser' is true, 'git p4' normally dies if it
 605        cannot find an author in the p4 user map.  This setting
 606        submits the change regardless.
 607
 608git-p4.skipSubmitEdit::
 609        The submit process invokes the editor before each p4 change
 610        is submitted.  If this setting is true, though, the editing
 611        step is skipped.
 612
 613git-p4.skipSubmitEditCheck::
 614        After editing the p4 change message, 'git p4' makes sure that
 615        the description really was changed by looking at the file
 616        modification time.  This option disables that test.
 617
 618git-p4.allowSubmit::
 619        By default, any branch can be used as the source for a 'git p4
 620        submit' operation.  This configuration variable, if set, permits only
 621        the named branches to be used as submit sources.  Branch names
 622        must be the short names (no "refs/heads/"), and should be
 623        separated by commas (","), with no spaces.
 624
 625git-p4.skipUserNameCheck::
 626        If the user running 'git p4 submit' does not exist in the p4
 627        user map, 'git p4' exits.  This option can be used to force
 628        submission regardless.
 629
 630git-p4.attemptRCSCleanup::
 631        If enabled, 'git p4 submit' will attempt to cleanup RCS keywords
 632        ($Header$, etc). These would otherwise cause merge conflicts and prevent
 633        the submit going ahead. This option should be considered experimental at
 634        present.
 635
 636git-p4.exportLabels::
 637        Export Git tags to p4 labels, as per --export-labels.
 638
 639git-p4.labelExportRegexp::
 640        Only p4 labels matching this regular expression will be exported. The
 641        default value is '[a-zA-Z0-9_\-.]+$'.
 642
 643git-p4.conflict::
 644        Specify submit behavior when a conflict with p4 is found, as per
 645        --conflict.  The default behavior is 'ask'.
 646
 647IMPLEMENTATION DETAILS
 648----------------------
 649* Changesets from p4 are imported using Git fast-import.
 650* Cloning or syncing does not require a p4 client; file contents are
 651  collected using 'p4 print'.
 652* Submitting requires a p4 client, which is not in the same location
 653  as the Git repository.  Patches are applied, one at a time, to
 654  this p4 client and submitted from there.
 655* Each commit imported by 'git p4' has a line at the end of the log
 656  message indicating the p4 depot location and change number.  This
 657  line is used by later 'git p4 sync' operations to know which p4
 658  changes are new.