User interfaces integrating hardware buttons

[0001] This application claims priority to U.S. Provisional Application No. 63/622,536, entitled “Camera,” filed on Jan. 18, 2024, U.S. Provisional Application No. 63/623,205, entitled “USER INTERFACES INTEGRATING HARDWARE BUTTONS,” filed on Jan. 19, 2024, U.S. Provisional Application No. 63/566,165, entitled “USER INTERFACES INTEGRATING HARDWARE BUTTONS,” filed on Mar. 15, 2024, U.S. Provisional Application No. 63/657,709, entitled “USER INTERFACES INTEGRATING HARDWARE BUTTONS,” filed on Jun. 7, 2024, and U.S. Provisional Application No. 63/692,133, entitled “USER INTERFACES INTEGRATING HARDWARE BUTTONS,” filed on Sep. 8, 2024, each of which is hereby incorporated by reference in their entirety.

[0002] The present disclosure relates generally to computer user interfaces, and more specifically to techniques for providing user interfaces that integrate one or more hardware buttons.

[0003] Electronic devices, such as smart phones, tablets, and wearable devices, provide user interfaces for controlling an ever-increasing scope, variety, and sophistication of functionality. Example user interfaces can be interacted with (e.g., controlled) using displayed software controls, such as user interface elements that can be interacted with via a touch-sensitive surface of a display, and hardware controls, such as buttons and switches.

[0004] Some systems and techniques for providing user interfaces that integrate one or more hardware buttons using electronic devices, however, are generally limited, cumbersome, and inefficient. For example, integrating numerous hardware buttons can increase the size, weight, and cost of electronic devices, but systems with user interfaces that over-rely on displayed software controls (e.g., touch controls) or require frequent switching between displayed software controls and hardware buttons are complex, error-prone, distracting, uncomfortable, and require more time than necessary, wasting user time and device energy. This latter consideration is particularly important in battery-operated devices.

[0005] Accordingly, the present technique provides electronic devices with faster, more efficient methods and interfaces for providing interfaces that integrate one or more hardware buttons. Such methods and interfaces optionally complement or replace other methods for providing interfaces that integrate one or more hardware buttons. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

[0006] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with a display generation component and a first input device, and comprises: detecting, via the first input device, a first set of one or more inputs directed to the first input device; and in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0007] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; and in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0008] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; and in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0009] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and a first input device, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; and in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0010] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and a first input device, the computer system comprising: means for detecting, via the first input device, a first set of one or more inputs directed to the first input device; and means for, in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0011] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; and in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, performing a first operation, wherein the first set of criteria includes: a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity; and a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type; and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies a second set of criteria different from the first set of criteria, performing a second operation different from the first operation, wherein the second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity.

[0012] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with a display generation component, one or more cameras, and a first input device, and comprises: detecting, via the first input device, a first set of one or more inputs directed to the first input device; in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; while capturing the first video media, detecting an end of the first set of one or more inputs; and in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0013] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, one or more cameras, and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; while capturing the first video media, detecting an end of the first set of one or more inputs; and in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0014] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, one or more cameras, and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; while capturing the first video media, detecting an end of the first set of one or more inputs; and in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0015] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, one or more cameras, and a first input device, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; while capturing the first video media, detecting an end of the first set of one or more inputs; and in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0016] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, one or more cameras, and a first input device, the computer system comprising: means for detecting, via the first input device, a first set of one or more inputs directed to the first input device; means for, in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; means for, while capturing the first video media, detecting an end of the first set of one or more inputs; and means for, in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0017] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, one or more cameras, and a first input device, the one or more programs including instructions for: detecting, via the first input device, a first set of one or more inputs directed to the first input device; in response to detecting the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria, capturing, via the one or more cameras, first photo media, wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type; and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria, capturing, via the one or more cameras, first video media, wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type; while capturing the first video media, detecting an end of the first set of one or more inputs; and in response to detecting the end of the first set of one or more inputs: in accordance with a determination that the first set of one or more inputs included a movement of a first type, continuing to capture the first video media after detecting the end of the first set of one or more inputs.

[0018] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with a display generation component and a first input device, and comprises: detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0019] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0020] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0021] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and a first input device, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0022] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and a first input device, the computer system comprising: means for detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; means for, in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; means for, while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; means for, after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and means for, in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0023] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a first input device, the one or more programs including instructions for: detecting a first input including a movement that starts at a first location corresponding to the first input device and ends at a second location that is different from the first location; in response to detecting the first input, displaying, via the display generation component, an option user interface, including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device; while displaying the options user interface, detecting a second input selecting a respective selectable user interface object of the plurality of selectable user interface objects; after detecting the second input, detecting, via the first input device, a third input directed to the first input device; and in response to detecting the third input directed to the first input device: in accordance with a determination that a first set of one or more criteria is satisfied, performing a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the first operation; and in accordance with a determination that a second set of one or more criteria is satisfied, performing a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation.

[0024] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with a display generation component, and comprises: receiving a request to play a video media item; and in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0025] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: receiving a request to play a video media item; and in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0026] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: receiving a request to play a video media item; and in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0027] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: receiving a request to play a video media item; and in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0028] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising: means for receiving a request to play a video media item; and means for, in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0029] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: receiving a request to play a video media item; and in response to receiving the request to play the video media item, playing the video media item, including, while playing the video media item, decreasing a playback speed of a respective portion of the video media item, wherein the respective portion of the video media item is automatically selected based on content of the video media item, including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item.

[0030] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with a display generation component, and comprises: detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; detecting an end of the input; and after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0031] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; detecting an end of the input; and after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0032] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; detecting an end of the input; and after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0033] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; detecting an end of the input; and after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0034] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising: means for detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; means for, in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; means for detecting an end of the input; and means for, after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0035] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: detecting an input directed to a control element of a user interface, wherein the input includes a detected movement component; in response to detecting the input directed to the control element, causing a first adjustment to a value of a parameter associated with the control element, wherein the first adjustment is based on the detected movement component; detecting an end of the input; and after detecting the end of the input, causing a second adjustment to the value of the parameter associated with the control element, wherein the second adjustment is based on the detected movement component.

[0036] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, and comprises: displaying, via the one or more display generation components, a user interface; while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0037] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, the one or more programs including instructions for: displaying, via the one or more display generation components, a user interface; while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0038] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, the one or more programs including instructions for: displaying, via the one or more display generation components, a user interface; while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0039] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the one or more display generation components, a user interface; while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0040] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, the computer system comprising: means for displaying, via the one or more display generation components, a user interface; means for, while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and means for, in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0041] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input devices, the one or more programs including instructions for: displaying, via the one or more display generation components, a user interface; while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes: in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

[0042] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, and comprises: while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera.

[0043] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, the one or more programs including instructions for: while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera

[0044] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, the one or more programs including instructions for: while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera

[0045] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera

[0046] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, the computer system comprising: means for while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and means for, in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera

[0047] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a plurality of cameras including a first camera and a second camera that is different from the first camera, and one or more input devices including a first hardware input device, the one or more programs including instructions for: while displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the first camera, detecting, via the first hardware input device, a first movement input; and in response to detecting the first movement input, displaying, via the one or more display generation components, a camera user interface for capturing media primarily using the second camera without displaying the camera user interface for capturing media primarily using the first camera.

[0048] In accordance with some embodiments, a method is described. The method is performed at a computer system that is in communication with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, and comprises: detecting, via the hardware input device, a press input; and in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0049] In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, the one or more programs including instructions for: detecting, via the hardware input device, a press input; and in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0050] In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, the one or more programs including instructions for: detecting, via the hardware input device, a press input; and in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0051] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, the computer system comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the hardware input device, a press input; and in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0052] In accordance with some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, the computer system comprising: means for detecting, via the hardware input device, a press input; and means for, in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0053] In accordance with some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components, a one or more cameras, and one or more input devices including a hardware input device, the one or more programs including instructions for: detecting, via the hardware input device, a press input; and in response to detecting the press input: in accordance with a determination that the press input satisfies a first set of one or more criteria, performing a first operation, wherein performing the first operation includes: displaying, via the one or more display generation components, a viewfinder user interface including a representation of a field-of-view of the one or more cameras; displaying, via the one or more display generation components, one or more indications associated with the representation of the field-of-view of the one or more cameras, wherein displaying the one or more indications associated with the representation of the field-of-view of the one or more cameras includes: in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a first type of content, displaying, in the viewfinder user interface, a first indication associated with the first type of content; and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes a second type of content that is different from the first type of content, displaying, in the viewfinder user interface, a second indication associated with the second type of content that is different from the first indication.

[0054] Executable instructions for performing these functions are, optionally, included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are, optionally, included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0055] Thus, devices are provided with faster, more efficient methods and interfaces for managing event notifications, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may complement or replace other methods for managing event notifications.

[0084] The following description sets forth exemplary methods, parameters, and the like. It should be recognized, however, that such description is not intended as a limitation on the scope of the present disclosure but is instead provided as a description of exemplary embodiments.

[0085] There is a need for electronic devices that provide efficient methods and interfaces that integrate one or more hardware buttons. For example, hardware button inputs can be used to control a variety of different functionality depending on the type of hardware button input detected (e.g., long or short presses, light or hard presses, and/or presses with other characteristics), the device context in which the hardware button input is detected (e.g., the user interface being displayed and/or the settings associated with the hardware button), and/or the hardware button being pressed (e.g., automatically switching between different media capture modes for a camera application using different buttons). Such techniques can improve the flexibility, ergonomics, and ease of use of user interfaces and reduce the cognitive burden on a user interacting with the user interface, thereby enhancing productivity. Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs.

[0086] Below, FIGS. 1A-1B, 2, 3A-3G, 4A-4B, and 5A-5H provide a description of exemplary devices for performing the techniques for managing event notifications. FIGS. 6A-6AM illustrate exemplary techniques and systems for controlling a computer system based on variable characteristics of hardware inputs. FIG. 7 is a flow diagram illustrating methods for controlling a computer system based on variable characteristics of hardware inputs in accordance with some embodiments. FIGS. 8A-8P illustrate exemplary techniques and systems for controlling media capture operations based on variable characteristics of hardware inputs. FIGS. 9A-9B are a flow diagram illustrating methods for controlling media capture operations based on variable characteristics of hardware inputs in accordance with some embodiments. FIGS. 10A-10W illustrate exemplary techniques and systems for customizing and controlling operations of a computer system using hardware inputs. FIGS. 11A-11B are a flow diagram illustrating methods for customizing and controlling operations of a computer system using hardware inputs in accordance with some embodiments. FIGS. 12A-12O illustrate exemplary techniques and systems for customizing playback speed of video media. FIG. 13 is a flow diagram illustrating methods for customizing playback speed of video media in accordance with some embodiments. FIGS. 14A-14Z illustrate exemplary techniques and systems controlling settings of a computer system based on movement characteristics of hardware inputs. FIG. 15 is a flow diagram illustrating methods for controlling settings of a computer system based on movement characteristics of hardware inputs in accordance with some embodiments. FIGS. 16A-16S illustrate exemplary techniques and systems for controlling a computer system with multiple hardware input devices. FIG. 17 is a flow diagram illustrating methods for controlling a computer system with multiple hardware input devices in accordance with some embodiments. FIGS. 18A-18T illustrate exemplary example techniques and systems for controlling media capture using a computer system with multiple cameras. FIG. 19 is a flow diagram of methods for controlling media capture using a computer system with multiple cameras. FIGS. 20A-20AL illustrate example techniques and systems for controlling visual intelligence functionality of a computer system with one or more cameras. FIG. 21 is a flow diagram of methods for controlling visual intelligence functionality of a computer system with one or more cameras.

[0087] The processes described below enhance the operability of the devices and make the user-device interfaces more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) through various techniques, including by providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, performing an operation when a set of conditions has been met without requiring further user input, and/or additional techniques. These techniques also reduce power usage and improve battery life of the device by enabling the user to use the device more quickly and efficiently.

[0088] In addition, in methods described herein where one or more steps are contingent upon one or more conditions having been met, it should be understood that the described method can be repeated in multiple repetitions so that over the course of the repetitions all of the conditions upon which steps in the method are contingent have been met in different repetitions of the method. For example, if a method requires performing a first step if a condition is satisfied, and a second step if the condition is not satisfied, then a person of ordinary skill would appreciate that the claimed steps are repeated until the condition has been both satisfied and not satisfied, in no particular order. Thus, a method described with one or more steps that are contingent upon one or more conditions having been met could be rewritten as a method that is repeated until each of the conditions described in the method has been met. This, however, is not required of system or computer readable medium claims where the system or computer readable medium contains instructions for performing the contingent operations based on the satisfaction of the corresponding one or more conditions and thus is capable of determining whether the contingency has or has not been satisfied without explicitly repeating steps of a method until all of the conditions upon which steps in the method are contingent have been met. A person having ordinary skill in the art would also understand that, similar to a method with contingent steps, a system or computer readable storage medium can repeat the steps of a method as many times as are needed to ensure that all of the contingent steps have been performed.

[0089] Although the following description uses terms “first,” “second,” etc. to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another. For example, a first touch could be termed a second touch, and, similarly, a second touch could be termed a first touch, without departing from the scope of the various described embodiments. In some embodiments, the first touch and the second touch are two separate references to the same touch. In some embodiments, the first touch and the second touch are both touches, but they are not the same touch.

[0090] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

[0091] The term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.

[0092] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communications device, such as a mobile telephone, that also contains other functions, such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and/or touchpads), are, optionally, used. It should also be understood that, in some embodiments, the device is not a portable communications device, but is a desktop computer with a touch-sensitive surface (e.g., a touch screen display and/or a touchpad). In some embodiments, the electronic device is a computer system that is in communication (e.g., via wireless communication, via wired communication) with a display generation component (e.g., a display device such as a head-mounted display (HMD), a display, a projector, a touch-sensitive display, or other device or component that presents visual content to a user, for example on or in the display generation component itself or produced from the display generation component and visible elsewhere). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, “displaying” content includes causing to display the content (e.g., video data rendered or decoded by display controller 156) by transmitting, via a wired or wireless connection, data (e.g., image data or video data) to an integrated or external display generation component to visually produce the content.

[0093] In the discussion that follows, an electronic device that includes a display and a touch-sensitive surface is described. It should be understood, however, that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and/or a joystick.

[0094] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an e-mail application, an instant messaging application, a workout support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and/or a digital video player application.

[0095] The various applications that are executed on the device optionally use at least one common physical user-interface device, such as the touch-sensitive surface. One or more functions of the touch-sensitive surface as well as corresponding information displayed on the device are, optionally, adjusted and/or varied from one application to the next and/or within a respective application. In this way, a common physical architecture (such as the touch-sensitive surface) of the device optionally supports the variety of applications with user interfaces that are intuitive and transparent to the user.

[0096] Attention is now directed toward embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating portable multifunction device 100 with touch-sensitive display system 112 in accordance with some embodiments. Touch-sensitive display 112 is sometimes called a “touch screen” for convenience and is sometimes known as or called a “touch-sensitive display system.” Device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input/output (I/O) subsystem 106, other input control devices 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 for detecting intensity of contacts on device 100 (e.g., a touch-sensitive surface such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile outputs on device 100 (e.g., generating tactile outputs on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate over one or more communication buses or signal lines 103.

[0097] As used in the specification and claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a substitute (proxy) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values and more typically includes hundreds of distinct values (e.g., at least 256). Intensity of a contact is, optionally, determined (or measured) using various approaches and various sensors or combinations of sensors. For example, one or more force sensors underneath or adjacent to the touch-sensitive surface are, optionally, used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated force of a contact. Similarly, a pressure-sensitive tip of a stylus is, optionally, used to determine a pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and/or changes thereto, the capacitance of the touch-sensitive surface proximate to the contact and/or changes thereto, and/or the resistance of the touch-sensitive surface proximate to the contact and/or changes thereto are, optionally, used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the substitute measurements for contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurements). In some implementations, the substitute measurements for contact force or pressure are converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of a user input allows for user access to additional device functionality that may otherwise not be accessible by the user on a reduced-size device with limited real estate for displaying affordances (e.g., on a touch-sensitive display) and/or receiving user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or a physical/mechanical control such as a knob or a button).

[0098] As used in the specification and claims, the term “tactile output” refers to physical displacement of a device relative to a previous position of the device, physical displacement of a component (e.g., a touch-sensitive surface) of a device relative to another component (e.g., housing) of the device, or displacement of the component relative to a center of mass of the device that will be detected by a user with the user's sense of touch. For example, in situations where the device or the component of the device is in contact with a surface of a user that is sensitive to touch (e.g., a finger, palm, or other part of a user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in physical characteristics of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is, optionally, interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, a user will feel a tactile sensation such as an “down click” or “up click” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movements. As another example, movement of the touch-sensitive surface is, optionally, interpreted or sensed by the user as “roughness” of the touch-sensitive surface, even when there is no change in smoothness of the touch-sensitive surface. While such interpretations of touch by a user will be subject to the individualized sensory perceptions of the user, there are many sensory perceptions of touch that are common to a large majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., an “up click,” a “down click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to physical displacement of the device or a component thereof that will generate the described sensory perception for a typical (or average) user.

[0099] It should be appreciated that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. The various components shown in FIG. 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and/or application-specific integrated circuits.

[0100] Memory 102 optionally includes high-speed random access memory and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0101] Peripherals interface 118 can be used to couple input and output peripherals of the device to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and/or sets of instructions stored in memory 102 to perform various functions for device 100 and to process data. In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are, optionally, implemented on a single chip, such as chip 104. In some other embodiments, they are, optionally, implemented on separate chips.

[0102] RF (radio frequency) circuitry 108 receives and sends RF signals, also called electromagnetic signals. RF circuitry 108 converts electrical signals to/from electromagnetic signals and communicates with communications networks and other communications devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. RF circuitry 108 optionally communicates with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by a short-range communication radio. The wireless communication optionally uses any of a plurality of communications standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for e-mail (e.g., Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

[0103] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuitry 110 receives audio data from peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to speaker 111. Speaker 111 converts the electrical signal to human-audible sound waves. Audio circuitry 110 also receives electrical signals converted by microphone 113 from sound waves. Audio circuitry 110 converts the electrical signal to audio data and transmits the audio data to peripherals interface 118 for processing. Audio data is, optionally, retrieved from and/or transmitted to memory 102 and/or RF circuitry 108 by peripherals interface 118. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., 212, FIG. 2). The headset jack provides an interface between audio circuitry 110 and removable audio input/output peripherals, such as output-only headphones or a headset with both output (e.g., a headphone for one or both ears) and input (e.g., a microphone).

[0104] I/O subsystem 106 couples input/output peripherals on device 100, such as touch screen 112 and other input control devices 116, to peripherals interface 118. I/O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive/send electrical signals from/to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some embodiments, input controller(s) 160 are, optionally, coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208, FIG. 2) optionally include an up/down button for volume control of speaker 111 and/or microphone 113. The one or more buttons optionally include a push button (e.g., 206, FIG. 2). In some embodiments, the electronic device is a computer system that is in communication (e.g., via wireless communication, via wired communication) with one or more input devices. In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a trackpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and/or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures and/or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some embodiments, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or independently of an input element that is a part of the device) and is based on detected motion of a portion of the user's body through the air including motion of the user's body relative to an absolute reference (e.g., an angle of the user's arm relative to the ground or a distance of the user's hand relative to the ground), relative to another portion of the user's body (e.g., movement of a hand of the user relative to a shoulder of the user, movement of one hand of the user relative to another hand of the user, and/or movement of a finger of the user relative to another finger or portion of a hand of the user), and/or absolute motion of a portion of the user's body (e.g., a tap gesture that includes movement of a hand in a predetermined pose by a predetermined amount and/or speed, or a shake gesture that includes a predetermined speed or amount of rotation of a portion of the user's body).

[0105] A quick press of the push button optionally disengages a lock of touch screen 112 or optionally begins a process that uses gestures on the touch screen to unlock the device, as described in U.S. patent application Ser. No. 11/322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed Dec. 23, 2005, U.S. Pat. No. 7,657,849, which is hereby incorporated by reference in its entirety. A longer press of the push button (e.g., 206) optionally turns power to device 100 on or off. The functionality of one or more of the buttons are, optionally, user-customizable. Touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0106] Touch-sensitive display 112 provides an input interface and an output interface between the device and a user. Display controller 156 receives and/or sends electrical signals from/to touch screen 112. Touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user-interface objects.

[0107] Touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from the user based on haptic and/or tactile contact. Touch screen 112 and display controller 156 (along with any associated modules and/or sets of instructions in memory 102) detect contact (and any movement or breaking of the contact) on touch screen 112 and convert the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages, or images) that are displayed on touch screen 112. In an exemplary embodiment, a point of contact between touch screen 112 and the user corresponds to a finger of the user.

[0108] Touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touch screen 112 and display controller 156 optionally detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch screen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.

[0109] A touch-sensitive display in some embodiments of touch screen 112 is, optionally, analogous to the multi-touch sensitive touchpads described in the following U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screen 112 displays visual output from device 100, whereas touch-sensitive touchpads do not provide visual output.

[0110] A touch-sensitive display in some embodiments of touch screen 112 is described in the following applications: (1) U.S. patent application Ser. No. 11/381,313, “Multipoint Touch Surface Controller,” filed May 2, 2006; (2) U.S. patent application Ser. No. 10/840,862, “Multipoint Touchscreen,” filed May 6, 2004; (3) U.S. patent application Ser. No. 10/903,964, “Gestures For Touch Sensitive Input Devices,” filed Jul. 30, 2004; (4) U.S. patent application Ser. No. 11/048,264, “Gestures For Touch Sensitive Input Devices,” filed Jan. 31, 2005; (5) U.S. patent application Ser. No. 11/038,590, “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6) U.S. patent application Ser. No. 11/228,758, “Virtual Input Device Placement On A Touch Screen User Interface,” filed Sep. 16, 2005; (7) U.S. patent application Ser. No. 11/228,700, “Operation Of A Computer With A Touch Screen Interface,” filed Sep. 16, 2005; (8) U.S. patent application Ser. No. 11/228,737, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard,” filed Sep. 16, 2005; and (9) U.S. patent application Ser. No. 11/367,749, “Multi-Functional Hand-Held Device,” filed Mar. 3, 2006. All of these applications are incorporated by reference herein in their entirety.

[0111] Touch screen 112 optionally has a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user optionally makes contact with touch screen 112 using any suitable object or appendage, such as a stylus, a finger, and so forth. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which can be less precise than stylus-based input due to the larger area of contact of a finger on the touch screen. In some embodiments, the device translates the rough finger-based input into a precise pointer/cursor position or command for performing the actions desired by the user.

[0112] In some embodiments, in addition to the touch screen, device 100 optionally includes a touchpad for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is, optionally, a touch-sensitive surface that is separate from touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0113] Device 100 also includes power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.

[0114] Device 100 optionally also includes secure element 163 for securely storing information. In some embodiments, secure element 163 is a hardware component (e.g., a secure microcontroller chip) configured to securely store data or an algorithm. In some embodiments, secure element 163 provides (e.g., releases) secure information (e.g., payment information (e.g., an account number and/or a transaction-specific dynamic security code), identification information (e.g., credentials of a state-approved digital identification), and/or authentication information (e.g., data generated using a cryptography engine and/or by performing asymmetric cryptography operations)). In some embodiments, secure element 163 provides (or releases) the secure information in response to device 100 receiving authorization, such as a user authentication (e.g., fingerprint authentication; passcode authentication; detecting double-press of a hardware button when device 100 is in an unlocked state, and optionally, while device 100 has been continuously on a user's wrist since device 100 was unlocked by providing authentication credentials to device 100, where the continuous presence of device 100 on the user's wrist is determined by periodically checking that the device is in contact with the user's skin). For example, device 100 detects a fingerprint at a fingerprint sensor (e.g., a fingerprint sensor integrated into a button) of device 100. Device 100 determines whether the detected fingerprint is consistent with an enrolled fingerprint. In accordance with a determination that the fingerprint is consistent with the enrolled fingerprint, secure element 163 provides (e.g., releases) the secure information. In accordance with a determination that the fingerprint is not consistent with the enrolled fingerprint, secure element 163 forgoes providing (e.g., releasing) the secure information.

[0115] Device 100 optionally also includes one or more optical sensors 164. FIG. 1A shows an optical sensor coupled to optical sensor controller 158 in I/O subsystem 106. Optical sensor 164 optionally includes charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. Optical sensor 164 receives light from the environment, projected through one or more lenses, and converts the light to data representing an image. In conjunction with imaging module 143 (also called a camera module), optical sensor 164 optionally captures still images or video. In some embodiments, an optical sensor is located on the back of device 100, opposite touch screen display 112 on the front of the device so that the touch screen display is enabled for use as a viewfinder for still and/or video image acquisition. In some embodiments, an optical sensor is located on the front of the device so that the user's image is, optionally, obtained for video conferencing while the user views the other video conference participants on the touch screen display. In some embodiments, the position of optical sensor 164 can be changed by the user (e.g., by rotating the lens and the sensor in the device housing) so that a single optical sensor 164 is used along with the touch screen display for both video conferencing and still and/or video image acquisition.

[0116] Device 100 optionally also includes one or more depth camera sensors 175. FIG. 1A shows a depth camera sensor coupled to depth camera controller 169 in I/O subsystem 106. Depth camera sensor 175 receives data from the environment to create a three dimensional model of an object (e.g., a face) within a scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also called a camera module), depth camera sensor 175 is optionally used to determine a depth map of different portions of an image captured by the imaging module 143. In some embodiments, a depth camera sensor is located on the front of device 100 so that the user's image with depth information is, optionally, obtained for video conferencing while the user views the other video conference participants on the touch screen display and to capture selfies with depth map data. In some embodiments, the depth camera sensor 175 is located on the back of device, or on the back and the front of the device 100. In some embodiments, the position of depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and the sensor in the device housing) so that a depth camera sensor 175 is used along with the touch screen display for both video conferencing and still and/or video image acquisition.

[0117] In some embodiments, a depth map (e.g., depth map image) contains information (e.g., values) that relates to the distance of objects in a scene from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor). In one embodiment of a depth map, each depth pixel defines the position in the viewpoint's Z-axis where its corresponding two-dimensional pixel is located. In some embodiments, a depth map is composed of pixels wherein each pixel is defined by a value (e.g., 0-255). For example, the “0” value represents pixels that are located at the most distant place in a “three dimensional” scene and the “255” value represents pixels that are located closest to a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor) in the “three dimensional” scene. In other embodiments, a depth map represents the distance between an object in a scene and the plane of the viewpoint. In some embodiments, the depth map includes information about the relative depth of various features of an object of interest in view of the depth camera (e.g., the relative depth of eyes, nose, mouth, ears of a user's face). In some embodiments, the depth map includes information that enables the device to determine contours of the object of interest in a z direction.

[0118] Device 100 optionally also includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I/O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is collocated with, or proximate to, a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touch screen display 112, which is located on the front of device 100.

[0119] Device 100 optionally also includes one or more proximity sensors 166. FIG. 1A shows proximity sensor 166 coupled to peripherals interface 118. Alternately, proximity sensor 166 is, optionally, coupled to input controller 160 in I/O subsystem 106. Proximity sensor 166 optionally performs as described in U.S. patent application Ser. No. 11/241,839, “Proximity Detector In Handheld Device”; Ser. No. 11/240,788, “Proximity Detector In Handheld Device”; Ser. No. 11/620,702, “Using Ambient Light Sensor To Augment Proximity Sensor Output”; Ser. No. 11/586,862, “Automated Response To And Sensing Of User Activity In Portable Devices”; and Ser. No. 11/638,251, “Methods And Systems For Automatic Configuration Of Peripherals,” which are hereby incorporated by reference in their entirety. In some embodiments, the proximity sensor turns off and disables touch screen 112 when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

[0120] Device 100 optionally also includes one or more tactile output generators 167. FIG. 1A shows a tactile output generator coupled to haptic feedback controller 161 in I/O subsystem 106. Tactile output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components and/or electromechanical devices that convert energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts electrical signals into tactile outputs on the device). Contact intensity sensor 165 receives tactile feedback generation instructions from haptic feedback module 133 and generates tactile outputs on device 100 that are capable of being sensed by a user of device 100. In some embodiments, at least one tactile output generator is collocated with, or proximate to, a touch-sensitive surface (e.g., touch-sensitive display system 112) and, optionally, generates a tactile output by moving the touch-sensitive surface vertically (e.g., in/out of a surface of device 100) or laterally (e.g., back and forth in the same plane as a surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite touch screen display 112, which is located on the front of device 100.

[0121] Device 100 optionally also includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 coupled to peripherals interface 118. Alternately, accelerometer 168 is, optionally, coupled to an input controller 160 in I/O subsystem 106. Accelerometer 168 optionally performs as described in U.S. Patent Publication No. 20050190059, “Acceleration-based Theft Detection System for Portable Electronic Devices,” and U.S. Patent Publication No. 20060017692, “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated by reference herein in their entirety. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on an analysis of data received from the one or more accelerometers. Device 100 optionally includes, in addition to accelerometer(s) 168, a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for obtaining information concerning the location and orientation (e.g., portrait or landscape) of device 100.

[0122] In some embodiments, the software components stored in memory 102 include operating system 126, biometric module 109, communication module (or set of instructions) 128, contact/motion module (or set of instructions) 130, graphics module (or set of instructions) 132, text input module (or set of instructions) 134, Global Positioning System (GPS) module (or set of instructions) 135, authentication module 105, and applications (or sets of instructions) 136. Furthermore, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3A) stores device/global internal state 157, as shown in FIGS. 1A and 3A. Device/global internal state 157 includes one or more of: active application state, indicating which applications, if any, are currently active; display state, indicating what applications, views or other information occupy various regions of touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and location information concerning the device's location and/or attitude.

[0123] Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0124] Communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by RF circuitry 108 and/or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, or similar to and/or compatible with, the 30-pin connector used on iPod® (trademark of Apple Inc.) devices.

[0125] Biometric module 109 optionally stores information about one or more enrolled biometric features (e.g., fingerprint feature information, facial recognition feature information, eye and/or iris feature information) for use to verify whether received biometric information matches the enrolled biometric features. In some embodiments, the information stored about the one or more enrolled biometric features includes data that enables the comparison between the stored information and received biometric information without including enough information to reproduce the enrolled biometric features. In some embodiments, biometric module 109 stores the information about the enrolled biometric features in association with a user account of device 100. In some embodiments, biometric module 109 compares the received biometric information to an enrolled biometric feature to determine whether the received biometric information matches the enrolled biometric feature.

[0126] Contact/motion module 130 optionally detects contact with touch screen 112 (in conjunction with display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). Contact/motion module 130 includes various software components for performing various operations related to detection of contact, such as determining if contact has occurred (e.g., detecting a finger-down event), determining an intensity of the contact (e.g., the force or pressure of the contact or a substitute for the force or pressure of the contact), determining if there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-dragging events), and determining if the contact has ceased (e.g., detecting a finger-up event or a break in contact). Contact/motion module 130 receives contact data from the touch-sensitive surface. Determining movement of the point of contact, which is represented by a series of contact data, optionally includes determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (a change in magnitude and/or direction) of the point of contact. These operations are, optionally, applied to single contacts (e.g., one finger contacts) or to multiple simultaneous contacts (e.g., “multitouch”/multiple finger contacts). In some embodiments, contact/motion module 130 and display controller 156 detect contact on a touchpad.

[0127] In some embodiments, contact/motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined in accordance with software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of particular physical actuators and can be adjusted without changing the physical hardware of device 100). For example, a mouse “click” threshold of a trackpad or touch screen display can be set to any of a large range of predefined threshold values without changing the trackpad or touch screen display hardware. Additionally, in some implementations, a user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and/or by adjusting a plurality of intensity thresholds at once with a system-level click “intensity” parameter).

[0128] Contact/motion module 130 optionally detects a gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and/or intensities of detected contacts). Thus, a gesture is, optionally, detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger-down event followed by detecting a finger-up (liftoff) event at the same position (or substantially the same position) as the finger-down event (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger-down event followed by detecting one or more finger-dragging events, and subsequently followed by detecting a finger-up (liftoff) event.

[0129] Graphics module 132 includes various known software components for rendering and displaying graphics on touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual property) of graphics that are displayed. As used herein, the term “graphics” includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations, and the like.

[0130] In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is, optionally, assigned a corresponding code. Graphics module 132 receives, from applications etc., one or more codes specifying graphics to be displayed along with, if necessary, coordinate data and other graphic property data, and then generates screen image data to output to display controller 156.

[0131] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator(s) 167 to produce tactile outputs at one or more locations on device 100 in response to user interactions with device 100.

[0132] Text input module 134, which is, optionally, a component of graphics module 132, provides soft keyboards for entering text in various applications (e.g., contacts module 137, e-mail client module 140, IM module 141, browser module 147, and any other application that needs text input).

[0133] GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to telephone module 138 for use in location-based dialing; to camera module 143 as picture/video metadata; and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map/navigation widgets).

[0134] Authentication module 105 determines whether a requested operation (e.g., requested by an application of applications 136) is authorized to be performed. In some embodiments, authentication module 105 receives for an operation to be perform that optionally requires authentication. Authentication module 105 determines whether the operation is authorized to be performed, such as based on a series of factors, including the lock status of device 100, the location of device 100, whether a security delay has elapsed, whether received biometric information matches enrolled biometric features, and/or other factors. Once authentication module 105 determines that the operation is authorized to be performed, authentication module 105 triggers performance of the operation.

[0135] Applications 136 optionally include the following modules (or sets of instructions), or a subset or superset thereof:

• • [0136] Contacts module 137 (sometimes called an address book or contact list);
  • [0137] Telephone module 138;
  • [0138] Video conference module 139;
  • [0139] E-mail client module 140;
  • [0140] Instant messaging (IM) module 141;
  • [0141] Workout support module 142;
  • [0142] Camera module 143 for still and/or video images;
  • [0143] Image management module 144;
  • [0144] Video player module;
  • [0145] Music player module;
  • [0146] Browser module 147;
  • [0147] Calendar module 148;
  • [0148] Widget modules 149, which optionally include one or more of: weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6;
  • [0149] Widget creator module 150 for making user-created widgets 149-6;
  • [0150] Search module 151;
  • [0151] Video and music player module 152, which merges video player module and music player module;
  • [0152] Notes module 153;
  • [0153] Map module 154; and/or
  • [0154] Online video module 155.

[0155] Examples of other applications 136 that are, optionally, stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0156] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, contacts module 137 are, optionally, used to manage an address book or contact list (e.g., stored in application internal state 192 of contacts module 137 in memory 102 or memory 370), including: adding name(s) to the address book; deleting name(s) from the address book; associating telephone number(s), e-mail address(es), physical address(es) or other information with a name; associating an image with a name; categorizing and sorting names; providing telephone numbers or e-mail addresses to initiate and/or facilitate communications by telephone module 138, video conference module 139, e-mail client module 140, or IM module 141; and so forth.

[0157] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, telephone module 138 are optionally, used to enter a sequence of characters corresponding to a telephone number, access one or more telephone numbers in contacts module 137, modify a telephone number that has been entered, dial a respective telephone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As noted above, the wireless communication optionally uses any of a plurality of communications standards, protocols, and technologies.

[0158] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact/motion module 130, graphics module 132, text input module 134, contacts module 137, and telephone module 138, video conference module 139 includes executable instructions to initiate, conduct, and terminate a video conference between a user and one or more other participants in accordance with user instructions.

[0159] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, e-mail client module 140 includes executable instructions to create, send, receive, and manage e-mail in response to user instructions. In conjunction with image management module 144, e-mail client module 140 makes it very easy to create and send e-mails with still or video images taken with camera module 143.

[0160] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions to enter a sequence of characters corresponding to an instant message, to modify previously entered characters, to transmit a respective instant message (for example, using a Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for telephony-based instant messages or using XMPP, SIMPLE, or IMPS for Internet-based instant messages), to receive instant messages, and to view received instant messages. In some embodiments, transmitted and/or received instant messages optionally include graphics, photos, audio files, video files and/or other attachments as are supported in an MMS and/or an Enhanced Messaging Service (EMS). As used herein, “instant messaging” refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0161] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, workout support module 142 includes executable instructions to create workouts (e.g., with time, distance, and/or calorie burning goals); communicate with workout sensors (sports devices); receive workout sensor data; calibrate sensors used to monitor a workout; select and play music for a workout; and display, store, and transmit workout data.

[0162] In conjunction with touch screen 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact/motion module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions to capture still images or video (including a video stream) and store them into memory 102, modify characteristics of a still image or video, or delete a still image or video from memory 102.

[0163] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions to arrange, modify (e.g., edit), or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store still and/or video images.

[0164] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions to browse the Internet in accordance with user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0165] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, e-mail client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and data associated with calendars (e.g., calendar entries, to-do lists, etc.) in accordance with user instructions.

[0166] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and browser module 147, widget modules 149 are mini-applications that are, optionally, downloaded and used by a user (e.g., weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by the user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript® file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript® file (e.g., Yahoo!® Widgets).

[0167] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creator module 150 are, optionally, used by a user to create widgets (e.g., turning a user-specified portion of a web page into a widget).

[0168] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions to search for text, music, sound, image, video, and/or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0169] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow the user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions to display, present, or otherwise play back videos (e.g., on touch screen 112 or on an external, connected display via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0170] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, notes module 153 includes executable instructions to create and manage notes, to-do lists, and the like in accordance with user instructions.

[0171] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 are, optionally, used to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data on stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0172] In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, e-mail client module 140, and browser module 147, online video module 155 includes instructions that allow the user to access, browse, receive (e.g., by streaming and/or download), play back (e.g., on the touch screen or on an external, connected display via external port 124), send an e-mail with a link to a particular online video, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141, rather than e-mail client module 140, is used to send a link to a particular online video. Additional description of the online video application can be found in U.S. Provisional Patent Application No. 60/936,562, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed Jun. 20, 2007, and U.S. patent application Ser. No. 11/968,067, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed Dec. 31, 2007, the contents of which are hereby incorporated by reference in their entirety.

[0173] Each of the above-identified modules and applications corresponds to a set of executable instructions for performing one or more functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), procedures, or modules, and thus various subsets of these modules are, optionally, combined or otherwise rearranged in various embodiments. For example, video player module is, optionally, combined with music player module into a single module (e.g., video and music player module 152, FIG. 1A). In some embodiments, memory 102 optionally stores a subset of the modules and data structures identified above. Furthermore, memory 102 optionally stores additional modules and data structures not described above.

[0174] In some embodiments, device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad. By using a touch screen and/or a touchpad as the primary input control device for operation of device 100, the number of physical input control devices (such as push buttons, dials, and the like) on device 100 is, optionally, reduced.

[0175] The predefined set of functions that are performed exclusively through a touch screen and/or a touchpad optionally include navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates device 100 to a main, home, or root menu from any user interface that is displayed on device 100. In such embodiments, a “menu button” is implemented using a touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.

[0176] FIG. 1B is a block diagram illustrating exemplary components for event handling in accordance with some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3A) includes event sorter 170 (e.g., in operating system 126) and a respective application 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).

[0177] Event sorter 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which to deliver the event information. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates the current application view(s) displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device/global internal state 157 is used by event sorter 170 to determine which application(s) is (are) currently active, and application internal state 192 is used by event sorter 170 to determine application views 191 to which to deliver event information.

[0178] In some embodiments, application internal state 192 includes additional information, such as one or more of: resume information to be used when application 136-1 resumes execution, user interface state information that indicates information being displayed or that is ready for display by application 136-1, a state queue for enabling the user to go back to a prior state or view of application 136-1, and a redo/undo queue of previous actions taken by the user.

[0179] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about a sub-event (e.g., a user touch on touch-sensitive display 112, as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I/O subsystem 106 or a sensor, such as proximity sensor 166, accelerometer(s) 168, and/or microphone 113 (through audio circuitry 110). Information that peripherals interface 118 receives from I/O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0180] In some embodiments, event monitor 171 sends requests to the peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and/or for more than a predetermined duration).

[0181] In some embodiments, event sorter 170 also includes a hit view determination module 172 and/or an active event recognizer determination module 173.

[0182] Hit view determination module 172 provides software procedures for determining where a sub-event has taken place within one or more views when touch-sensitive display 112 displays more than one view. Views are made up of controls and other elements that a user can see on the display.

[0183] Another aspect of the user interface associated with an application is a set of views, sometimes herein called application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of a respective application) in which a touch is detected optionally correspond to programmatic levels within a programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is, optionally, called the hit view, and the set of events that are recognized as proper inputs are, optionally, determined based, at least in part, on the hit view of the initial touch that begins a touch-based gesture.

[0184] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies a hit view as the lowest view in the hierarchy which should handle the sub-event. In most circumstances, the hit view is the lowest level view in which an initiating sub-event occurs (e.g., the first sub-event in the sequence of sub-events that form an event or potential event). Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0185] Active event recognizer determination module 173 determines which view or views within a view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of a sub-event are actively involved views, and therefore determines that all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if touch sub-events were entirely confined to the area associated with one particular view, views higher in the hierarchy would still remain as actively involved views.

[0186] Event dispatcher module 174 dispatches the event information to an event recognizer (e.g., event recognizer 180). In embodiments including active event recognizer determination module 173, event dispatcher module 174 delivers the event information to an event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores in an event queue the event information, which is retrieved by a respective event receiver 182.

[0187] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In yet other embodiments, event sorter 170 is a stand-alone module, or a part of another module stored in memory 102, such as contact/motion module 130.

[0188] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a respective view of the application's user interface. Each application view 191 of the application 136-1 includes one or more event recognizers 180. Typically, a respective application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface kit or a higher level object from which application 136-1 inherits methods and other properties. In some embodiments, a respective event handler 190 includes one or more of: data updater 176, object updater 177, GUI updater 178, and/or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in a respective application view 191.

[0189] A respective event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes event receiver 182 and event comparator 184. In some embodiments, event recognizer 180 also includes at least a subset of: metadata 183, and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0190] Event receiver 182 receives event information from event sorter 170. The event information includes information about a sub-event, for example, a touch or a touch movement. Depending on the sub-event, the event information also includes additional information, such as location of the sub-event. When the sub-event concerns motion of a touch, the event information optionally also includes speed and direction of the sub-event. In some embodiments, events include rotation of the device from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation (also called device attitude) of the device.

[0191] Event comparator 184 compares the event information to predefined event or sub-event definitions and, based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definitions 186. Event definitions 186 contain definitions of events (e.g., predefined sequences of sub-events), for example, event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in an event (e.g., 187-1 and/or 187-2) include, for example, touch begin, touch end, touch movement, touch cancellation, and multiple touching. In one example, the definition for event 1 (187-1) is a double tap on a displayed object. The double tap, for example, comprises a first touch (touch begin) on the displayed object for a predetermined phase, a first liftoff (touch end) for a predetermined phase, a second touch (touch begin) on the displayed object for a predetermined phase, and a second liftoff (touch end) for a predetermined phase. In another example, the definition for event 2 (187-2) is a dragging on a displayed object. The dragging, for example, comprises a touch (or contact) on the displayed object for a predetermined phase, a movement of the touch across touch-sensitive display 112, and liftoff of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0192] In some embodiments, event definitions 186 include a definition of an event for a respective user-interface object. In some embodiments, event comparator 184 performs a hit test to determine which user-interface object is associated with a sub-event. For example, in an application view in which three user-interface objects are displayed on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user-interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object triggering the hit test.

[0193] In some embodiments, the definition for a respective event (187) also includes delayed actions that delay delivery of the event information until after it has been determined whether the sequence of sub-events does or does not correspond to the event recognizer's event type.

[0194] When a respective event recognizer 180 determines that the series of sub-events do not match any of the events in event definitions 186, the respective event recognizer 180 enters an event impossible, event failed, or event ended state, after which it disregards subsequent sub-events of the touch-based gesture. In this situation, other event recognizers, if any, that remain active for the hit view continue to track and process sub-events of an ongoing touch-based gesture.

[0195] In some embodiments, a respective event recognizer 180 includes metadata 183 with configurable properties, flags, and/or lists that indicate how the event delivery system should perform sub-event delivery to actively involved event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate how event recognizers interact, or are enabled to interact, with one another. In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate whether sub-events are delivered to varying levels in the view or programmatic hierarchy.

[0196] In some embodiments, a respective event recognizer 180 activates event handler 190 associated with an event when one or more particular sub-events of an event are recognized. In some embodiments, a respective event recognizer 180 delivers event information associated with the event to event handler 190. Activating an event handler 190 is distinct from sending (and deferred sending) sub-events to a respective hit view. In some embodiments, event recognizer 180 throws a flag associated with the recognized event, and event handler 190 associated with the flag catches the flag and performs a predefined process.

[0197] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver event information to event handlers associated with the series of sub-events or to actively involved views. Event handlers associated with the series of sub-events or with actively involved views receive the event information and perform a predetermined process.

[0198] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates the telephone number used in contacts module 137, or stores a video file used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates a new user-interface object or updates the position of a user-interface object. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.

[0199] In some embodiments, event handler(s) 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of a respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0200] It shall be understood that the foregoing discussion regarding event handling of user touches on touch-sensitive displays also applies to other forms of user inputs to operate multifunction devices 100 with input devices, not all of which are initiated on touch screens. For example, mouse movement and mouse button presses, optionally coordinated with single or multiple keyboard presses or holds; contact movements such as taps, drags, scrolls, etc. on touchpads; pen stylus inputs; movement of the device; oral instructions; detected eye movements; biometric inputs; and/or any combination thereof are optionally utilized as inputs corresponding to sub-events which define an event to be recognized.

[0201] FIG. 2 illustrates a portable multifunction device 100 having a touch screen 112 in accordance with some embodiments. The touch screen optionally displays one or more graphics within user interface (UI) 200. In this embodiment, as well as others described below, a user is enabled to select one or more of the graphics by making a gesture on the graphics, for example, with one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, right to left, upward and/or downward), and/or a rolling of a finger (from right to left, left to right, upward and/or downward) that has made contact with device 100. In some implementations or circumstances, inadvertent contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0202] Device 100 optionally also include one or more physical buttons, such as “home” or menu button 204. As described previously, menu button 204 is, optionally, used to navigate to any application 136 in a set of applications that are, optionally, executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touch screen 112.

[0203] In some embodiments, device 100 includes touch screen 112, menu button 204, push button 206 for powering the device on/off and locking the device, volume adjustment button(s) 208, subscriber identity module (SIM) card slot 210, headset jack 212, and docking/charging external port 124. Push button 206 is, optionally, used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the device by depressing the button and releasing the button before the predefined time interval has elapsed; and/or to unlock the device or initiate an unlock process. In an alternative embodiment, device 100 also accepts verbal input for activation or deactivation of some functions through microphone 113. Device 100 also, optionally, includes one or more contact intensity sensors 165 for detecting intensity of contacts on touch screen 112 and/or one or more tactile output generators 167 for generating tactile outputs for a user of device 100.

[0204] FIG. 3A is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communications interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. Communication buses 320 optionally include circuitry (sometimes called a chipset) that interconnects and controls communications between system components. Device 300 includes input/output (I/O) interface 330 comprising display 340, which is typically a touch screen display. I/O interface 330 also optionally includes a keyboard and/or mouse (or other pointing device) 350 and touchpad 355, tactile output generator 357 for generating tactile outputs on device 300 (e.g., similar to tactile output generator(s) 167 described above with reference to FIG. 1A), sensors 359 (e.g., optical, acceleration, proximity, touch-sensitive, and/or contact intensity sensors similar to contact intensity sensor(s) 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices remotely located from CPU(s) 310. In some embodiments, memory 370 stores programs, modules, and data structures analogous to the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A), or a subset thereof. Furthermore, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, word processing module 384, website creation module 386, disk authoring module 388, and/or spreadsheet module 390, while memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0205] Each of the above-identified elements in FIG. 3A is, optionally, stored in one or more of the previously mentioned memory devices. Each of the above-identified modules corresponds to a set of instructions for performing a function described above. The above-identified modules or computer programs (e.g., sets of instructions or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), procedures, or modules, and thus various subsets of these modules are, optionally, combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the modules and data structures identified above. Furthermore, memory 370 optionally stores additional modules and data structures not described above.

[0206] Implementations within the scope of the present disclosure can be partially or entirely realized using a tangible computer-readable storage medium (or multiple tangible computer-readable storage media of one or more types) encoding one or more computer-readable instructions. It should be recognized that computer-readable instructions can be organized in any format, including applications, widgets, processes, software, and/or components.

[0207] Implementations within the scope of the present disclosure include a computer-readable storage medium that encodes instructions organized as an application (e.g., application 3160) that, when executed by one or more processing units, control an electronic device (e.g., device 3150) to perform the method of FIG. 3B, the method of FIG. 3C, and/or one or more other processes and/or methods described herein.

[0208] It should be recognized that application 3160 (shown in FIG. 3D) can be any suitable type of application, including, for example, one or more of: a browser application, an application that functions as an execution environment for plug-ins, widgets or other applications, a fitness application, a health application, a digital payments application, a media application, a social network application, a messaging application, and/or a maps application. In some embodiments, application 3160 is an application that is pre-installed on device 3150 at purchase (e.g., a first-party application). In some embodiments, application 3160 is an application that is provided to device 3150 via an operating system update file (e.g., a first-party application or a second-party application). In some embodiments, application 3160 is an application that is provided via an application store. In some embodiments, the application store can be an application store that is pre-installed on device 3150 at purchase (e.g., a first-party application store). In some embodiments, the application store is a third-party application store (e.g., an application store that is provided by another application store, downloaded via a network, and/or read from a storage device).

[0209] Referring to FIG. 3B and FIG. 3F, application 3160 obtains information (e.g., 3010). In some embodiments, at 3010, information is obtained from at least one hardware component of device 3150. In some embodiments, at 3010, information is obtained from at least one software module of device 3150. In some embodiments, at 3010, information is obtained from at least one hardware component external to device 3150 (e.g., a peripheral device, an accessory device, and/or a server). In some embodiments, the information obtained at 3010 includes positional information, time information, notification information, user information, environment information, electronic device state information, weather information, media information, historical information, event information, hardware information, and/or motion information. In some embodiments, in response to and/or after obtaining the information at 3010, application 3160 provides the information to a system (e.g., 3020).

[0210] In some embodiments, the system (e.g., 3110 shown in FIG. 3E) is an operating system hosted on device 3150. In some embodiments, the system (e.g., 3110 shown in FIG. 3E) is an external device (e.g., a server, a peripheral device, an accessory, and/or a personal computing device) that includes an operating system.

[0211] Referring to FIG. 3C and FIG. 3G, application 3160 obtains information (e.g., 3030). In some embodiments, the information obtained at 3030 includes positional information, time information, notification information, user information, environment information electronic device state information, weather information, media information, historical information, event information, hardware information, and/or motion information. In response to and/or after obtaining the information at 3030, application 3160 performs an operation with the information (e.g., 3040). In some embodiments, the operation performed at 3040 includes: providing a notification based on the information, sending a message based on the information, displaying the information, controlling a user interface of a fitness application based on the information, controlling a user interface of a health application based on the information, controlling a focus mode based on the information, setting a reminder based on the information, adding a calendar entry based on the information, and/or calling an API of system 3110 based on the information.

[0212] In some embodiments, one or more steps of the method of FIG. 3B and/or the method of FIG. 3C is performed in response to a trigger. In some embodiments, the trigger includes detection of an event, a notification received from system 3110, a user input, and/or a response to a call to an API provided by system 3110.

[0213] In some embodiments, the instructions of application 3160, when executed, control device 3150 to perform the method of FIG. 3B and/or the method of FIG. 3C by calling an application programming interface (API) (e.g., API 3190) provided by system 3110. In some embodiments, application 3160 performs at least a portion of the method of FIG. 3B and/or the method of FIG. 3C without calling API 3190.

[0214] In some embodiments, one or more steps of the method of FIG. 3B and/or the method of FIG. 3C includes calling an API (e.g., API 3190) using one or more parameters defined by the API. In some embodiments, the one or more parameters include a constant, a key, a data structure, an object, an object class, a variable, a data type, a pointer, an array, a list or a pointer to a function or method, and/or another way to reference a data or other item to be passed via the API.

[0215] Referring to FIG. 3D, device 3150 is illustrated. In some embodiments, device 3150 is a personal computing device, a smart phone, a smart watch, a fitness tracker, a head mounted display (HMD) device, a media device, a communal device, a speaker, a television, and/or a tablet. As illustrated in FIG. 3D, device 3150 includes application 3160 and an operating system (e.g., system 3110 shown in FIG. 3E). Application 3160 includes application implementation module 3170 and API-calling module 3180. System 3110 includes API 3190 and implementation module 3100. It should be recognized that device 3150, application 3160, and/or system 3110 can include more, fewer, and/or different components than illustrated in FIGS. 3D and 3E.

[0216] In some embodiments, application implementation module 3170 includes a set of one or more instructions corresponding to one or more operations performed by application 3160. For example, when application 3160 is a messaging application, application implementation module 3170 can include operations to receive and send messages. In some embodiments, application implementation module 3170 communicates with API-calling module 3180 to communicate with system 3110 via API 3190 (shown in FIG. 3E).

[0217] In some embodiments, API 3190 is a software module (e.g., a collection of computer-readable instructions) that provides an interface that allows a different module (e.g., API-calling module 3180) to access and/or use one or more functions, methods, procedures, data structures, classes, and/or other services provided by implementation module 3100 of system 3110. For example, API-calling module 3180 can access a feature of implementation module 3100 through one or more API calls or invocations (e.g., embodied by a function or a method call) exposed by API 3190 (e.g., a software and/or hardware module that can receive API calls, respond to API calls, and/or send API calls) and can pass data and/or control information using one or more parameters via the API calls or invocations. In some embodiments, API 3190 allows application 3160 to use a service provided by a Software Development Kit (SDK) library. In some embodiments, application 3160 incorporates a call to a function or method provided by the SDK library and provided by API 3190 or uses data types or objects defined in the SDK library and provided by API 3190. In some embodiments, API-calling module 3180 makes an API call via API 3190 to access and use a feature of implementation module 3100 that is specified by API 3190. In such embodiments, implementation module 3100 can return a value via API 3190 to API-calling module 3180 in response to the API call. The value can report to application 3160 the capabilities or state of a hardware component of device 3150, including those related to aspects such as input capabilities and state, output capabilities and state, processing capability, power state, storage capacity and state, and/or communications capability. In some embodiments, API 3190 is implemented in part by firmware, microcode, or other low level logic that executes in part on the hardware component.

[0218] In some embodiments, API 3190 allows a developer of API-calling module 3180 (which can be a third-party developer) to leverage a feature provided by implementation module 3100. In such embodiments, there can be one or more API-calling modules (e.g., including API-calling module 3180) that communicate with implementation module 3100. In some embodiments, API 3190 allows multiple API-calling modules written in different programming languages to communicate with implementation module 3100 (e.g., API 3190 can include features for translating calls and returns between implementation module 3100 and API-calling module 3180) while API 3190 is implemented in terms of a specific programming language. In some embodiments, API-calling module 3180 calls APIs from different providers such as a set of APIs from an OS provider, another set of APIs from a plug-in provider, and/or another set of APIs from another provider (e.g., the provider of a software library) or creator of the another set of APIs.

[0219] Examples of API 3190 can include one or more of: a pairing API (e.g., for establishing secure connection, e.g., with an accessory), a device detection API (e.g., for locating nearby devices, e.g., media devices and/or smartphone), a payment API, a UIKit API (e.g., for generating user interfaces), a location detection API, a locator API, a maps API, a health sensor API, a sensor API, a messaging API, a push notification API, a streaming API, a collaboration API, a video conferencing API, an application store API, an advertising services API, a web browser API (e.g., WebKit API), a vehicle API, a networking API, a WiFi API, a Bluetooth API, an NFC API, a UWB API, a fitness API, a smart home API, contact transfer API, photos API, camera API, and/or image processing API. In some embodiments, the sensor API is an API for accessing data associated with a sensor of device 3150. For example, the sensor API can provide access to raw sensor data. For another example, the sensor API can provide data derived (and/or generated) from the raw sensor data. In some embodiments, the sensor data includes temperature data, image data, video data, audio data, heart rate data, IMU (inertial measurement unit) data, lidar data, location data, GPS data, and/or camera data. In some embodiments, the sensor includes one or more of an accelerometer, temperature sensor, infrared sensor, optical sensor, heartrate sensor, barometer, gyroscope, proximity sensor, temperature sensor, and/or biometric sensor.

[0220] In some embodiments, implementation module 3100 is a system (e.g., operating system and/or server system) software module (e.g., a collection of computer-readable instructions) that is constructed to perform an operation in response to receiving an API call via API 3190. In some embodiments, implementation module 3100 is constructed to provide an API response (via API 3190) as a result of processing an API call. By way of example, implementation module 3100 and API-calling module 3180 can each be any one of an operating system, a library, a device driver, an API, an application program, or other module. It should be understood that implementation module 3100 and API-calling module 3180 can be the same or different type of module from each other. In some embodiments, implementation module 3100 is embodied at least in part in firmware, microcode, or hardware logic.

[0221] In some embodiments, implementation module 3100 returns a value through API 3190 in response to an API call from API-calling module 3180. While API 3190 defines the syntax and result of an API call (e.g., how to invoke the API call and what the API call does), API 3190 might not reveal how implementation module 3100 accomplishes the function specified by the API call. Various API calls are transferred via the one or more application programming interfaces between API-calling module 3180 and implementation module 3100. Transferring the API calls can include issuing, initiating, invoking, calling, receiving, returning, and/or responding to the function calls or messages. In other words, transferring can describe actions by either of API-calling module 3180 or implementation module 3100. In some embodiments, a function call or other invocation of API 3190 sends and/or receives one or more parameters through a parameter list or other structure.

[0222] In some embodiments, implementation module 3100 provides more than one API, each providing a different view of or with different aspects of functionality implemented by implementation module 3100. For example, one API of implementation module 3100 can provide a first set of functions and can be exposed to third-party developers, and another API of implementation module 3100 can be hidden (e.g., not exposed) and provide a subset of the first set of functions and also provide another set of functions, such as testing or debugging functions which are not in the first set of functions. In some embodiments, implementation module 3100 calls one or more other components via an underlying API and thus is both an API-calling module and an implementation module. It should be recognized that implementation module 3100 can include additional functions, methods, classes, data structures, and/or other features that are not specified through API 3190 and are not available to API-calling module 3180. It should also be recognized that API-calling module 3180 can be on the same system as implementation module 3100 or can be located remotely and access implementation module 3100 using API 3190 over a network. In some embodiments, implementation module 3100, API 3190, and/or API-calling module 3180 is stored in a machine-readable medium, which includes any mechanism for storing information in a form readable by a machine (e.g., a computer or other data processing system). For example, a machine-readable medium can include magnetic disks, optical disks, random access memory; read only memory, and/or flash memory devices.

[0223] An application programming interface (API) is an interface between a first software process and a second software process that specifies a format for communication between the first software process and the second software process. Limited APIs (e.g., private APIs or partner APIs) are APIs that are accessible to a limited set of software processes (e.g., only software processes within an operating system or only software processes that are approved to access the limited APIs). Public APIs that are accessible to a wider set of software processes. Some APIs enable software processes to communicate about or set a state of one or more input devices (e.g., one or more touch sensors, proximity sensors, visual sensors, motion/orientation sensors, pressure sensors, intensity sensors, sound sensors, wireless proximity sensors, biometric sensors, buttons, switches, rotatable elements, and/or external controllers). Some APIs enable software processes to communicate about and/or set a state of one or more output generation components (e.g., one or more audio output generation components, one or more display generation components, and/or one or more tactile output generation components). Some APIs enable particular capabilities (e.g., scrolling, handwriting, text entry, image editing, and/or image creation) to be accessed, performed, and/or used by a software process (e.g., generating outputs for use by a software process based on input from the software process). Some APIs enable content from a software process to be inserted into a template and displayed in a user interface that has a layout and/or behaviors that are specified by the template.

[0224] Many software platforms include a set of frameworks that provides the core objects and core behaviors that a software developer needs to build software applications that can be used on the software platform. Software developers use these objects to display content onscreen, to interact with that content, and to manage interactions with the software platform. Software applications rely on the set of frameworks for their basic behavior, and the set of frameworks provides many ways for the software developer to customize the behavior of the application to match the specific needs of the software application. Many of these core objects and core behaviors are accessed via an API. An API will typically specify a format for communication between software processes, including specifying and grouping available variables, functions, and protocols. An API call (sometimes referred to as an API request) will typically be sent from a sending software process to a receiving software process as a way to accomplish one or more of the following: the sending software process requesting information from the receiving software process (e.g., for the sending software process to take action on), the sending software process providing information to the receiving software process (e.g., for the receiving software process to take action on), the sending software process requesting action by the receiving software process, or the sending software process providing information to the receiving software process about action taken by the sending software process. Interaction with a device (e.g., using a user interface) will in some circumstances include the transfer and/or receipt of one or more API calls (e.g., multiple API calls) between multiple different software processes (e.g., different portions of an operating system, an application and an operating system, or different applications) via one or more APIs (e.g., via multiple different APIs). For example, when an input is detected the direct sensor data is frequently processed into one or more input events that are provided (e.g., via an API) to a receiving software process that makes some determination based on the input events, and then sends (e.g., via an API) information to a software process to perform an operation (e.g., change a device state and/or user interface) based on the determination. While a determination and an operation performed in response could be made by the same software process, alternatively the determination could be made in a first software process and relayed (e.g., via an API) to a second software process, that is different from the first software process, that causes the operation to be performed by the second software process. Alternatively, the second software process could relay instructions (e.g., via an API) to a third software process that is different from the first software process and/or the second software process to perform the operation. It should be understood that some or all user interactions with a computer system could involve one or more API calls within a step of interacting with the computer system (e.g., between different software components of the computer system or between a software component of the computer system and a software component of one or more remote computer systems). It should be understood that some or all user interactions with a computer system could involve one or more API calls between steps of interacting with the computer system (e.g., between different software components of the computer system or between a software component of the computer system and a software component of one or more remote computer systems).

[0225] In some embodiments, the application can be any suitable type of application, including, for example, one or more of: a browser application, an application that functions as an execution environment for plug-ins, widgets or other applications, a fitness application, a health application, a digital payments application, a media application, a social network application, a messaging application, and/or a maps application.

[0226] In some embodiments, the application is an application that is pre-installed on the first computer system at purchase (e.g., a first-party application). In some embodiments, the application is an application that is provided to the first computer system via an operating system update file (e.g., a first-party application). In some embodiments, the application is an application that is provided via an application store. In some embodiments, the application store is pre-installed on the first computer system at purchase (e.g., a first-party application store) and allows download of one or more applications. In some embodiments, the application store is a third-party application store (e.g., an application store that is provided by another device, downloaded via a network, and/or read from a storage device). In some embodiments, the application is a third-party application (e.g., an app that is provided by an application store, downloaded via a network, and/or read from a storage device). In some embodiments, the application controls the first computer system to perform methods 700, 900, 1100, 1300, 1500, 1700, 1900, and/or 2100 (FIGS. 7, 9A-9B, 11A-11B, 13, 15, 17, 19, and/or 21) by calling an application programming interface (API) provided by the system process using one or more parameters.

[0227] In some embodiments, exemplary APIs provided by the system process include one or more of: a pairing API (e.g., for establishing secure connection, e.g., with an accessory), a device detection API (e.g., for locating nearby devices, e.g., media devices and/or smartphone), a payment API, a UIKit API (e.g., for generating user interfaces), a location detection API, a locator API, a maps API, a health sensor API, a sensor API, a messaging API, a push notification API, a streaming API, a collaboration API, a video conferencing API, an application store API, an advertising services API, a web browser API (e.g., WebKit API), a vehicle API, a networking API, a WiFi API, a Bluetooth API, an NFC API, a UWB API, a fitness API, a smart home API, contact transfer API, a photos API, a camera API, and/or an image processing API.

[0228] In some embodiments, at least one API is a software module (e.g., a collection of computer-readable instructions) that provides an interface that allows a different module (e.g., API-calling module 3180) to access and use one or more functions, methods, procedures, data structures, classes, and/or other services provided by an implementation module of the system process. The API can define one or more parameters that are passed between the API-calling module and the implementation module. In some embodiments, API 3190 defines a first API call that can be provided by API-calling module 3180. The implementation module is a system software module (e.g., a collection of computer-readable instructions) that is constructed to perform an operation in response to receiving an API call via the API. In some embodiments, the implementation module is constructed to provide an API response (via the API) as a result of processing an API call. In some embodiments, the implementation module is included in the device (e.g., 3150) that runs the application. In some embodiments, the implementation module is included in an electronic device that is separate from the device that runs the application.

[0229] Attention is now directed towards embodiments of user interfaces that are, optionally, implemented on, for example, portable multifunction device 100.

[0230] FIG. 4A illustrates an exemplary user interface for a menu of applications on portable multifunction device 100 in accordance with some embodiments. Similar user interfaces are, optionally, implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

• • [0231] Signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals;
  • [0232] Time 404;
  • [0233] Bluetooth indicator 405;
  • [0234] Battery status indicator 406;
  • [0235] Tray 408 with icons for frequently used applications, such as:
    • [0236] Icon 416 for telephone module 138, labeled “Phone,” which optionally includes an indicator 414 of the number of missed calls or voicemail messages;
    • [0237] Icon 418 for e-mail client module 140, labeled “Mail,” which optionally includes an indicator 410 of the number of unread e-mails;
    • [0238] Icon 420 for browser module 147, labeled “Browser;” and
    • [0239] Icon 422 for video and music player module 152, also referred to as iPod (trademark of Apple Inc.) module 152, labeled “iPod;” and
  • [0240] Icons for other applications, such as:
    • [0241] Icon 424 for IM module 141, labeled “Messages;”
    • [0242] Icon 426 for calendar module 148, labeled “Calendar;”
    • [0243] Icon 428 for image management module 144, labeled “Photos;”
    • [0244] Icon 430 for camera module 143, labeled “Camera;”
    • [0245] Icon 432 for online video module 155, labeled “Online Video;”
    • [0246] Icon 434 for stocks widget 149-2, labeled “Stocks;”
    • [0247] Icon 436 for map module 154, labeled “Maps;”
    • [0248] Icon 438 for weather widget 149-1, labeled “Weather;”
    • [0249] Icon 440 for alarm clock widget 149-4, labeled “Clock;”
    • [0250] Icon 442 for workout support module 142, labeled “Workout Support;”
    • [0251] Icon 444 for notes module 153, labeled “Notes;” and
    • [0252] Icon 446 for a settings application or module, labeled “Settings,” which provides access to settings for device 100 and its various applications 136.

[0253] It should be noted that the icon labels illustrated in FIG. 4A are merely exemplary. For example, icon 422 for video and music player module 152 is labeled “Music” or “Music Player.” Other labels are, optionally, used for various application icons. In some embodiments, a label for a respective application icon includes a name of an application corresponding to the respective application icon. In some embodiments, a label for a particular application icon is distinct from a name of an application corresponding to the particular application icon.

[0254] FIG. 4B illustrates an exemplary user interface on a device (e.g., device 300, FIG. 3A) with a touch-sensitive surface 451 (e.g., a tablet or touchpad 355, FIG. 3A) that is separate from the display 450 (e.g., touch screen display 112). Device 300 also, optionally, includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and/or one or more tactile output generators 357 for generating tactile outputs for a user of device 300.

[0255] Although some of the examples that follow will be given with reference to inputs on touch screen display 112 (where the touch-sensitive surface and the display are combined), in some embodiments, the device detects inputs on a touch-sensitive surface that is separate from the display, as shown in FIG. 4B. In some embodiments, the touch-sensitive surface (e.g., touch-sensitive surface 451 in FIG. 4B) has a primary axis (e.g., 452 in FIG. 4B) that corresponds to a primary axis (e.g., 453 in FIG. 4B) on the display (e.g., display 450). In accordance with these embodiments, the device detects contacts (e.g., contact 460 and contact 462 in FIG. 4B) with the touch-sensitive surface 451 at locations that correspond to respective locations on the display (e.g., in FIG. 4B, contact 460 corresponds to 468 and contact 462 corresponds to 470). In this way, user inputs (e.g., contact 460 and contact 462, and movements thereof) detected by the device on the touch-sensitive surface (e.g., touch-sensitive surface 451 in FIG. 4B) are used by the device to manipulate the user interface on the display (e.g., display 450 in FIG. 4B) of the multifunction device when the touch-sensitive surface is separate from the display. It should be understood that similar methods are, optionally, used for other user interfaces described herein.

[0256] Additionally, while the following examples are given primarily with reference to finger inputs (e.g., finger contacts, finger tap gestures, finger swipe gestures), it should be understood that, in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., a mouse-based input or stylus input). For example, a swipe gesture is, optionally, replaced with a mouse click (e.g., instead of a contact) followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is, optionally, replaced with a mouse click while the cursor is located over the location of the tap gesture (e.g., instead of detection of the contact followed by ceasing to detect the contact). Similarly, when multiple user inputs are simultaneously detected, it should be understood that multiple computer mice are, optionally, used simultaneously, or a mouse and finger contacts are, optionally, used simultaneously.

[0257] FIG. 5A illustrates exemplary personal electronic device 500. Device 500 includes body 502. In some embodiments, device 500 can include some or all of the features described with respect to devices 100 and 300 (e.g., FIGS. 1A-4B). In some embodiments, device 500 has touch-sensitive display screen 504, hereafter touch screen 504. Alternatively, or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors for detecting intensity of contacts (e.g., touches) being applied. The one or more intensity sensors of touch screen 504 (or the touch-sensitive surface) can provide output data that represents the intensity of touches. The user interface of device 500 can respond to touches based on their intensity, meaning that touches of different intensities can invoke different user interface operations on device 500.

[0258] Exemplary techniques for detecting and processing touch intensity are found, for example, in related applications: International Patent Application Serial No. PCT/US2013/040061, titled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed May 8, 2013, published as WIPO Publication No. WO/2013/169849, and International Patent Application Serial No. PCT/US2013/069483, titled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed Nov. 11, 2013, published as WIPO Publication No. WO/2014/105276, each of which is hereby incorporated by reference in their entirety.

[0259] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can permit attachment of device 500 with, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch straps, chains, trousers, belts, shoes, purses, backpacks, and so forth. These attachment mechanisms permit device 500 to be worn by a user.

[0260] FIG. 5B depicts exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3A. Device 500 has bus 512 that operatively couples I/O section 514 with one or more computer processors 516 and memory 518. I/O section 514 can be connected to display screen 504, which can have touch-sensitive component 522 and, optionally, intensity sensor 524 (e.g., contact intensity sensor). In addition, I/O section 514 can be connected with communication unit 530 for receiving application and operating system data, using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and/or other wireless communication techniques. Device 500 can include input mechanisms 506 and/or 508. Input mechanism 506 is, optionally, a rotatable input device or a depressible and rotatable input device, for example. Input mechanism 508 is, optionally, a button, in some examples.

[0261] Input mechanism 508 is, optionally, a microphone, in some examples. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, directional sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and/or a combination thereof, all of which can be operatively connected to I/O section 514.

[0262] Memory 518 of personal electronic device 500 can include one or more non-transitory computer-readable storage media, for storing computer-executable instructions, which, when executed by one or more computer processors 516, for example, can cause the computer processors to perform the techniques described below, including processes described with respect to FIGS. 7, 9A-9B, 11A-11B, 13, 15, 17, 19, and 21 (processes 700, 900, 1100, 1300, 1500, 1700, 1900, and 2100). A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with the instruction execution system, apparatus, or device. In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium can include, but is not limited to, magnetic, optical, and/or semiconductor storages. Examples of such storage include magnetic disks, optical discs based on CD, DVD, or Blu-ray® technologies, as well as persistent solid-state memory such as flash, solid-state drives, and the like. Personal electronic device 500 is not limited to the components and configuration of FIG. 5B, but can include other or additional components in multiple configurations.

[0263] As used here, the term “affordance” refers to a user-interactive graphical user interface object that is, optionally, displayed on the display screen of devices 100, 300, and/or 500 (FIGS. 1A, 3A, and 5A-5B). For example, an image (e.g., icon), a button, and text (e.g., hyperlink) each optionally constitute an affordance.

[0264] As used herein, the term “focus selector” refers to an input element that indicates a current part of a user interface with which a user is interacting. In some implementations that include a cursor or other location marker, the cursor acts as a “focus selector” so that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in FIG. 3A or touch-sensitive surface 451 in FIG. 4B) while the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted in accordance with the detected input. In some implementations that include a touch screen display (e.g., touch-sensitive display system 112 in FIG. 1A or touch screen 112 in FIG. 4A) that enables direct interaction with user interface elements on the touch screen display, a detected contact on the touch screen acts as a “focus selector” so that when an input (e.g., a press input by the contact) is detected on the touch screen display at a location of a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted in accordance with the detected input. In some implementations, focus is moved from one region of a user interface to another region of the user interface without corresponding movement of a cursor or movement of a contact on a touch screen display (e.g., by using a tab key or arrow keys to move focus from one button to another button); in these implementations, the focus selector moves in accordance with movement of focus between different regions of the user interface. Without regard to the specific form taken by the focus selector, the focus selector is generally the user interface element (or contact on a touch screen display) that is controlled by the user so as to communicate the user's intended interaction with the user interface (e.g., by indicating, to the device, the element of the user interface with which the user is intending to interact). For example, the location of a focus selector (e.g., a cursor, a contact, or a selection box) over a respective button while a press input is detected on the touch-sensitive surface (e.g., a touchpad or touch screen) will indicate that the user is intending to activate the respective button (as opposed to other user interface elements shown on a display of the device).

[0265] As used in the specification and claims, the term “characteristic intensity” of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is, optionally, based on a predefined number of intensity samples, or a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) relative to a predefined event (e.g., after detecting the contact, prior to detecting liftoff of the contact, before or after detecting a start of movement of the contact, prior to detecting an end of the contact, before or after detecting an increase in intensity of the contact, and/or before or after detecting a decrease in intensity of the contact). A characteristic intensity of a contact is, optionally, based on one or more of: a maximum value of the intensities of the contact, a mean value of the intensities of the contact, an average value of the intensities of the contact, a top 10 percentile value of the intensities of the contact, a value at the half maximum of the intensities of the contact, a value at the 90 percent maximum of the intensities of the contact, or the like. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an operation has been performed by a user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact with a characteristic intensity that does not exceed the first threshold results in a first operation, a contact with a characteristic intensity that exceeds the first intensity threshold and does not exceed the second intensity threshold results in a second operation, and a contact with a characteristic intensity that exceeds the second threshold results in a third operation. In some embodiments, a comparison between the characteristic intensity and one or more thresholds is used to determine whether or not to perform one or more operations (e.g., whether to perform a respective operation or forgo performing the respective operation), rather than being used to determine whether to perform a first operation or a second operation.

[0266] FIG. 5C illustrates detecting a plurality of contacts 552A-552E on touch-sensitive display screen 504 with a plurality of intensity sensors 524A-524D. FIG. 5C additionally includes intensity diagrams that show the current intensity measurements of the intensity sensors 524A-524D relative to units of intensity. In this example, the intensity measurements of intensity sensors 524A and 524D are each 9 units of intensity, and the intensity measurements of intensity sensors 524B and 524C are each 7 units of intensity. In some implementations, an aggregate intensity is the sum of the intensity measurements of the plurality of intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a respective intensity that is a portion of the aggregate intensity. FIG. 5D illustrates assigning the aggregate intensity to contacts 552A-552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E are assigned an intensity of contact of 8 intensity units of the aggregate intensity, and each of contacts 552C and 552D are assigned an intensity of contact of 4 intensity units of the aggregate intensity. More generally, in some implementations, each contact j is assigned a respective intensity Ij that is a portion of the aggregate intensity, A, in accordance with a predefined mathematical function, Ij=A·(Dj/ΣDi), where Dj is the distance of the respective contact j to the center of force, and ΣDi is the sum of the distances of all the respective contacts (e.g., i=1 to last) to the center of force. The operations described with reference to FIGS. 5C-5D can be performed using an electronic device similar or identical to device 100, 300, or 500. In some embodiments, a characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, the intensity sensors are used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity diagrams are not part of a displayed user interface, but are included in FIGS. 5C-5D to aid the reader.

[0267] In some embodiments, a portion of a gesture is identified for purposes of determining a characteristic intensity. For example, a touch-sensitive surface optionally receives a continuous swipe contact transitioning from a start location and reaching an end location, at which point the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end location is, optionally, based on only a portion of the continuous swipe contact, and not the entire swipe contact (e.g., only the portion of the swipe contact at the end location). In some embodiments, a smoothing algorithm is, optionally, applied to the intensities of the swipe contact prior to determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of: an unweighted sliding-average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and/or an exponential smoothing algorithm. In some circumstances, these smoothing algorithms eliminate narrow spikes or dips in the intensities of the swipe contact for purposes of determining a characteristic intensity.

[0268] The intensity of a contact on the touch-sensitive surface is, optionally, characterized relative to one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and/or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform operations typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform operations that are different from operations typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact-detection intensity threshold below which the contact is no longer detected), the device will move a focus selector in accordance with movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise stated, these intensity thresholds are consistent between different sets of user interface figures.

[0269] An increase of characteristic intensity of the contact from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a “light press” input. An increase of characteristic intensity of the contact from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a “deep press” input. An increase of characteristic intensity of the contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting the contact on the touch-surface. A decrease of characteristic intensity of the contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold is sometimes referred to as detecting liftoff of the contact from the touch-surface. In some embodiments, the contact-detection intensity threshold is zero. In some embodiments, the contact-detection intensity threshold is greater than zero.

[0270] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a respective press input or in response to detecting the respective press input performed with a respective contact (or a plurality of contacts), where the respective press input is detected based at least in part on detecting an increase in intensity of the contact (or plurality of contacts) above a press-input intensity threshold. In some embodiments, the respective operation is performed in response to detecting the increase in intensity of the respective contact above the press-input intensity threshold (e.g., a “down stroke” of the respective press input). In some embodiments, the press input includes an increase in intensity of the respective contact above the press-input intensity threshold and a subsequent decrease in intensity of the contact below the press-input intensity threshold, and the respective operation is performed in response to detecting the subsequent decrease in intensity of the respective contact below the press-input threshold (e.g., an “up stroke” of the respective press input).

[0271] FIGS. 5E-5H illustrate detection of a gesture that includes a press input that corresponds to an increase in intensity of a contact 562 from an intensity below a light press intensity threshold (e.g., “IT_L”) in FIG. 5E, to an intensity above a deep press intensity threshold (e.g., “IT_D”) in FIG. 5H. The gesture performed with contact 562 is detected on touch-sensitive surface 560 while cursor 576 is displayed over application icon 572B corresponding to App 2, on a displayed user interface 570 that includes application icons 572A-572D displayed in predefined region 574. In some embodiments, the gesture is detected on touch-sensitive display screen 504. The intensity sensors detect the intensity of contacts on touch-sensitive surface 560. The device determines that the intensity of contact 562 peaked above the deep press intensity threshold (e.g., “IT_D”). Contact 562 is maintained on touch-sensitive surface 560. In response to the detection of the gesture, and in accordance with contact 562 having an intensity that goes above the deep press intensity threshold (e.g., “IT_D”) during the gesture, reduced-scale representations 578A-578C (e.g., thumbnails) of recently opened documents for App 2 are displayed, as shown in FIGS. 5F-5H. In some embodiments, the intensity, which is compared to the one or more intensity thresholds, is the characteristic intensity of a contact. It should be noted that the intensity diagram for contact 562 is not part of a displayed user interface, but is included in FIGS. 5E-5H to aid the reader.

[0272] In some embodiments, the display of representations 578A-578C includes an animation. For example, representation 578A is initially displayed in proximity of application icon 572B, as shown in FIG. 5F. As the animation proceeds, representation 578A moves upward and representation 578B is displayed in proximity of application icon 572B, as shown in FIG. 5G. Then, representations 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed in proximity of application icon 572B, as shown in FIG. 5H. Representations 578A-578C form an array above icon 572B. In some embodiments, the animation progresses in accordance with an intensity of contact 562, as shown in FIGS. 5F-5G, where the representations 578A-578C appear and move upwards as the intensity of contact 562 increases toward the deep press intensity threshold (e.g., “IT_D”). In some embodiments, the intensity, on which the progress of the animation is based, is the characteristic intensity of the contact. The operations described with reference to FIGS. 5E-5H can be performed using an electronic device similar or identical to device 100, 300, or 500.

[0273] In some embodiments, the device employs intensity hysteresis to avoid accidental inputs sometimes termed “jitter,” where the device defines or selects a hysteresis intensity threshold with a predefined relationship to the press-input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press-input intensity threshold or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press-input intensity threshold). Thus, in some embodiments, the press input includes an increase in intensity of the respective contact above the press-input intensity threshold and a subsequent decrease in intensity of the contact below the hysteresis intensity threshold that corresponds to the press-input intensity threshold, and the respective operation is performed in response to detecting the subsequent decrease in intensity of the respective contact below the hysteresis intensity threshold (e.g., an “up stroke” of the respective press input). Similarly, in some embodiments, the press input is detected only when the device detects an increase in intensity of the contact from an intensity at or below the hysteresis intensity threshold to an intensity at or above the press-input intensity threshold and, optionally, a subsequent decrease in intensity of the contact to an intensity at or below the hysteresis intensity, and the respective operation is performed in response to detecting the press input (e.g., the increase in intensity of the contact or the decrease in intensity of the contact, depending on the circumstances).

[0274] For ease of explanation, the descriptions of operations performed in response to a press input associated with a press-input intensity threshold or in response to a gesture including the press input are, optionally, triggered in response to detecting either: an increase in intensity of a contact above the press-input intensity threshold, an increase in intensity of a contact from an intensity below the hysteresis intensity threshold to an intensity above the press-input intensity threshold, a decrease in intensity of the contact below the press-input intensity threshold, and/or a decrease in intensity of the contact below the hysteresis intensity threshold corresponding to the press-input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting a decrease in intensity of a contact below the press-input intensity threshold, the operation is, optionally, performed in response to detecting a decrease in intensity of the contact below a hysteresis intensity threshold corresponding to, and lower than, the press-input intensity threshold.

[0275] As used herein, an “installed application” refers to a software application that has been downloaded onto an electronic device (e.g., devices 100, 300, and/or 500) and is ready to be launched (e.g., become opened) on the device. In some embodiments, a downloaded application becomes an installed application by way of an installation program that extracts program portions from a downloaded package and integrates the extracted portions with the operating system of the computer system.

[0276] As used herein, the terms “open application” or “executing application” refer to a software application with retained state information (e.g., as part of device/global internal state 157 and/or application internal state 192). An open or executing application is, optionally, any one of the following types of applications:

• • [0277] an active application, which is currently displayed on a display screen of the device that the application is being used on;
  • [0278] a background application (or background processes), which is not currently displayed, but one or more processes for the application are being processed by one or more processors; and
  • [0279] a suspended or hibernated application, which is not running, but has state information that is stored in memory (volatile and non-volatile, respectively) and that can be used to resume execution of the application.

[0280] As used herein, the term “closed application” refers to software applications without retained state information (e.g., state information for closed applications is not stored in a memory of the device). Accordingly, closing an application includes stopping and/or removing application processes for the application and removing state information for the application from the memory of the device. Generally, opening a second application while in a first application does not close the first application. When the second application is displayed and the first application ceases to be displayed, the first application becomes a background application.

[0281] As described herein, content is automatically generated by one or more computers in response to a request to generate the content. The automatically-generated content is optionally generated on-device (e.g., generated at least in part by a computer system at which a request to generate the content is received) and/or generated off-device (e.g., generated at least in part by one or more nearby computers that are available via a local network or one or more computers that are available via the internet). This automatically-generated content optionally includes visual content (e.g., images, graphics, and/or video), audio content, and/or text content.

[0282] In some embodiments, novel automatically-generated content that is generated via one or more artificial intelligence (AI) processes is referred to as generative content (e.g., generative images, generative graphics, generative video, generative audio, and/or generative text). Generative content is typically generated by an AI process based on a prompt that is provided to the AI process. An AI process typically uses one or more AI models to generate an output based on an input. An AI process optionally includes one or more pre-processing steps to adjust the input before it is used by the AI model to generate an output (e.g., adjustment to a user-provided prompt, creation of a system-generated prompt, and/or AI model selection). An AI process optionally includes one or more post-processing steps to adjust the output by the AI model (e.g., passing AI model output to a different AI model, upscaling, downscaling, cropping, formatting, and/or adding or removing metadata) before the output of the AI model used for other purposes such as being provided to a different software process for further processing or being presented (e.g., visually or audibly) to a user. An AI process that generates generative content is sometimes referred to as a generative AI process.

[0283] A prompt for generating generative content can include one or more of: one or more words (e.g., a natural language prompt that is written or spoken), one or more images, one or more drawings, and/or one or more videos. AI processes can include machine learning models including neural networks. Neural networks can include transformer-based deep neural networks such as large language models (LLMs). Generative pre-trained transformer models are a type of LLM that can be effective at generating novel generative content based on a prompt. Some AI processes use a prompt that includes text to generate either different generative text, generative audio content, and/or generative visual content. Some AI processes use a prompt that includes visual content and/or an audio content to generate generative text (e.g., a transcription of audio and/or a description of the visual content). Some multi-modal AI processes use a prompt that includes multiple types of content (e.g., text, images, audio, video, and/or other sensor data) to generate generative content. A prompt sometimes also includes values for one or more parameters indicating an importance of various parts of the prompt. Some prompts include a structured set of instructions that can be understood by an AI process that include phrasing, a specified style, relevant context (e.g., starting point content and/or one or more examples), and/or a role for the AI process.

[0284] Generative content is generally based on the prompt but is not deterministically selected from pre-generated content and is, instead, generated using the prompt as a starting point. In some embodiments, pre-existing content (e.g., audio, text, and/or visual content) is used as part of the prompt for creating generative content (e.g., the pre-existing content is used as a starting point for creating the generative content). For example, a prompt could request that a block of text be summarized or rewritten in a different tone, and the output would be generative text that is summarized or written in the different tone. Similarly, a prompt could request that visual content be modified to include or exclude content specified by a prompt (e.g., removing an identified feature in the visual content, adding a feature to the visual content that is described in a prompt, changing a visual style of the visual content, and/or creating additional visual elements outside of a spatial or temporal boundary of the visual content that are based on the visual content). In some embodiments, a random or pseudo-random seed is used as part of the prompt for creating generative content (e.g., the random or pseud-random seed content is used as a starting point for creating the generative content). For example, when generating an image from a diffusion model, a random noise pattern is iteratively denoised based on the prompt to generate an image that is based on the prompt. While specific types of AI processes have been described herein, it should be understood that a variety of different AI processes could be used to generate generative content based on a prompt.

[0285] Attention is now directed towards embodiments of user interfaces (“UI”) and associated processes that are implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0286] FIGS. 6A-6AM illustrate exemplary techniques and systems for controlling a computer system based on variable characteristics of hardware inputs, in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below.

[0287] FIGS. 6A, 6B, and 6C illustrate back (e.g., FIG. 6A), isometric (e.g., FIG. 6B), and front (e.g., FIG. 6D) views of computer system 600 (e.g., a mobile phone device) that includes a set of hardware buttons including first button 602A, second button 602B, third button 602C, and fourth button 602D, a set of cameras including first camera 604A, second camera 604B, third camera 604C, and 604D, and a display 606 including a touch-sensitive surface. As illustrated in FIG. 6C, the set of hardware buttons including first button 602A are arranged outside of the display on the edges of computer system 600. In FIGS. 6A and 6C-6AM, the set of hardware buttons including first button 602A are illustrated as extending up (e.g., protruding) from the edge of device 600; however, as illustrated in FIG. 6B, in some embodiments, the set of hardware buttons including first 602A are flush with, or even inset below, the edge of device 600. It should be noted that buttons that are flush with or inset below the edge of the device are less prone to accidental activation while the device is being held.

[0288] In some embodiments, the set of hardware buttons may include different numbers of buttons, different arrangements of buttons, different types of buttons (e.g., mechanical and/or solid-state buttons, described in further detail with respect to FIG. 6C), and/or compound buttons (e.g., one or more independently-operable buttons combined into a compound form or housing). In some embodiments, the set of cameras may include different numbers of cameras, different arrangements of cameras, and/or different types of cameras. For example, the different types of cameras may include one or more wide-angle lenses, one or more telephoto lenses, and/or one or more macro lenses. For example, the different types of cameras may vary in geometry (e.g., physical or equivalent focal lengths, such as 5 mm, 13 mm, 22 mm, 24 mm, 28 mm, 50 mm, 77 mm, 100 mm, and/or 300 mm, or f-stops of f/1.2, f/1.78, f/2.2, f/2.8, f/3.4, and/or f/8.4), resolution (e.g., 8 MP, 12 MP, 24 MP, 48 MP, and/or 72 MP), pixel size (e.g., 100 nm, 0.5 μm, 1.0 μm, 2.44 μm, 5 μm), and/or presence of other hardware features (e.g., dual or quad pixels, dual pixel autofocus capabilities, and/or optical image stabilization capabilities). In some embodiments, computer system 600 includes one or more sensors, such as light sensors, depth sensors, motion sensors, and/or audio sensors. In some embodiments, the methods described herein using computer system 600 are implemented using (e.g., in conjunction with computer system 600) one or more user devices (e.g., mobile phones, tablet computers, laptop computers, and/or wearable electronic devices (e.g., smart watches)), remote devices (e.g., servers and/or network-connected devices), and/or peripheral devices (e.g., external storage drives, microphones, speakers, and/or hardware input devices). In some embodiments, computer system 600 includes one or more features of devices 100, 300, or 500 (e.g., the set of cameras can include optical sensor 164).

[0289] FIG. 6C illustrates exemplary hardware button states (A)-(E) that can be detected by computer system 600 via the set of hardware buttons (e.g., first button 602A, second button 602B, third button 602C, and/or fourth button 602D). The top panel (I) illustrates an embodiment including a pressure-sensitive button that does not physically depress when pressure is applied by a user (e.g., a solid-state button), and the bottom panel (II) illustrates an embodiment including a mechanical button, which physically depresses when pressure is applied by a user (e.g., by the user's finger 608). In some embodiments, a pressure-sensitive button that does not physically depress (e.g., a solid-state button) includes one or more haptic (e.g., tactile) output generators that create the sensation of physically depressing the button by different amounts (e.g., as illustrated in bottom panel (II)) without the button actually moving (e.g., as illustrated in top panel (I)). In some embodiments, the solid-state button and/or the mechanical button include one or more pressure sensors, one or more capacitive (e.g., touch) sensors, and/or one or more intensity sensors (e.g., as described with respect to FIGS. 5C-5D). In some embodiments, computer system 600 may detect hardware button states (A)-(E) based on touch proximity, the directly-measured applied pressure, and/or the amount of physical (e.g., mechanical) depression of a button. In some embodiments, the pressure (e.g., intensity) thresholds and depression thresholds described below may correspond to the same states of the hardware button, for example, such that applying the threshold pressure values P_M, P_A, and/or P_F physically depresses a hardware button to the respective depression levels T_M, T_A, and/or T_F. In some embodiments, one or more of the hardware buttons is a hybrid button that uses both intensity (e.g., pressure) sensitivity and mechanical depression to detect input characteristics, as described in further detail below. For example, one or more of hardware button states (A)-(E) are detected using the physical depression of the hybrid button (e.g., as a substitute measurement for force/pressure) and one or more of hardware button states (A)-(E) are detected using the intensity sensors of the hybrid button (e.g., directly measuring force/pressure applied to the hybrid button).

[0290] In some embodiments, the pressure (e.g., intensity) thresholds and depression thresholds described below are customizable. For example, a user can define custom values for threshold pressure values P_M, P_A, and/or P_F and/or threshold depression levels T_M, T_A, and/or T_F by inputting numeric values, adjusting threshold controls in a user interface (e.g., using displayed sliders, dials, or menus to adjust the thresholds up and down and/or to select between different presets), and/or inputting presses of different intensities in a testing user interface to generate one or more of the thresholds based on detected characteristics of the test presses. Accordingly, references to the hardware button states (e.g., (A)-(E)) and press types (e.g., light/partial presses and/or hard/full presses) described with respect to said thresholds are to be understood as being implemented with threshold pressure values P_M, P_A, and/or P_F and/or threshold depression levels T_M, T_A, and/or T_F as currently defined by computer system 600. Additionally, in some embodiments, the pressure (e.g., intensity) thresholds and depression thresholds described below differ between two or more different hardware buttons of a plurality of hardware buttons. For example, the threshold pressure values P_M, P_A, and/or P_F and/or the threshold depression levels T_M, T_A, and/or T_F for first button 602A are different than the threshold pressure values P_M, P_A, and/or P_F and/or the threshold depression levels T_M, T_A, and/or T_F for second button 602B. For example, a user can define different custom values for two or more different hardware buttons.

[0291] As illustrated in FIG. 6C, computer system 600 detects hardware button state (A) when a user is not using or pressing the hardware button. Accordingly, as illustrated in bottom panel (II), in hardware button state (A), the mechanical button is not (e.g., 0%) physically depressed (e.g., the mechanical button is in a “rest” position). Computer system 600 detects hardware button state (B) when a finger is detected (e.g., using the one or more capacitive sensors) near (e.g., hovering over) or resting on (e.g., touching, but not pressing) the button. As illustrated in bottom panel (II), in hardware button state (B), the mechanical button remains in the rest position. In some embodiments, computer system 600 may detect hardware button state (B) when less than a maintenance pressure threshold P_M (e.g., 5 g/cm², 10 g/cm², 16 g/cm², or 20 g/cm²) is detected (e.g., using the one or more pressure sensors) and/or when a mechanical button is physically depressed less than a maintenance depression threshold T_M (e.g., the least-depressed state illustrated in bottom panel (II); e.g., 2% depressed, 5% depressed, 10% depressed, or 18% depressed).

[0292] Computer system 600 detects hardware button state (C) when the user begins to press the hardware button. In some embodiments, computer system 600 detects hardware button state (C) when a user applies pressure P_(C) to the button, where P_(C) is less than an activation pressure threshold P_A (e.g., 25 g/cm², 50 g/cm², 75 g/cm², 82 g/cm², or 100 g/cm²) and, in some embodiments, greater or equal to than the maintenance pressure threshold P_M. In some embodiments, computer system 600 detects hardware button state (C) when a mechanical button is physically depressed less than an activation depression threshold T_A (e.g., the partially-depressed state illustrated in bottom panel (II); e.g., 15% depressed, 30% depressed, 40% depressed, 43% depressed, or 50% depressed) and, in some embodiments, physically depressed to at least the maintenance depression threshold T_M.

[0293] Computer system 600 registers a “light” or “partial” press (e.g., a first type of button press) of the hardware button when computer system 600 detects hardware button state (D). In some embodiments, computer system 600 detects hardware button state (D) when a user applies pressure P_(D) to the button, where P_(D) is less than a hard-press pressure threshold P_H (e.g., 75 g/cm², 100 g/cm², 123 g/cm², or 150 g/cm²) and greater than or equal to the activation pressure threshold P_A. In some embodiments, computer system 600 detects hardware button state (D) when a mechanical button is physically depressed less than a hard-press depression threshold T_H(e.g., the mostly-depressed state illustrated in bottom panel (II); e.g., 65% depressed, 72% depressed, 80% depressed, or 90% depressed) and physically depressed to at least the activation depression threshold T_A. In some embodiments, once computer system 600 detects hardware button state (D) (e.g., “activating” the light/partial button press), computer system 600 will register hardware button state (C) (e.g., “maintaining” the light/partial button press) as a continued or maintained light/partial press (e.g., the first type of button press), for instance, until computer system 600 detects one of hardware button state (A), hardware button state (B) (e.g., releasing the light/partial button press), or hardware button state (E) (e.g., transitioning to a hard/full press, as described below). For example, once the user has activated a light/partial press by pressing a button with more than the activation pressure threshold P_A and/or beyond the activation depression threshold T_A, the user can maintain the light/partial press with a lighter touch, as long as the button is still pressed with more than the maintenance pressure threshold P_M and/or beyond the maintenance depression threshold T_M. In some embodiments, presses meeting a light press intensity threshold (e.g., as described above with respect to FIGS. 5C-5D) may be registered as light/partial-type button presses (for example, a light press intensity may correspond to hardware button state (C) and/or hardware button state (D)). As used herein, a light/partial press corresponds to a light press and/or a partial press, and a hard/full press corresponds to a hard and/or full press.

[0294] Computer system 600 registers as a “hard” or “full” press (e.g., a second type of button press) when computer system 600 detects hardware button state (E). In some embodiments, computer system 600 detects hardware button state (E) when a user applies pressure P_(E) to the button, where P_(E) is greater than or equal to the hard-press pressure threshold P_H, and/or when a mechanical button is physically depressed to at least the hard-press depression threshold T_H. In some embodiments, if computer system 600 detects hardware button state (E) less than a threshold duration of time (e.g., 0.1, 0.25 s, 0.5 s, 1 s, or 2 s) after detecting hardware button state (D), computer system 600 registers hardware button state (E) as a “quick” hard/full press and, in some embodiments, does not register or respond to the detection of hardware button state (D) as a light/partial press. For example, a user can provide a hard/full press without necessarily activating a light/partial press by quickly increasing pressure from activation pressure threshold P_A to hard-press pressure threshold P_H and/or quickly depressing the button from activation depression threshold T_A to hard-press depression threshold T_H. In some embodiments, presses meeting a deep press intensity threshold (e.g., as described above with respect to FIGS. 5C-5D) may be registered as hard/full-type button presses (for example, a deep press intensity may correspond to hardware button state (E)).

[0295] In the following, where computer system 600 is described as “detecting” the intensity of a press, computer system 600 may measure the intensity directly, based on sensor data, and/or indirectly, based on physical depression to a certain state, for instance, depending on whether first button 602A is a solid-state or physically-depressible button and/or how many distinct physical depression states first button 602A has. For example, a hard/full press may be detected either by measuring an intensity greater than hard-press pressure threshold P_H and/or detecting first button 602A depressing to hard-press depression threshold T_H. For example, using a hybrid button, a hard/full press is detected when the hybrid button has been physically depressed to hard-press depression threshold T_H, a light/partial press is detected by directly measuring an intensity greater than or equal to the activation pressure threshold P_A (e.g., without physically depressing to hard-press depression threshold T_H), and maintenance of a light/partial press is detected by directly measuring an intensity greater or equal to than the maintenance pressure threshold P_M. In some embodiments, computer system 600 provides tactile feedback using the one or more haptic (e.g., tactile) output generators when a press reaches an intensity threshold measured using the intensity sensors (e.g., the user feels a vibration and/or other tactile sensation when inputting a light/partial press) but foregoes providing tactile feedback when a press reaches an intensity threshold measured using the mechanical states (e.g., because the user can physically feel the hardware button reaching the hard/full press state).

[0296] FIGS. 6D-6E illustrate using a press of one of the hardware buttons to launch a camera user interface from a non-camera context, such as a video application. As illustrated in FIG. 6D, while displaying user interface 610 for a media player application, computer system detects input 609, a press input of first button 602A. In some embodiments, input 609 is a particular type of input, such as a hard/full press placing first button 602A into hardware button state (E) or a light/partial press placing first button 602A into hardware button state (D).

[0297] In response to detecting input 609, at FIG. 6E, computer system 600 launches camera user interface 612 of a first-party camera application of computer system 600, for example, opening and/or displaying the first-party camera application. In some embodiments, computer system 600 launches camera user interface 612 in response to press inputs of first button 602A such as 609 if camera user interface 612 is associated with first button 602A and will launch a different camera user interface (e.g., 1046) if the other camera is associated with first button 602A. For example, the user can select between a plurality of camera utilities (e.g., user interfaces and/or applications) to associate with first button 602A using a settings menu for computer system 600 (e.g., as described in more detail with respect to FIGS. 10A-OW). In some embodiments, computer system 600 launches camera user interface 612, the associated camera utility, in response to press inputs of first button 602A, such as 609 if the press input is detected while displaying a non-camera user interface, such as user interface 610 for a media player application, a home or lock screen of computer system 600, an application without a camera utility (e.g., a game, a clock application, and/or a podcast application), and/or a non-camera user interface of an application that includes an embedded camera utility (e.g., a social media application, a financial application, a creative application, and/or a messaging application).

[0298] As illustrated in FIG. 6E, camera user interface 612 includes touch controls 612A-612G for navigating, using, assisting with, and/or changing settings of the camera user interface via the touch-sensitive surface of display 606, and camera preview 614, which represents a portion of the field-of-view of the set of cameras of computer system 600, e.g., as it would currently be captured in a photo or video capture. Capture mode affordance 612A is a menu (e.g., a sliding toolbar) for selecting between capture modes including a standard photo capture mode (e.g., a mode for capturing photo media that are not designated for display with synthetic depth-of-field effects), a portrait capture mode (e.g., a mode for capturing photo media that are designated for display with synthetic depth-of-field effects, lighting effects, and/or other post-processing effects), a panoramic photo capture mode (e.g., a mode for capturing photos from different positions and/or angles that are stitched together to create a single, larger form-factor image), a standard video capture mode (e.g., a mode for capturing video media that are not designated for display with synthetic depth-of-field effects), and/or a cinematic video capture mode (e.g., a mode for capturing video media that are designated for display with synthetic depth-of-field effects, lighting effects, and/or other post-processing effects). Camera selection affordance 612B is a software button for switching between capture using a front-facing (e.g., environment-facing) camera (e.g., first camera 604A, second camera 604B, and/or third camera 604C) and using a back-facing (e.g., user-facing) camera (e.g., fourth camera 604D). Shutter affordance 612C is a software button that can be selected to initiate the capture of media. Captured media icon 612D is a selectable thumbnail icon that previews captured media and can be selected to view captured media (e.g., in a media viewing or media library user interface). Zoom affordance 612E is a menu (e.g., a platter of multiple software buttons) for changing the capture magnification and/or switching between cameras/lenses with different magnification. Multi-frame photo affordance 612F is a software button for toggling between capturing single-frame/still photo capture and capturing photo media with a limited duration (e.g., 1, 3, and/or 5 seconds), for example, including content from before and/or after a capture input is detected that can be displayed in sequence for a “live” effect. Camera flash affordance 612G is a software button for selecting a camera flash mode (e.g., on, off, or automatic).

[0299] FIGS. 6F-6I illustrate displaying an indicator of one or more characteristics of an input via the hardware button, which responds to changes in intensity of the input, changes in location of the input, and, as illustrated in FIG. 6I, morphs into a settings control element when the intensity of the input meets light/partial press criteria (e.g., hardware button state (D)). At FIG. 6I, the computer system additionally provides a tactile (e.g., haptic) output when the intensity of the input meets light/partial press criteria.

[0300] As illustrated in FIG. 6F, while displaying camera user interface 612, computer system 600 detects input 616, where finger 608 is resting on the surface of first button 602A but not applying enough pressure to qualify as a light/partial press (e.g., first button 602A is in hardware button state (B)). In response to detecting input 616, computer system 600 displays contact indicator 618. Contact indicator 618 is displayed as a cut-out from camera user interface 612 (e.g., blocking out a portion of camera user interface 612) extending into display 606 from the edge region of display 606 that is adjacent to first button 602A. Contact indicator 618 indicates certain characteristics of input 616. As shown in FIG. 6F, as finger 608 is resting on the left side of first button 602A, computer system 600 displays contact indicator 618 below the left side of first button 602A (e.g., indicating the current location of input 616), and as first button 602A is in hardware button state (B), computer system 600 displays contact indicator 618 as a relatively small cut-out (e.g., indicating the current intensity of input 616).

[0301] As illustrated in FIG. 6G, computer system 600 detects input 616 beginning to move, for example, detecting movement component 616A via one or more touch sensors of first button 602A. Accordingly, computer system 600 animates contact indicator 618 moving to the right (e.g., in the direction of movement component 616A) by an amount similar to the amount traveled by movement component 616A, for instance, deforming the cut-out shape of contact indicator 618 during the animation to depict the movement. For example, computer system 600 animates contact indicator 618 moving to remain below finger 608 as it moves to the right side of first button 602A.

[0302] In some embodiments, if detected movement component 616A exceeds a threshold magnitude, computer system 600 proceeds as discussed below with respect to FIG. 6J, displaying settings control 622 and displaying camera user interface 612 in a “quiet” mode. For example, a swipe input across the full length or a majority of the length of first button 602A along the edge of display 606 can be used additionally or alternatively to a light/partial press of first button 602A as discussed with respect to FIGS. 6I-6J.

[0303] As illustrated in FIG. 6H, computer system 600 detects input 616 increasing in intensity, transitioning from hardware button state (B) to hardware button state (C) without yet qualifying as a light/partial press. Accordingly, computer system 600 animates contact indicator 618 growing, indicating the increasing intensity, while remaining located below finger 608 on the right side of first button 602A. In some embodiments, in response to detecting input 616 decreasing in intensity (e.g., transitioning from hardware button state (C) to hardware button state (B)), computer system 600 shrinks contact indicator 618, and in response to detecting input 616 ending (e.g., transitioning to hardware button state (A)), computer system 600 stops displaying contact indicator 618.

[0304] As illustrated in FIGS. 6I-6J, computer system detects input 616 increasing in intensity past a light/partial press threshold, e.g., transitioning to hardware button state (D). In response to this light/partial press of first button 602A, computer system 600 displays settings control 622 for a zoom setting of camera user interface 612. In some embodiments, the zoom setting is associated with first button 602A as described with respect to FIGS. 10A-10W, below, when input 616 is detected.

[0305] As illustrated in FIG. 6I, before displaying settings control 622, computer system 600 displays contact indicator 618 growing further in size and morphing into the shape of settings control 622, a tab-shaped cut-out from camera user interface 612 extending into display 606 from the location of first button 602A. Additionally, computer system 600 provides tactile output 620 indicating that light/partial press of first button 602A has been detected, for example, providing a vibration or a tactile response simulating the feeling of lightly pressing or clicking a button at the location of first button 602A. As illustrated in FIGS. 6I-6J, computer system 600 also transitions camera user interface 612 to a “quiet” or “ready to capture” mode in response to the light/partial press of first button 602A. As illustrated in FIG. 6I, computer system 600 fades out (e.g., increases the transparency of and/or visually deemphasizes) several of the touch controls included in camera user interface 612, including capture mode affordance 612A, camera selection affordance 612B, captured media icon 612D, multi-frame photo affordance 612F, and camera flash affordance 612G. In some embodiments, computer system 600 displays removal of one or more of the touch controls in other manners, such as animating the removed touch controls sliding off of display 606. For the “quiet” or “ready to capture” mode of camera user interface 612, computer system also begins displaying levels affordance 612H, a histogram indicating the tonal range and content of camera preview 614, and a capture guidance grid displayed over camera preview 614.

[0306] FIG. 6J illustrates displaying a settings control element for a zoom setting of the camera user interface in response to the input meeting light/partial press criteria (along with an inset illustrating an alternative embodiment of the settings control element).

[0307] As illustrated in FIG. 6J, settings control 622 for the zoom setting of camera user interface 612 includes text indicating the current zoom level (“1×”), an icon representing the zoom setting, and a representation of a zoom scale. In particular, the representation of the zoom scale includes a plurality of tick marks representing ordered zoom levels in intervals of 0.1× zoom. As illustrated in FIG. 6J, the representation of the zoom scale includes a portion of an overall zoom scale with tick marks representing 0.6× to 1.9× zoom, and the tick mark representing the current zoom level of 1.0× is displayed at a center point of settings control 622 (e.g., centered within the cut-out tab of settings control 622). In some embodiments, computer system 600 centers the text indicating the current zoom level at the current tick mark, outside of the cut-out tab region of settings control 622, and in some embodiments, as illustrated by the side panel of FIG. 6J, computer system 600 displays the text indicating the current zoom level inside the cut-out tab of settings control 622 (e.g., to the side of the representation of the zoom scale). As illustrated in FIG. 6J, the representation of the zoom scale is oriented such that the zoom levels represented by the tick marks increase going from left to right with respect to the view of the environment included in camera preview 614. In particular, the tick mark representing 0.6× is located below the edge of first button 602A closest to the set of cameras (e.g., considered the “top” of the device), and the tick mark representing 1.9× is located below the edge of first button 602A the regions further away from the set of cameras (e.g., considered the “bottom” of the device). Settings control 622, and, in particular, the representation of the zoom scale, are described in greater detail with respect to FIGS. 14A-14Z, below.

[0308] As illustrated in FIG. 6J1, in some embodiments, settings control 622 is displayed with an appearance that simulates a curved, rotatable dial. The left panels illustrated in FIG. 6J1 represent settings control 622 as displayed via display 606 and the right panels represent corresponding top-down views of simulated dial 622′, which is simulated as curving outwards from the surface of display 606. Accordingly, to create the appearance of simulated dial 622′, system 600 gradually blurs, darkens, fades, and/or otherwise obscures the representation of the zoom scale (e.g., described in further detail below) as the zoom scale approaches the edges (e.g., the left and right edges where simulated dial 622′ has an appearance that appears to curve away from the user and into the surface of display 606) and/or distorts the representation of the zoom scale based on a projection of the apparent curve of simulated dial 622′ onto the surface of display 606, for instance, decreasing the spacing between tick marks as the zoom scale approaches the edges to simulate the foreshortening of placing the tick marks on the physically curved surface of simulated dial 622′. As illustrated in FIG. 6J1, the visual distortion simulating the curved dial is represented by the crosshatching at the edges of settings control 622. As illustrated in FIG. 6J1, when adjusting the zoom setting using settings control 622 (e.g., as described in detail herein), system 600 simulates input 613, a movement input swiping right-to-left along settings control 622, as an input rotating simulated dial 622′ clockwise, moving the previously-centered tick mark (marked with an arrow in FIG. 6J1) to the left and adjusting the appearance of settings control 622 to simulate the resulting position of simulated dial 622′.

[0309] FIG. 6K illustrates the display of settings control 622 at different orientation states of computer system 600. For example, using one or more motion or orientation sensors, computer system 600 detects how computer system 600 is being held with respect to the environment. In the Portrait 1 orientation state, computer system 600 is held in an “upright” portrait orientation with first button 602A to the right relative to the field of view of first camera 604A, second camera 604B, and/or third camera 604C; in the Portrait 2 orientation state, computer system 600 is held in an “upside-down” portrait orientation with first button 602A to the left relative to the field of view of first camera 604A, second camera 604B, and/or third camera 604C; in the Landscape 1 orientation state (e.g., the orientation state depicted in FIGS. 6E-6J and 6L-6V), computer system 600 is held in a “right-handed” portrait orientation with first button 602A at the top relative to the field of view of first camera 604A, second camera 604B, and/or third camera 604C; and in the Landscape 2 orientation state, is held in a “left-handed” portrait orientation with first button 602A at the bottom relative to the field of view of first camera 604A, second camera 604B, and/or third camera 604C. As illustrated in FIG. 6K, in each of the different orientation states, computer system 600 displays settings control 622 at a consistent position near the location of first button 602A (e.g., a hardware-locked position on the display), such that in Portrait 1, settings control 622 appears at the lower right edge of camera preview 614 (e.g., and/or camera user interface 612); in Portrait 2, settings control 622 appears at the upper left edge of camera preview 614; in Landscape 1, settings control 622 appears at the top edge of camera preview 614; and in Landscape 2, settings control 622 appears at the bottom edge of camera preview 614. Additionally, in each of the different orientation states, computer system 600 orients the representation of the zoom scale in the same manner with respect to first button 602A, such that the zoom levels represented by the tick marks increase going in the direction from the set of cameras towards the charging port of computer system 600, whether that direction is up, down, left, or right with respect to camera preview 614. In some embodiments, computer system 600 rotates some elements of the camera user interface and/or settings control 622 as the orientation state changes. In particular, as illustrated in FIG. 6K, computer system 600 rotates the text indicating the current zoom level (“1×”), the text included in zoom affordance 612E, and levels affordance 612H with respect to the hardware such that those elements appear upright with respect to the camera preview.

[0310] FIGS. 6L-6T illustrate adjusting the zoom setting of camera user interface 612 and capturing media in response to various inputs, including movement inputs (e.g., swipes, flicks, and/or directional taps) detected while displaying settings control 622 and press inputs of first button 602A.

[0311] At FIG. 6L, while displaying settings control 622 for the zoom setting of camera user interface 612, computer system 600 detects a movement input, such as movement component 616B of input 616 where finger 608 swipes from right to left along the surface of first button 602A and/or touch input 624A, a right-to-left swipe gesture (e.g., a touch with movement) directed to settings control 622 on the touch-sensitive surface of display 606. In some embodiments, once settings control 622 is displayed in response to the light/partial press of first button 602A (e.g., once the intensity of input 616 passes the light/partial press threshold), computer system 600 continues displaying settings control 622 and displaying camera user interface 612 in the “quiet” mode, and remains responsive to detected movement inputs, after the intensity of input 616 drops below the light/partial press intensity. For example, as illustrated in FIGS. 6L, movement component 616A is detected while the intensity of input 616 has lessened, placing first button 602A into hardware button state (C). In some embodiments, input 616 can be fully lifted off of first button 602A (e.g., in hardware button state (A)) while detecting touch input 624A via settings control 622 on the touch-sensitive surface of display 606. In some embodiments, computer system 600 continues displaying settings control 622 and displaying camera user interface 612 in the “quiet” mode and remains responsive to detected movement inputs for at least a threshold period of time (e.g., 0.25 s, 0.3 s, 0.5 s, or 1 s) after contact with first button 602A and/or with settings control 622 on the touch-sensitive surface of display 606 lifts off, allowing the user to briefly lift and replace finger 608 without needing to provide another light/partial press.

[0312] At FIG. 6L, computer system 600 adjusts the zoom setting of camera user interface 612 based on the detected movement input (e.g., movement component 616B and/or touch input 624A), increasing the zoom level (e.g., zooming in) from 1× to 3.4× zoom as shown by the increased magnification of the field-of-view of the environment displayed in camera preview 614. In particular, adjusting to increase the zoom level (e.g., zooming in) corresponds to the direction of the detected movement input with respect to the displayed representation of the zoom scale, and adjusting the zoom level by a magnitude of 1.4× corresponds to the magnitude of the detected movement input with respect to the displayed representation of the zoom scale. For example, computer system 600 makes the adjustment based on the detected movement input as if settings control 622 were a physical zoom dial (e.g., with the same or a proportional scale to the displayed representation of the zoom scale, such as simulated rotatable dial 622′, illustrated in FIG. 6J1) being rotated by input 616 and/or touch input 624A.

[0313] In some embodiments, adjusting the zoom level includes performing an optical zoom (e.g., switching between capturing camera data using first camera 604A, second camera 604B, and/or third camera 604C for the different magnifications produced by each different lens), performing a digital zoom (e.g., digitally cropping the portion of the field-of-view of the environment represented in camera preview 614), or a combination of both an optical zoom and a digital zoom.

[0314] As illustrated in FIG. 6L, upon adjusting the zoom setting of camera user interface 612 to 3.4× magnification, computer system 600 displays the representation of the zoom scale with the tick mark representing 3.4× zoom at the center point of settings control 622, surrounded by tick marks representing 1.8× to 6.6× zoom, and additionally updates the text indicating the current zoom level in settings control 622 to 3.4×. In some embodiments, computer system 600 additionally updates the text included in zoom affordance 612E to reflect the current zoom level. In some embodiments, computer system 600 animates the representation of the zoom scale sliding to the left along with movement component 616A and/or touch input 624A (e.g., as described further with respect to FIGS. 14A-14Z), for instance, with the same speed/acceleration or a proportionate speed/acceleration as movement component 616B and/or touch input 624, as if the representation of the zoom scale were being physically dragged. In some embodiments, computer system 600 updates the text of settings control 622 and/or displays camera preview 614 at the zoom levels represented by the tick marks as they move past the center of settings control 622, providing a “live” preview of the zoom adjustment during the movement inputs.

[0315] FIGS. 6M-6N illustrate adjusting the zoom setting of camera user interface 612 in response to detecting a “flick” movement via first button 602A and/or the touch-sensitive surface of display 606, also described in detail with respect to FIGS. 14A-14Z. At FIG. 6M, computer system 600 detects a movement input, such as movement component 616C of input 616 swiping further from right to left along the surface of first button 602A (e.g., while in hardware button state (B)) and/or touch input 624B, a further right-to-left swipe gesture directed to settings control 622 on the touch-sensitive surface of display 606, and begins adjusting the zoom setting as described with respect to FIG. 6L, increasing the zoom level from 3.4× zoom to 4.0× zoom. At FIG. 6N, without first slowing down and/or stopping the right-to-left movement of movement component 616C and/or touch input 624B, the user lifts off of (e.g., ceases contact with) first button 602A and/or the touch-sensitive surface of display 606, producing a right-to-left “flick” movement. Computer system 600 thus detects a flick movement based on detecting a lift-off from first button 602A and/or the touch-sensitive surface of display 606 coupled with movement near (e.g., before and/or after) the time of the lift-off. A flick input is generally differentiated from a drag input because a flick input ends (e.g., based on lift off of the input) with more than a threshold amount of movement while a drag input ends (e.g., based on lift off of the input or an end of motion of the input) with less than the threshold amount of movement. Operations that are performed in response to detecting a flick input typically include a component of the operation that is performed after the flick input ends (e.g., based on simulated inertia based on the movement that was detected when the flick input ended).

[0316] As illustrated in FIG. 6N, in response to detecting the right-to-left flick movement, computer system 600 increases the zoom setting of camera user interface 612 to 8.0×, displaying the representation of the zoom scale with the tick mark representing 8.0× at the center point of settings control 622. As described further with respect to FIGS. 14A-14Z, in some embodiments, the adjustment to the zoom setting made after detecting the lift-off (e.g., zooming in from 4.0× to 8.0×) is a “snapping” adjustment that adjusts to the next zoom value in a predetermined set of zoom values (e.g., 8.0×, 2.0×, 1.0×, and 0.5×) in response to the flick, and in some embodiments, the adjustment to the zoom setting made after detecting the lift-off (e.g., zooming in from 4.0× to 8.0×) is based on simulated physics, for instance, as though the flick gesture were transferring momentum to a physical zoom dial that keeps spinning to 8.0×. Accordingly, the user can zoom in to 8.0× zoom without needing to provide a movement input of a commensurate distance (e.g., as described with respect to FIG. 6L). Following the lift-off detected at FIG. 6N, computer system 600 continues displaying settings control 622 and displaying camera user interface 612 in the “quiet” mode for at least the threshold period of time (e.g., 0.25 s, 0.3 s, 0.5 s, or 1 s).

[0317] At FIG. 6O, while continuing to display settings control 622 (e.g., within the threshold period of time after lift-off), computer system 600 detects resumed contact with first button 602A (e.g., hardware button state (B)) and/or with settings control 622 via the touch-sensitive surface of display 606 detects a subsequent movement input, such as movement component 616D of input 616 where finger 608 swipes from left to right along the surface of first button 602A and/or touch input 624C, a left-to-right swipe gesture (e.g., a touch with movement) directed to settings control 622 on the touch-sensitive surface of display 606. As contact with first button 602A and/or with settings control 622 is reestablished within the threshold period of time after lift-off, the intensity of input 616 does not need to exceed the light/partial press threshold (e.g., as described with respect to FIGS. 6I-6J) again before movement inputs are detected. For example, as illustrated in FIG. 6O, movement component 616D is detected while first button 602A is in hardware button state (B), e.g., with finger 608 just resting on the surface of the button.

[0318] As illustrated in FIG. 6O, in response to detecting the subsequent left-to-right movement input, computer system 600 adjusts the zoom setting of camera user interface 612 based on the detected movement input, decreasing the zoom level (e.g., zooming out) from 8× to 2.8× zoom. As discussed with respect to FIG. 6L, decreasing the zoom level to 2.8× zoom corresponds to the direction and magnitude of the detected movement input with respect to the displayed representation of the zoom scale, for example, adjusting the zoom level as though the movement inputs were physically dragging the tick mark representing 2.8× zoom in the representation of the zoom scale towards the center of settings control 622.

[0319] FIGS. 6P-6Q illustrate adjusting the zoom setting of camera user interface 612 in response to detecting a flick movement, as described above with respect to FIGS. 6M-6N. At FIG. 6P, computer system 600 detects a left-to-right movement input such as movement component 616E of input 616 and/or touch input 624D, and begins adjusting the zoom setting, decreasing the zoom level to 2.4× zoom. At FIG. 6Q, while continuing the left-to-right motion of the movement input(s), the user lifts off of first button 602A and/or the touch-sensitive surface of display 606, producing a left-to-right flick movement. As illustrated in FIG. 6Q, in response to detecting the left-to-right flick movement, computer system 600 decreases the zoom setting of camera user interface 612 to 2.0×, for example, based on simulating a transfer of momentum from the flick movement and/or based on 2.0× being the next predetermined “snapping” value in the direction of movement.

[0320] FIGS. 6R-6S illustrate adjusting the zoom setting of camera user interface 612 in response to detecting a directional tap input via first button 602A and/or the touch-sensitive surface of display 606. At FIG. 6R, while continuing to display settings control 622, computer system 600 detects input 616 briefly contacting and then lifting off of the right side of first button 602A and/or touch input 624E briefly contacting and then lifting off of the right side of settings control 622. As the right side of the representation of the zoom scale corresponds to higher zoom values, in response to detecting the tap inputs, computer system 600 adjusts the zoom setting of camera user interface 612, increasing the zoom level from 2.0× zoom to 8.0× zoom, the next predetermined “snapping” value in the direction of the tap. At FIG. 6S, while continuing to display settings control 622, computer system 600 detects input 616 briefly contacting and then lifting off of the left side of first button 602A and/or touch input 624F briefly contacting and then lifting off of the left side of settings control 622. As the left side of the representation of the zoom scale corresponds to lower zoom values, in response to detecting the tap inputs, computer system 600 adjusts the zoom setting of camera user interface 612, decreasing the zoom level from 8.0× zoom to 2.0× zoom, the next predetermined “snapping” value in the direction of the tap. Following the lift-off of the tap inputs at FIGS. 6R-6S, computer system 600 continues displaying settings control 622 and displaying camera user interface 612 in the “quiet” mode for at least the threshold period of time (e.g., 0.25 s, 0.3 s, 0.5 s, or 1 s).

[0321] At FIG. 6T, computer system 600 detects lift-off from of button 602A (e.g., ending input 616) and/or settings control 622 on the touch-sensitive surface of display 606. As discussed above, in some embodiments, computer system 600 continues displaying settings control 622 and displaying camera user interface 612 in the “quiet” mode for at least the threshold period of time (e.g., 0.25 s, 0.3 s, 0.5 s, or 1 s) after lift-off. If contact with button 602A and/or settings control 622 on the touch-sensitive surface of display 606 is not re-established within the threshold period of time, computer system 600 stops displaying settings control 622 and reverts camera user interface 612 to a default mode (e.g., the initial appearance of camera user interface 612 described with respect to FIG. 6E) as illustrated in FIG. 6U, ceasing display of levels affordance 612H and the capture guidance grid and re-displaying capture mode affordance 612A, camera selection affordance 612B, captured media icon 612D, multi-frame photo affordance 612F, and camera flash affordance 612G. Alternatively, in some embodiments, computer system 600 stops displaying settings control 622 and reverts camera user interface 612 to the default mode as illustrated in FIG. 6U in response to a separate input dismissing settings control 622. For example, as illustrated in FIG. 6T, the separate input dismissing settings control 622 may include touch input 626A, a swipe gesture moving across settings control 622 towards the outside edge of display 606, or touch input 626B, a touch input (e.g., a tap or press) directed to a portion of camera user interface 612 outside of the region of settings control 622.

[0322] As illustrated in FIG. 6U, after computer system 600 ceases displaying settings control 622 and returns camera user interface 612 to the default mode, the zoom setting of camera user interface 612 remains set to 2× zoom, the zoom level selected via settings control 622.

[0323] At FIG. 6U, while camera user interface 612 is in the default mode and settings control 622 is not displayed, computer system 600 detects input 628, a press input that places first button 602A into hardware button state (E) (e.g., applying intensity that exceeds a hard/full press intensity threshold), qualifying as a hard/full press. In some embodiments, computer system 600 does not display contact indicator 618, display settings control 622, and/or display camera user interface 612 in the “quiet” mode in response to input 628 if input 628 is a “quick” hard/full press. For example, a quick hard/full press places first button 602A into hardware button state (E) less than a first threshold duration of time after placing first button 602A into hardware button state (B) (e.g., after initiating contact with first button 602A) and/or less than a second threshold duration of time after placing first button 602A into hardware button state (D) (e.g., after reaching a light/partial press state).

[0324] In response to detecting input 628 (e.g., a hard/full press of first button 602A), computer system 600 initiates capturing media. As illustrated in FIGS. 6U-6V, the media is captured at 2× zoom, the zoom level selected via settings control 622. At FIG. 6V, computer system 600 detects lift-off from first button 602A within a threshold period of time (e.g., 0.5 s, 0.75 s, 1 s, or 1.5 s) after input 628 qualifies as a hard/full press (e.g., input 628 is a quick press, as discussed in more detail with respect to FIGS. 8A-8Z). Accordingly, computer system 600 captures photo media in response to input 628, updating captured media icon 612D to display a thumbnail of the captured photo media.

[0325] Although FIGS. 6L-6V depict adjusting a zoom setting of camera user interface 612 based on movement inputs while computer system 600 is in the Landscape 1 orientation state, it is to be understood that the techniques and user interfaces described with respect to FIGS. 6L-6V can be likewise applied to perform operations based on movement inputs in other orientation states. For example, FIGS. 6W-6AD illustrate controlling the zoom setting of camera user interface 612 using movement inputs while computer system 600 is in the Landscape 2 orientation state, and FIGS. 6AE-6AM illustrate controlling other operations (e.g., adjusting different settings of camera user interface 612) using movement inputs while in the Portrait 1 orientation state.

[0326] At FIG. 6W, computer system 600 detects input 630 placing first button 602A into hardware button state (D), qualifying as a light/partial press of first button 602A. In response to input 630 (and/or in response to a full swipe of first button 602A, as described above), computer system 600 displays settings control 622 for the zoom setting of camera user interface 612 and additionally displays camera user interface 612 in the “quiet” mode, as described with respect to FIGS. 6F-6J. As described with respect to FIG. 6K, at FIG. 6W, computer system 600 displays settings control 622 at the edge of display 606 near the location of first button 602A, which, while in the Landscape 2 orientation state, appears at the bottom left edge of camera preview 614. As illustrated in FIG. 6W, the representation of the zoom scale is oriented such that the zoom levels represented by the tick marks increase going from right to left with respect to the view of the environment included in camera preview 614. Although the orientation of the representation of the zoom scale in FIG. 6W is oriented opposite to the orientation illustrated in FIG. 6J with respect to the environment, the representation of the zoom scale is oriented consistently with respect to the hardware of computer system 600 regardless of the orientation state. Specifically, computer system 600 displays the tick mark representing the lowest displayed zoom level near the edge of first button 602A closest to the set of cameras (e.g., the “top” of the device) and the tick mark representing the highest displayed zoom level is located near the edge of first button 602A closest to, e.g., a charging port of computer system 600 (e.g., the “bottom” of the device). As described with respect to FIG. 6K, at FIG. 6W, computer system 600 displays the text indicating the current zoom level (“2×”), the text included in zoom affordance 612E, and levels affordance 612H oriented upright with respect to the environment.

[0327] At FIG. 6X, while displaying settings control 622, computer system 600 detects movement component 630A of input 630 via first button 602A (and/or a flick, directional tap, and/or a swipe directed to settings control 622 via the touch-sensitive surface of display 606, as discussed above), where finger 608 swipes from left to right along the surface of first button 602A. As illustrated in FIG. 6X, computer system 600 adjusts the zoom setting of camera user interface 612 based on movement component 630A, e.g., as described with respect to FIG. 6L. In particular, computer system 600 increases the zoom level (e.g., zooming in) from 2× to 3.4×, corresponding to the magnitude of movement component 630A and the direction of movement component 630A with respect to the displayed representation of the zoom scale. Accordingly, although movement component 630A is a movement from left to right and movement component 616B (in FIG. 6L) is a movement from right to left, e.g., with respect to the view of the environment included in camera preview 614, both movement component 630A and movement component 616B increase the zoom setting of camera user interface 612, as both movement components correspond to the same direction with respect to the displayed representation of the zoom scale (e.g., dragging the higher zoom level tick marks towards the center of settings control 622).

[0328] At FIG. 6Y, while displaying settings control 622, computer system 600 detects the input 630 transitioning first button 602A into hardware button state (E), e.g., increasing in intensity past the hard/full press threshold. As discussed with respect to FIG. 6U, in response to detecting the hard/full press of first button 602A, computer system 600 initiates media capture. As illustrated in FIG. 6Y, in response to detecting input 630 maintaining hardware button state (E) for at least a threshold period of time (e.g., 0.5 s, 0.75 s, 1 s, or 1.5 s), computer system 600 initiates capture of video media (e.g., as discussed in more detail with respect to FIGS. 8A-8P). While capturing video media, computer system 600 displays camera user interface 612 in a video capture mode, in particular, changing the aspect ratio of camera preview 614 to a wider format, ceasing display of levels affordance 612H, updating the appearance of shutter affordance 612C to appear as a stop recording button, and displaying capture timer 612I, as discussed in more detail with respect to FIGS. 8A-8P. Additionally, as computer system 600 detected the hard/full press of first button 602A while displaying settings control 622, computer system 600 continues displaying settings control 622.

[0329] At FIG. 6Z, while capturing the video media and displaying settings control 622, computer system 600 detects movement component 630B of input 630 via first button 602A (and/or a swipe directed to settings control 622 via the touch-sensitive surface of display 606, as discussed above), where finger 608 swipes from right to left along the surface of first button 602A. As illustrated in FIG. 6Z, computer system 600 adjusts the zoom setting of camera user interface 612 based on movement component 630B, decreasing the zoom level of the ongoing video media capture from 3.4× to 2×. In some embodiments, as input 630 was not lifted off of first button 602A following the hard/full press initiating the video capture, computer system 600 responds to movement component 630B while first button 602A is in hardware button state (B), without needing to detect another light/partial press before adjusting the zoom setting.

[0330] At FIG. 6AA, while capturing the video media, computer system 600 detects lift-off from button 602A (e.g., ending input 630) and, as described above, continues displaying settings control 622 for at least a threshold period of time after lift-off. At FIG. 6AB, after the threshold period of time has elapsed without detecting re-established contact with first button 602A and/or settings control 622 on the touch-sensitive surface of display 606, computer system 600 ceases displaying settings control 622, as described above with respect to FIG. 6U, and continues capturing the video media at 2.0× zoom. As illustrated in FIG. 6AB, as video capture is ongoing, computer system 600 does not revert camera user interface 612 to the default mode following the lift-off, instead remaining in the video capture mode.

[0331] At FIG. 6AC, after ceasing to display settings control 622, computer system 600 detects input 632, including movement component 632A and/or movement component 632B, via first button 602A. As settings control 622 is not currently displayed and input 632 is insufficient (e.g., in intensity) to place first button 602A into hardware button state (D) (and/or movement component 632A and movement component 632B are insufficient in magnitude to qualify as a full swipe of first button 602A), computer system 600 does not display settings control 622 or adjust the zoom setting of camera user interface 612 based on movement component 632A and/or movement component 632B. In some embodiments, if input 632 qualified as a light/partial press, computer system 600 would re-display settings control 622 and adjust the zoom setting in response to subsequent movement inputs while continuing the video media capture. In some embodiments, computer system 600 will display contact indicator 618 (e.g., as described with respect to FIGS. 6F-6H) in response to input 632 while the video capture is ongoing.

[0332] At FIG. 6AD, computer system 600 detects input 634, a press input that places first button 602A into hardware button state (E), qualifying as a hard/full press (and, in some embodiments, a quick hard/full press, which does not result in displaying the contact indicator 618 and/or settings control 622). In response to input 634, computer system 600 ends the capture of the video media. Alternatively, in some embodiments, computer system 600 ends the capture of video media in response to detecting touch input 636 directed to shutter affordance 612C via the touch-sensitive surface of display 606. Upon ending the capture of the video media, computer system 600 will revert camera user interface 612 to the default mode and return the aspect ratio of camera preview 614 and the appearance of shutter affordance 612C to the state illustrated in FIG. 6W, cease displaying capture timer 612I, and re-display capture mode affordance 612A, camera selection affordance 612B, captured media icon 612D, multi-frame photo affordance 612F, and camera flash affordance 612G.

[0333] FIGS. 6AE-6AM illustrate computer system 600 displaying settings control 622 for settings of camera user interface 612 other than the zoom setting, in particular, a depth-of-field setting, a focus setting, a filter setting, and a capture mode setting. In some embodiments, computer system 600 displays settings control 622 for a respective settings of camera user interface 612 as illustrated in FIGS. 6AE-6AM in response to a light/partial press of first button 602A or a full swipe of first button 602A, such as described with respect to displaying settings control 622 for the zoom setting of camera user interface 612 in FIGS. 6E-6J. In some embodiments, computer system 600 displays settings control 622 for a respective setting of camera user interface 612 in response to a light/partial press or full swipe when the respective setting is currently associated with first button 602A, for example, as described in further detail with respect to FIGS. 10A-10W.

[0334] As illustrated in FIGS. 6AE-6AF, computer system 600 displays settings control 622 for a simulated depth-of-field setting of camera user interface 612. For example, the simulated depth-of-field setting of camera user interface 612 controls visual effects simulating the depth-of-field of a camera or lens with a particular aperture setting (e.g., an f-stop value, which defines a ratio between the focal length of a photographic lens and the aperture size, such as f/1.8, f/2.8, or f/8), such that portions of the environment within the simulated depth-of-field's range (e.g., the current focal plane or focal range) appear in focus (e.g., sharp) in camera preview 614 and/or in captured media, while portions of the environment outside of the simulated depth-of-field's range appear out of focus (e.g., blurry). In some embodiments, computer system 600 displays camera preview 614 with the simulated depth-of-field effects applied while displaying settings control 622 for the simulated depth-of-field setting (e.g., in response to a light/partial press and/or full swipe of first button 602A), while camera user interface 612 is in a particular capture mode (e.g., a portrait or cinematic capture mode, for instance, selected using capture mode affordance 612A), and/or while capture of depth information is enabled (e.g., indicated in FIGS. 6AE-6AF by the display of depth capture affordance 612J, an f-stop icon that indicates depth information is being captured and/or can be selected to toggle the display of the simulated depth-of-field effects). As illustrated in FIGS. 6AE-6AF, settings control 622 for the simulated depth-of-field setting of camera user interface 612 includes text indicating the current f-stop value, an icon representing the simulated depth-of-field setting, and a representation of an f-stop scale. In particular, the representation of the f-stop scale includes a plurality of tick marks representing ordered f-stop values in intervals of f/0.1, with f-stop values for narrower depths-of-field (e.g., f/1.8) are displayed closer to the set of cameras and f-stop values for wider depths-of-field (e.g., f/8.0) are displayed further from the set of cameras.

[0335] At FIG. 6AE, while displaying settings control 622 for the simulated depth-of-field setting of camera user interface 612, computer system 600 detects a downwards movement input (e.g., moving away from the set of cameras) such as movement input 640 directed to first button 602A and/or touch input 642 directed to settings control 622 on the touch-sensitive surface of display 606. For example, movement input 640 and/or touch input 642 may include swipe/drag movements (e.g., movements remaining in contact with first button 602A and/or display 606, as described with respect to FIGS. 6L and 6O), flick movements (e.g., as described with respect to FIGS. 6M-6N and 6P-6Q), and/or directional tap inputs (e.g., as described with respect to FIGS. 6R-6S) directed towards the lower region of first button 602A and/or settings control 622 (e.g., the regions further away from the set of cameras).

[0336] In response to movement input 640 and/or touch input 642, computer system 600 adjusts the simulated depth-of-field setting of camera user interface 612 to an f-stop value of f/1.8. As illustrated in FIG. 6AE, at the f-stop value of f/1.8 (e.g., a relatively narrow depth-of-field), computer system 600 displays camera preview 614 with the midground (e.g., including the woman sitting at the table) in focus and selectively blurs the foreground (e.g., including the coffee cup) and background (e.g., including the person standing behind the table and the mountains in the distance), with the blurring represented in these figures by crosshatching. Additionally, computer system displays the representation of the f-stop scale with the tick mark representing f/1.8 at the center point of settings control 622 and updates the text indicating the current f-stop value in settings control 622 to “1.8.” As described with respect to FIG. 6L, in some embodiments, computer system 600 animates the representation of the f-stop scale being dragged down along with the movement inputs, pulling the f/1.8 tick mark towards the center, and may update the simulated depth-of-field effects applied to camera preview 614 to reflect the f-stop values of the tick marks as they pass the center of settings control 622, providing a “live” preview of the depth-of-field adjustment. As described with respect to FIGS. 6M-6N and 6P-6Q, in some embodiments, if the detected movements are flick or tap movements, computer system 600 adjusts the simulated depth-of-field setting to skip or snap to the next f-stop value of a set of predetermined f-stop values (e.g., f/1.8, f/2.4, and f/4.0).

[0337] Likewise, at FIG. 6AF, while displaying settings control 622 for the simulated depth-of-field setting of camera user interface 612, computer system 600 detects an upwards movement input (e.g., moving towards the set of cameras), such as movement input 644 directed to first button 602A and/or touch input 642 directed to settings control 622 on the touch-sensitive surface of display 606, and in response, adjusts the simulated depth-of-field setting of camera user interface 612 to an f-stop value of f/8.0. For example, movement input 640 and/or touch input 646 may include swipe/drag movements, flick movements, and/or directional tap inputs directed towards the upper region of first button 602A and/or settings control 622 (e.g., the regions closer to the set of cameras). As illustrated in FIG. 6AF, at the f-stop value of f/8.0 (e.g., a relatively wide depth-of-field), computer system 600 displays camera preview 614 with a wider region of the midground (e.g., including the woman sitting at the table, the coffee cup, and the person standing behind the table) in focus and selectively blurs the background (e.g., including the mountains in the distance) and additionally displays the representation of the f-stop scale with the tick mark representing f/8.0 at the center point of settings control 622, and updates the text indicating the current f-stop value in settings control 622 to “8.0.” As described above, in some embodiments, computer system 600 animates the representation of the f-stop scale being dragged up along with the movement inputs, pulling the f/8.0 tick mark towards the center, and may display “live” updates camera preview 614 and/or the text included in settings control 622 along with the movement inputs.

[0338] As illustrated in FIGS. 6AG-6AH, computer system 600 displays settings control 622 for a focus setting of camera user interface 612. For example, the focus setting of camera user interface 612 controls which subjects detected in the field-of-view of the environment appear in focus (e.g., sharp) in camera preview 614 and/or in captured media and selectively blurring other subjects and/or regions (e.g., similarly to applying the simulated depth-of-field effects). In some embodiments, computer system 600 detects potential subjects for selective focus while displaying settings control 622 for the focus setting (e.g., in response to a light/partial press and/or full swipe of first button 602A), while camera user interface 612 is in a particular capture mode (e.g., a portrait or cinematic capture mode, for instance, selected using capture mode affordance 612A), and/or while capture of depth information is enabled. As illustrated in FIGS. 6AG-6AH, settings control 622 for the simulated depth-of-field setting of camera user interface 612 includes an icon representing the focus setting and a representation of available (e.g., detected) subjects for selective focus. In particular, the representation of available subjects includes graphical elements (e.g., dots) representing, from top to bottom, the person standing behind the table, the woman sitting at the table, and the coffee cup on the table, also indicated in camera preview 614 by subject indicators 647A, 647B, and 647C.

[0339] At FIG. 6AG, while displaying settings control 622 for the focus setting of camera user interface 612, computer system 600 detects an upwards movement input (e.g., moving towards the set of cameras) such as movement input 648 directed to first button 602A and/or touch input 650 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the upper region of first button 602A and/or settings control 622 (e.g., the regions closer to the set of cameras). In response to movement input 648 and/or touch input 650, computer system 600 adjusts the focus setting of camera user interface 612 to select the coffee cup on the table as the subject of selective focus, displaying camera preview 614 with the coffee cup in focus while blurring the other portions of the field-of-view (e.g., including the other detected subjects). Additionally, computer system displays the representation of the available subjects with the graphical element representing the coffee cup at the center point of settings control 622, for example, animating the representation of the available subjects being dragged up along with the movement inputs, pulling the bottom dot (representing the coffee cup) towards the center.

[0340] Likewise, at FIG. 6AH, while displaying settings control 622 for the focus setting of camera user interface 612, computer system 600 detects a downwards movement input (e.g., moving away from the set of cameras) such as movement input 652 directed to first button 602A and/or touch input 654 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the lower region of first button 602A and/or settings control 622 (e.g., the regions further away from the set of cameras). In response to movement input 652 and/or touch input 654, computer system 600 adjusts the focus setting of camera user interface 612 to select the person standing behind the table as the subject of selective focus, displaying camera preview 614 with the person standing behind the table in focus while blurring the other portions of the field-of-view (e.g., including the other detected subjects). Additionally, computer system displays the representation of the available subjects with the graphical element representing the person standing behind the table at the center point of settings control 622, for example, animating the representation of the available subjects being dragged down along with the movement inputs, pulling the top dot (representing the person standing behind the table) towards the center.

[0341] As illustrated in FIGS. 6AI-6AK, computer system 600 displays settings control 622 for a filter setting of camera user interface 612, e.g., a setting for applying effects such as color grading, blurring, vignetting, simulated lighting, and/or augmented reality effects to media capture. For example, as illustrated in FIGS. 6AI-6AJ, the filter setting of camera user interface 612 controls which filter of a plurality of available filters is applied to camera preview 614 and/or the captured media. As another example, as illustrated in FIG. 6AK, the filter setting of camera user interface 612 adjusts the intensity of a filter being applied to camera preview 614 and/or the captured media. In some embodiments, computer system 600 applies a filter to camera preview 614 while displaying settings control 622 for the filter setting (e.g., in response to a light/partial press and/or full swipe of first button 602A) and/or while filter effects are enabled (e.g., by another control of camera user interface 612).

[0342] As illustrated in FIGS. 6AI-6AJ, settings control 622 for selecting between available filters of camera user interface 612 includes an icon representing the filter setting, text indicating the currently selected filter, and a representation of available filters. In particular, the representation of available filters includes graphical elements (e.g., icons) representing each of the available filters, such as a triangle icon representing a warm color grading filter, a starburst icon representing a cool color grading filter, a moon icon representing a monochromatic filter, a circle representing a vignetting effect, and a square representing an AR face filter.

[0343] At FIG. 6AI, while displaying settings control 622 for selecting a filter for camera user interface 612, computer system 600 detects an upwards movement input (e.g., moving towards the set of cameras) such as movement input 656 directed to first button 602A and/or touch input 658 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the upper region of first button 602A and/or settings control 622 (e.g., the regions closer to the set of cameras). In response to movement input 656 and/or touch input 658, computer system 600 changes the filter selection applied to camera user interface 612 to apply the warm color grading filter to camera preview 614, represented in FIG. 6AI by an overlay of dots. As illustrated in FIG. 6AI, computer system displays the representation of the available filter with the triangle icon representing the warm color grading filter at the center point of settings control 622, for example, animating the representation of the available filters being dragged up along with the movement inputs, pulling the triangle icon towards the center. Additionally, computer system 600 updates the text of settings control 622 to indicate the selected filter (e.g., displaying the text “WARM” at the center point of settings control 622).

[0344] Likewise, at FIG. 6AJ, while displaying settings control 622 for selecting a filter for camera user interface 612, computer system 600 detects a downwards movement input (e.g., moving away from the set of cameras) such as movement input 660 directed to first button 602A and/or touch input 662 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the lower region of first button 602A and/or settings control 622 (e.g., the regions further away from the set of cameras). In response to movement input 652 and/or touch input 654, changes the filter selection applied to camera user interface 612 to apply the monochromatic filter to camera preview 614, represented in FIG. 6AJ by a square grid overlay. Additionally, computer system updates the text (e.g., to “MONO”) and displays the representation of the available subjects with the moon icon representing the monochromatic filter at the center point of settings control 622, for example, animating the representation of the available filters being dragged down along with the movement inputs, pulling the moon icon towards the center.

[0345] As illustrated in FIG. 6AK, settings control 622 for adjusting a filter intensity of camera user interface 612 includes an icon representing the filter setting, text indicating the current filter intensity (e.g., as a percentage), and a representation of a filter intensity scale. In particular, the representation of the filter intensity scale includes a plurality of tick marks representing ordered filter intensity values in intervals of 5%, with tick marks representing higher intensities (e.g., 100%) displayed closer to the set of cameras and tick marks representing lower intensities (e.g., 0%) displayed further from the set of cameras. At FIG. 6AK, while displaying settings control 622 for adjusting the filter intensity of camera user interface 612, computer system 600 detects a downwards movement input (e.g., a swipe/drag, flick, and/or directional tap), such as movement input 664 directed to first button 602A and/or touch input 666 directed to settings control 622 on the touch-sensitive surface of display 606. In response to movement input 664 and/or touch input 666, computer system 600 reduces the filter intensity to 80%, represented in FIG. 6AK by the lower density of the square grid overlay.

[0346] As illustrated in FIGS. 6AL-6AM, computer system 600 displays settings control 622 for selecting a capture mode of camera user interface 612, such as selecting between a standard photo capture mode, a portrait photo capture mode (e.g., for capturing photo media with simulated depth-of-field effects applied), a standard video capture mode, and/or a cinematic video capture mode (e.g., for capturing photo media with a high frame rate and/or simulated depth-of-field effects applied). As illustrated in FIGS. 6AL-6AM, settings control 622 for selecting the capture mode of camera user interface 612 includes graphical elements (e.g., icons) representing the available capture modes. In particular, the representation of available capture modes includes a film strip icon representing the cinematic video capture mode, a video play icon representing the standard video capture mode, a landscape icon representing the standard photo capture mode, and an f-stop icon representing the portrait photo capture mode.

[0347] At FIG. 6AL, while displaying settings control 622 for selecting the capture mode of camera user interface 612, computer system 600 detects an upwards movement input (e.g., moving towards the set of cameras), such as movement input 668 directed to first button 602A and/or touch input 670 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the upper region of first button 602A and/or settings control 622 (e.g., the regions closer to the set of cameras). In response to movement input 648 and/or touch input 650, computer system 600 places camera user interface 612 into a standard photo capture mode, displaying the representation of the available capture modes with the landscape icon representing the standard photo capture mode at the center point of settings control 622 (e.g., animating the representation of the available capture modes being dragged up along with the movement inputs, pulling the landscape icon towards the center) and displaying the text “PHOTO” at the center of settings control 622.

[0348] Likewise, at FIG. 6AM, while displaying settings control 622 for selecting the capture mode of camera user interface 612, computer system 600 detects a downwards movement input (e.g., moving away from the set of cameras) such as movement input 672 directed to first button 602A and/or touch input 674 directed to settings control 622 on the touch-sensitive surface of display 606, e.g., swipe/drag movements, flick movements, and/or directional tap inputs directed towards the lower region of first button 602A and/or settings control 622 (e.g., the regions further away from the set of cameras). In response to movement input 672 and/or touch input 674, computer system 600 places camera user interface 612 into the standard video capture mode, in particular, changing the aspect ratio of camera preview 614 to a wider format, ceasing display of levels affordance 612H, updating the appearance of shutter affordance 612C to appear as a stop recording button, and displaying capture timer 612I. Additionally, computer system displays the representation of the available capture modes with the video play icon representing the standard video capture mode at the center point of settings control 622 (e.g., animating the representation of the available capture modes being dragged down along with the movement inputs, pulling the video play icon towards the center) and displaying the text “VIDEO” at the center of settings control 622.

[0349] FIG. 7 is a flow diagram illustrating method 700 for controlling a computer system based on variable characteristics of hardware inputs, in accordance with some embodiments. The method is performed at a computer system (e.g., 100, 300, 500, and/or 600) that is in communication with a display generation component (e.g., 606) (e.g., a display controller; a touch-sensitive display system; a display (e.g., integrated and/or connected), a 3D display, a transparent display, a projector, and/or a heads-up display) and a first input device (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606) (e.g., including one or more hardware buttons and/or surfaces, such as mechanical (e.g., physically depressible), solid-state, intensity-sensitive, and/or touch-sensitive (e.g., capacitive) buttons and/or surfaces), e.g., as illustrated in FIGS. 6A-6B. In some embodiments, the first input device is included in a plurality of input devices in communication with the computer system. In some embodiments, the computer system is optionally in communication with one or more cameras (e.g., 604A, 604B, 604C, and/or 604D), such as a rear (user-facing) camera and a forward (environment-facing) camera and/or a plurality of cameras with different lenses, such as a standard camera, a telephoto camera, and/or a wide-angle camera. In some embodiments, the computer system is optionally in communication with one or more sensors, such as camera sensors, optical sensors, depth sensors, capacitive sensors, intensity sensors, motion sensors, vibration sensors, and/or audio sensors.

[0350] The computer system (e.g., 600) detects (702), via the first input device (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606), a first set of one or more inputs directed to the first input device (e.g., 609, 616, 624, 628, 630, 632, 634, 640, 642, 644, 646, 648, 650, 652, 654, 656, 658, 660, 662, 664, 666, 668, 670, 672, 674, and/or other inputs as described with respect to FIGS. 8A-11 and/or 14A-15) (e.g., one or more presses, taps, clicks, swipes, and/or other manipulations of the first input device). In some embodiments, the first set of one or more inputs includes a single input. In some embodiments, the first set of one or more inputs includes a single continuous contact with the first input device that includes multiple component inputs, such as a press, followed by movement.

[0351] In response to detecting the first set of one or more inputs (704) and in accordance with a determination that the first set of one or more inputs satisfies (e.g., meets) a first set of criteria (706), the computer system performs (708) a first operation (e.g., as described with respect to FIGS. 6L-6S, 6X, 6Z, 6AE-6AM, 10G, 10J, 10N-10O, 10R, 10U, and/or 14A-14Z) (e.g., changing an appearance of a user interface, displaying a menu, selecting an option, changing a setting, and/or previewing a media capture effect; e.g., displaying controls for and/or changing a zoom level, an exposure level, an f-stop value for a simulated depth-of-field effect, a selected subject/focal point, a saturation level, a color balance setting, and/or a capture guidance setting). In some embodiments, the first operation is performed based on the movement of the first type, e.g., changing a setting based on a direction and magnitude of the movement. In some embodiments, in accordance with a determination that the first input does not satisfy the first set of criteria, the computer system foregoes performing the first operation. In some embodiments, the first set of criteria are satisfied when the set of inputs includes a light/partial press accompanied by movement on the first input device, e.g., simultaneously (e.g., maintaining a light/partial inward press while moving a finger across the surface of the first input device), with some temporal overlap (e.g., beginning to move the finger while performing a light/partial press), and/or sequentially (e.g., beginning to move the finger across the surface of the first input device within a threshold period of time after releasing/lifting the light/partial press).

[0352] The first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a first input intensity (e.g., an input detected by an intensity sensor, such as a pressure sensor, and/or by a mechanical button that can be physically depressed to one or more states when pushed) that exceeds a first threshold intensity (e.g., as described with respect to input 616 at FIG. 6I and/or input 630 at FIG. 6W) (e.g., a light/partial press threshold; in some embodiments, a force or pressure threshold, e.g., 25 g/cm³, 50 g/cm³, or 100 g/cm³; in some embodiments, a threshold mechanical state corresponding to the first threshold intensity, e.g., detecting physical depression of a mechanical button to a light/partial press state as a substitute measurement for force/pressure). In some embodiments, the first threshold intensity is an activation threshold, such that the first criterion remains satisfied once the input intensity exceeds the first (e.g., activation) threshold intensity until a different set of conditions are met, e.g., until the applied pressure exceeds a higher threshold pressure (e.g., transitioning to a hard/full press); until the input intensity drops below a lower, maintenance threshold intensity; until a release of the first input is detected; and/or until a threshold period of time passes without detecting particular inputs and/or input characteristics.

[0353] The first set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type (e.g., 616B, 624B, 616C, 624B, 616D, 624C, 616E, 624D, 630A, 630B, 644, 646, 648, 650, 652, 654, 656, 658, 660, 662, 664, 666, 668, 670, and/or 672, and/or as described with respect to FIGS. 10G, 10J, 10N, 10O, 10R, 10U, and/or 14A-14Z, below). In some embodiments, a movement of the first type includes a movement component perpendicular to the direction of the first input intensity, such as swiping and/or flicking gestures across, over, and/or around the surface of the first input device that the first input intensity is pressing into. In some embodiments, a movement of the first type includes a lift-off movement from the first input device, such as discrete tapping and/or flicking gestures. In some embodiments, the threshold amount includes a threshold distance/length of movement, e.g., 0.1 mm, 1 mm, 2.5 mm, or 1 cm.; In some embodiments, the first set of criteria includes a criterion that is met (e.g., satisfied) when the first input intensity does not exceed a higher threshold intensity (e.g., the second threshold intensity) for at least a threshold period of time (e.g., 0.05 s, 0.25 s, 0.7 s, or 1 s) after the first input intensity exceeds the first threshold intensity. For example, if the first input quickly transitions from a light/partial press to a hard/full press, the computer system foregoes performing the first operation. In some embodiments, the first set of criteria includes a criterion that is met when the second criterion is met after the first criterion is met. For example, the first set of criteria are only met if more than the threshold amount of movement of the first type is detected after detecting the first threshold intensity. In some embodiments, the first set of criteria includes a criterion that is met when the second criterion is met within a threshold period of time after the first criterion is met and/or when the second criteria is met while displaying a particular user interface, e.g., the user can briefly lift and replace a finger while making the movement. In some embodiments, in accordance with a determination that the first input satisfies at least the first criterion but not the second criterion (e.g., in response to detecting a light/partial press input without accompanying movement), the computer system performs a different operation, such as changing the appearance of a user interface without changing a setting. In some embodiments, in accordance with a determination that the first input satisfies the second criterion and not the first criterion (e.g., in response to detecting movement without detecting an activation pressure), the computer system foregoes responding to the first input.

[0354] In response to detecting the first set of one or more inputs (704) and in accordance with a determination that the first set of one or more inputs directed to the first input device satisfies (e.g., meets) a second set of criteria different from the first set of criteria (710) (in some embodiments, the second set of criteria are satisfied when the press input is a hard/full press), the computer system performs (712) a second operation different from the first operation (e.g., as described with respect to FIGS. 6U-6V, 6Y, 6AD, 8A, 8C, 10H, and/or 10V) (in some embodiments, a media capture operation, e.g., capturing photo media, initiating capture of video media, and/or stopping capture of video media). The second set of criteria includes a third criterion that is satisfied when the first set of one or more inputs includes a second input intensity that exceeds a second threshold intensity that is higher than the first threshold intensity (e.g., 628 and/or 634) (e.g., a hard/full press threshold; in some embodiments, a force or pressure threshold, e.g., 100 g/cm3, 150 g/cm³, or 200 g/cm³; in some embodiments, a threshold mechanical state corresponding to the second threshold intensity, e.g., detecting physical depression of a mechanical button to a hard/full press state as a substitute measurement for force/pressure) (in some embodiments, in accordance with a determination that the first input does not satisfy the second set of criteria, the computer system forgoes performing the second operation). Conditionally performing a first operation in response to a lower-intensity input that includes movement and performing a second operation in response to a higher-intensity input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily switch back and forth between performing the first and second operations merely by changing input intensity and without needing to provide additional inputs, switch between different user interface elements and/or input devices, e.g., a hardware button and a touch-sensitive display. Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using a particular input device and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, which also reduces the overall number of hardware components needed for control (e.g., compared to mapping the first and second operation to different input devices), resulting in a more compact, lighter, and cheaper device.

[0355] In some embodiments, performing the first operation includes changing an operation setting (e.g., zoom level, exposure/brightness level, applied filter type, filter intensity, media capture type, selected subject/focus, and/or simulated depth-of-field/focal length setting) to a respective value (e.g., as described with respect to FIGS. 6L-6S, 6X, 6Z, 6AE-6AM, 10G, 10J, 10N, 10O, 10R, 10U, and 14A-14Z) (e.g., a value selected based on a magnitude and/or direction of the first type of input); and For example, changing the operation setting to a respective value based on the magnitude and/or direction of input (e.g., contact) movement can be performed as described with respect to FIGS. 6A-6AM, 10A-11, and 14A-15. In some embodiments, the amount of change to the operation setting (e.g., the amount by which the parameter value changes with respect to a numeric scale or with respect to a set of available values) may be related to the distance moved by a contact across a surface of the first input device. For example, the relation may be proportional, logarithmic, based on simulated physics, and/or based on other relational rules (e.g., as described in detail with respect to FIGS. 14A-15). In some embodiments, the operation setting is increased (or moved “forward” through non-numeric parameter values) in response to movements in one direction (e.g., towards the “top” of a device) and decreased (or moved “backward”) in response to movements in the opposite direction.

[0356] In some embodiments, performing the second operation includes performing the second operation based on a current value of the operation setting (e.g., as described with respect to FIGS. 6U-6V, 6Y, 10H, and/or 10V) (e.g., performing a media capture operation with the current zoom level, exposure/brightness level, applied filter type, filter intensity, media capture type, selected subject/focus, and/or simulated depth-of-field/focal length setting), wherein, in accordance with a determination that the first set of one or more inputs satisfied the first set of criteria prior to satisfying the second set of criteria (e.g., the first set of one or more inputs exceeds the first (lower) threshold intensity and includes more than a threshold amount of movement of a first type, and the computer system performs the first operation, before the first set of one or more inputs exceeds the second (higher) threshold intensity), the current value of the operation setting is the respective value. For example, if the first operation is performed prior to the second operation, the first operation modifies the performance of the second operation. For example, the user modifies the operation setting using a lower-intensity input with movement (e.g., increasing the zoom level to 2.0×), then transitions to a higher-intensity input to perform the second operation using (e.g., according to) the modified operation setting (e.g., taking a photo at 2.0× zoom). Changing a setting of the second operation in response to a lower-intensity input that includes movement and performing the second operation in response to a higher-intensity input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily switch back and forth between performing the second operation and adjusting the setting of the second operation without needing to provide additional inputs, such as opening a separate settings menu. Doing so also provides improved ergonomics of computer systems, for example, by providing related controls using a particular input device and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices.

[0357] In some embodiments, performing the first operation includes changing a media capture setting (e.g., as described with respect to FIGS. 6L-6S, 6X, 6Z, 6AE-6AM, 10G, 10J, 10N, 10O, 10R, 10U, and 14A-14Z) (e.g., modifying a zoom level, exposure/brightness level, applied filter type, filter intensity, media capture type, selected subject/focus, and/or simulated depth-of-field/focal length setting). In some embodiments, changing the media capture setting includes updating display of a media capture preview (e.g., a camera viewfinder) according to the changed media capture setting, allowing the user to preview the changed setting for media capture. In some embodiments, modifying an exposure or brightness level includes simulating different camera exposure times, shutter speeds, aperture sizes, and/or ISO speeds, where higher exposure levels correspond to brighter captures (e.g., longer exposure times/slower shutter speeds, slower ISO speeds, and/or larger aperture sizes) and lower exposure levels correspond to darker captures (e.g., shorter exposure times/faster shutter speeds, faster ISO speeds, and/or smaller aperture sizes). For example, at a higher exposure value, the computer system combines image data from a higher number of captured frames (e.g., simulating a longer exposure, slower speed, and/or larger aperture) to create a brighter image.

[0358] In some embodiments, performing the second operation includes capturing media based on the media capture setting (e.g., as described with respect to FIGS. 6U-6V, 6Y, 10H, and/or 10V) (e.g., based on the current value(s) of one or more media capture settings including the media capture setting that is changed via the first operation). In some embodiments, capturing media includes capturing a still photo. In some embodiments, capturing media includes capturing photo media with a limited duration, such as a short (e.g., 0.25, 0.5, 1, 3, and/or 5 second) multi-frame capture that includes content from before and/or after a capture input (e.g., the full/hard press) is detected, creating a “live” effect. In some embodiments, capturing media includes capturing video media. In some embodiments, if the computer system performs the first operation changing the media capture setting to a respective value before performing the second operation (e.g., and does not detect subsequent input(s) satisfying the first set of criteria, resulting in further changes to the media capture setting), capturing media is performed based on the respective value of the media capture setting. In some embodiments, the media capture setting is a setting of a set of media capture settings that is currently associated with an input device used to detect the first set of one or more inputs. For example, if a zoom setting is associated with a hardware button when the first set of one or more inputs is detected, the first operation modifies the zoom level for media capture, and if an exposure setting is associated with a hardware button when the first set of one or more inputs is detected, the first operation modifies the exposure level for media capture. Changing a media capture setting in response to a lower-intensity input that includes movement and performing a media capture in response to a higher-intensity input provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily switch back and forth between capturing media and adjusting the settings for capturing media merely by changing input intensity and without needing to provide additional inputs (such as opening a separate settings menu) or to switch between different user interface elements and/or input devices.

[0359] In some embodiments, the media capture setting includes a zoom setting (e.g., magnification level) for media capture (e.g., as described with respect to FIGS. 6L-6S, 6X, 6Z, 10O, 10R, and/or 14P-14Z). In some embodiments, modifying a zoom level media capture setting includes performing an optical zoom (e.g., switching between different fixed focal-length lenses of different magnifications and/or varying the focal length of a hardware zoom lens) and/or performing a digital zoom (e.g., digitally magnifying camera by resizing, interpolating, and/or combining data captured at one or more optical zoom levels). In some embodiments, changing the zoom setting includes updating display of a media capture preview (e.g., a camera viewfinder) according to the current zoom level, allowing the user to preview capture at the current zoom level.

[0360] In some embodiments, the media capture setting includes a filter setting for media capture (e.g., as described with respect to FIGS. 6AI-6AK) (e.g., an adjustment to and/or overlay of media capture, such as filters for color grading, tone adjustment, blurring, smoothing, vignetting, noise reduction, and/or applying other visual and/or audio effects). In some embodiments, changing the filter setting includes changing the type of filter being applied to the media capture. For example, the computer system switches between a cool color grading filter, a warm color grading filter, and a monochrome color grading filter, or switches between a color grading filter, a bokeh filter, and a cartoon face filter. In some embodiments, changing the filter setting includes changing the intensity of a filter being applied. For example, for a monochrome color grading filter, a filter intensity of 100% results in an entirely grayscale media capture, a filter intensity of 50% results in a moderately desaturated (but still full-color) media capture, and a filter intensity of 0% results in a media capture with un-adjusted saturation.

[0361] In some embodiments, the media capture setting includes a simulated depth-of-field setting for media capture (e.g., as described with respect to FIGS. 6AE-6AF and/or 10N) (e.g., a setting for simulating capture with a particular focal length (f-stop) by selectively blurring portions of a media capture that would not be in focus (e.g., would be outside of the depth-of-field) when captured using a lens with the particular focal length). In some embodiments, the simulated depth-of-field effect is based on detection of one or more subjects in the camera preview and/or captured media. In some embodiments, the simulated depth-of-field effect is based on detected or estimated depth information (e.g., a depth map) about objects in the camera preview and/or captured media. In some embodiments, the depth information is captured at the time the media item is captured and is associated with the media item. In some embodiments, the depth information includes a distance of an object (or a portion of an object) from a sensor (e.g., a camera or lens) or other point of reference. In some embodiments, the depth information includes a distance of an object (or a portion of an object) from another object (or portion of an object) (e.g., the relative distance between two objects or portions of objects). In some embodiments, the depth-of-field effect is based on segmentation information that separates a subject from other elements, such as foreground and/or background elements. In some embodiments, the simulated depth-of-field effect includes blurring (e.g., artificially blurring and/or adding a blurring effect to) a portion of a media item (e.g., image or video) that is in a foreground and/or a background relative to a subject (e.g., a detected subject and/or a designated subject) or a depth plane of the image (e.g., a simulated focal plane and/or a plane perpendicular to an optical axis). In some embodiments, the portion of the image that is blurred when the simulated depth-of-field effect is applied is not blurry when the depth-of-field effect is not applied. In some embodiments, when the simulated depth-of-field effect is applied, portions of the image that are at a different depth (e.g., along an optical axis) than the subject are blurred. In some embodiments, portions of the image that are not within a threshold depth (or range of depths) relative to the subject are blurred. In some embodiments, an amount or degree of blurring applied to a portion of a media item (e.g., image or video) varies based on a distance (e.g., along an optical axis) from the subject or a simulated focal plane. For example, the simulated depth-of-field effect includes applying a greater amount of blur to a portion of the image that is farther from the subject than to a portion of the image that is closer to the subject (e.g., objects in the image that are further from the subject are blurred by a greater amount than objects that are closer to the subject). In some embodiments, changing the simulated depth-of-field setting includes changing the simulated focal length (f-stop), e.g., from f/1.8 (e.g., with foreground and/or background objects having a greater degree of applied blurring or simulated bokeh effect) to f/8.4 (e.g., with foreground and/or background objects having a lower degree of applied blurring or simulated bokeh effect). In some embodiments, changing the simulated depth-of-field setting includes changing or selecting which detected subject(s) appears in focus with the simulated depth-of-field effect applied. In some embodiments, changing the simulated depth-of-field setting includes enabling or disabling application of the simulated depth-of-field effect to the camera preview and/or captured media.

[0362] In some embodiments, the media capture setting includes a media capture type setting (e.g., as described with respect to FIGS. 6AL-6AM). In some embodiments, changing the media capture type setting includes selecting between capture modes, such as standard photo capture, portrait photo capture (e.g., photo capture with applied simulated lighting and/or simulated depth-of-field effects), standard video capture, cinematic video capture (e.g., video capture with applied lighting and/or simulated depth-of-field effects and/or enhanced capture quality, such as high frame rate and/or high resolution), and/or panoramic photo capture. In some embodiments, changing the media capture type setting includes changing a capture type option, such as toggling multi-frame photo capture or spatial capture (e.g., capture including depth information) on or off. In some embodiments, applying simulated lighting effects (e.g., natural light, studio light, contour light, stage light, and/or stage light mono effects) includes simulation of one or more light sources (e.g., directional, ambient, and/or point) at different locations in space and/or at different intensities. In some embodiments, applying simulated lighting effects includes blurring one or more image portions, e.g., to create a bokeh effect or a simulated bokeh effect. In some embodiments, applying simulated lighting effects includes simulating a background portion of a media item (e.g., image or video), e.g., displaying subjects in the camera preview/captured media with a single-color background or other simulated backdrop. In some embodiments, applying simulated lighting effects includes modifying the hue, saturation, brightness, and/or contrast of the camera data. In some embodiments, the simulated lighting effects are simulated based on depth map information associated with the camera/image data and/or detected facial features and optionally simulate light falling in different ways on different portions of a surface based on an angle of the surface relative to an angle of a simulated light source. In some embodiments, changing a value of parameter associated with a simulated lighting effect includes changing a simulated intensity of the light and/or changing a simulated distance of the simulated light source from one or more surfaces in the image.

[0363] In some embodiments, the media capture setting includes a focus subject selection (e.g., as described with respect to FIGS. 6AG-6AH). In some embodiments, changing the focus subject selection includes changing which subject included in a camera preview (e.g., a detected person, pet, and/or other content) is in focus. For example, the computer system can change which subject is in focus by changing the application of simulated depth-of-field effects (e.g., blurring) to keep the selected subject in focus (e.g., unblurred).

[0364] In some embodiments, performing the first operation includes selecting, based on one or more characteristics of the movement of the first type (e.g., direction, location, distance, speed, acceleration, and/or input style (e.g., movement as part of a drag, flick, tap, and/or press)), a first settings value (e.g., parameter value) from an ordered sequence of settings values (e.g., as described with respect to FIGS. 6L-6S, 6X, 6Z, 6AE-6AF, 6AK, 10G, 10J, 10N, 10O, 10R, 10U, and/or 14P-14Z) (e.g., an incremented set of possible parameter values for a setting, such as zoom levels between 0.5×-12.0× magnification in increments of 0.1×, simulated f-stop values between f/32 and f/1.2 in increments of 0.1× (or variable increments, such as f/0.1 steps from f/1.2 to f/4.8 and f/2.0 steps from f/6 to f/32), and/or filter intensity levels between 0%-100% in increments of 1%). In some embodiments, selecting the settings value from the ordered sequence of settings based on the characteristics of the movement of the first type includes incrementing/decrementing the settings value by an amount based on a distance of the movement of the first type (e.g., the distance moved along a particular axis and/or on a particular sensing area), at a rate based on a speed or acceleration of the movement of the first type, and/or in a direction (e.g., incrementing up or down) based on a direction of the movement of the first type. In some embodiments, selecting a settings value from an ordered sequence of settings based on the characteristics of the movement of the first type includes using simulated physics to model the selection of the settings value from the ordered sequence of settings, e.g., as if the movement of the first type were adjusting a physical control for the setting, such as a knob, dial, wheel, and/or slider, which the computer system can model with simulated physical characteristics (e.g., size, weight, friction, and/or elasticity). In some embodiments, selecting the first settings value is performed as described with respect to FIGS. 14A-14Z and 15. Providing selection from an ordered sequence of settings values in response to a lower-intensity input that includes movement provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, selecting from the ordered sequence of settings using input movement provides fine-grained control of settings in an intuitive manner without needing to display additional controls or input fields.

[0365] In some embodiments, selecting the first settings value from the ordered sequence of settings values includes simulating a transfer of momentum from the movement of the first type to a model of the ordered sequence of settings values (e.g., as described with respect to FIGS. 6N, 6Q, and/or 14C-14Z). For example, when a touch input lifts from a touch-sensitive surface while swiping in a particular direction, the computer system continues to change the settings value (e.g., increments the settings value in the same direction) after the lift-off as if momentum from the first type of movement were transferring to a physical control (e.g., a knob, dial, wheel, and/or slider) for the setting. Selecting (e.g., adjusting) a settings value by simulating the transfer of momentum from the input movement provides improved control of computer system functionality, reducing the number of inputs needed to adjust settings and improving ergonomics of computer systems, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, simulating the physics intuitively translates input movement into a settings adjustment (e.g., as if moving a physical control element) and, by continuing to adjust the settings with some transferred momentum (e.g., adjusting after the end of the movement), the user can reach particular settings values with less movement and/or fewer inputs (e.g., using a quick flick to scroll with momentum to a particular setting rather than needing to drag the whole distance or drag, lift, and reset), which also allows for optimized input device size.

[0366] In some embodiments, the ordered sequence of settings values includes a subset of one or more preset values (e.g., “snapping” values, for example: preset zoom levels of 0.5×, 1.0×, 2.0×, and 8.0×; preset simulated f-stop values of f/1.2, f/2.4, and f/4.6; and/or preset filter intensity levels of 0%, 25%, 50%, 75%, and 100%). In some embodiments, selecting, based on the one or more characteristics of the movement of the first type, the first settings value from the ordered sequence of settings values includes, in accordance with a determination that the first set of one or more inputs satisfies a set of one or more drag criteria (e.g., during a drag input, e.g., a moving input that remains in contact with the first input device), selecting the first settings value from the ordered sequence of settings values based on a direction of the movement of the first type and an amount of the movement of the first type (e.g., as described with respect to FIGS. 6L-6M, 6O-6P, 6X, 6Z, 14C, 14K, 14N, 14R, 145, 14V, and/or 14Y), wherein the set of one or more drag criteria includes a criterion that is satisfied when the first set of one or more inputs includes a contact that is maintained on the first input device (e.g., while contact is maintained; in some embodiments, contact is maintained when a third threshold intensity (e.g., the same as or lower than the first threshold intensity; e.g., a minimum/maintenance threshold) is exceeded). For example, while the user is providing a drag input, such as a touch input moving across a touch-sensitive surface without lifting off (and/or falling below a maintenance intensity threshold), the computer system adjusts the settings value by scrolling through the ordered sequence of settings values by an amount and in a direction commensurate to the distance and direction of the movement.

[0367] In some embodiments, selecting, based on the one or more characteristics of the movement of the first type, the first settings value from the ordered sequence of settings values includes, in accordance with a determination that the first set of one or more inputs satisfies a set of one or more flick criteria (e.g., during a flick input, e.g., a moving input quickly followed by lift-off), selecting the first settings value from the subset of one or more preset values based on a direction of the movement of the first type (e.g., as described with respect to FIGS. 6N, 6Q, 14F, 14O, 14T, and/or 14Z) (e.g., the computer system “snaps” to the next preset value in the ordered sequence in the direction of the flick). In some embodiments, the set of one or more flick criteria includes a first flick criterion that is satisfied when the first set of one or more inputs ceases to be detected on the first input device; For example, the first flick criterion is met when contact with the first input device lifts off and/or falls below a maintenance intensity threshold. In some embodiments, the set of one or more flick criteria includes a second flick criterion that is satisfied when the movement of the first type includes more than a second threshold amount of movement within a threshold period of time before the first flick criterion is satisfied (e.g., the input includes movement near the end of contact). For example, the second flick criterion is met when the input is moving at or near the end of contact with the first input device, e.g., the movement is a quick flick rather than a drag that comes to a stop prior to lift-off. In some embodiments, the set of one or more flick criterion include a third flick criterion that is met when the movement of the first type includes movement in the direction of one of the preset values. For example, flicking to zoom in from 5.5× will snap to 8.0×, but flicking to zoom in from 8.5× will not snap to a preset value (e.g., instead simply stopping adjustment when the input ends or continuing to adjust with some simulated momentum from the flick) as no preset values above 8.0× are included in the subset. As another example, flicking to increase filter intensity from 100% (e.g., a maximum preset value) will not snap to a higher value, but flicking to decrease filter intensity from 100% will snap to the next preset value of 75%. In some embodiments, the set of one or more flick criterion include a fourth flick criterion that is met when simulated momentum from the flick would adjust the settings value past one of the preset values, for example, as described with respect to FIGS. 14A-14Z and 15. Adjusting continuously through the ordered sequence of values in response to movement during input contact (e.g., drag movements) and adjusting by skipping between preset values of the ordered sequence in response to movement quickly followed by lift-off (e.g., flick movements) makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, the user can achieve both fine-grained controls (scrolling through the entire ordered sequence of values) and quick/optimized (snapping between preset values) simply by changing movement style from a drag to a flick, without needing to provide additional inputs or use different user interface elements and/or input devices.

[0368] In some embodiments, performing the first operation includes selecting, based on one or more characteristics of the movement of the first type (e.g., direction, location, distance, speed, acceleration, and/or input style (e.g., movement as part of a drag, flick, tap, and/or press)), a second settings value (e.g., parameter value) from a predetermined set of settings values (e.g., as described with respect to FIGS. 6AG-6AJ and/or 6AL-6AM (e.g., a set of available, preselected, and/or preferred values for the setting)). For example, for a focus selection setting, the predetermined set of settings values includes each of a group of subjects identified (e.g., detected) in the camera preview, e.g., allowing the user to select between focusing on a first subject, a second subject, and/or a third subject. For example, for a filter setting, the predetermined set of settings values includes available filters, such as a warm tone filter, a cool tone filter, a monochromatic filter, a sepia filter, a cartoon face filter, and/or a smoothing filter. For example, for a media capture type setting, the predetermine set of settings values includes available capture types, such as standard photo capture, standard video capture, portrait photo capture, cinematic video capture, and so forth. In some embodiments, the predetermined set of settings values is a subset of one or more preset settings values (e.g., snapping values) included in an ordered sequence of settings values. In some embodiments, the second settings value is the same as the first settings value. Providing selection from a predetermined set of settings values in response to a lower-intensity input that includes movement provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, selecting from the predetermined settings values using input movement allows the user to adjust settings in a quick and intuitive manner without needing to display additional controls.

[0369] In some embodiments, the first set of criteria includes a fourth criterion that is satisfied when the second criterion (e.g., which is satisfied when the first set of one or more inputs includes more than a threshold amount of movement of a first type) is satisfied after the first criterion (e.g., which is satisfied when the first set of one or more inputs includes a first input intensity that exceeds a first threshold intensity) is satisfied (e.g., as described with respect to FIGS. 6L-6S, 6X, and/or 6Z). In some embodiments, if the computer system detects (e.g., via the first input device) movement before the first set of inputs reaches the first threshold intensity, the computer system ignores the movement and/or foregoes perform the first operation (e.g., as described with respect to FIGS. 6G and/or 6AC). In some embodiments, the computer system foregoes detecting movement using the first input device until the first criterion is satisfied, for example, leaving the movement sensors of the first input device in an off or inactive state until the first threshold intensity is exceeded (e.g., until a light press is detected). Conditionally performing the first operation in response to input movement based on whether or not an input exceeding the first threshold intensity has been detected makes the user-system interface more efficient by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, performing the first operation in response to movement after the first threshold intensity has been exceeded increases confidence that the user intends to perform the first operation, decreasing the likelihood of unintended inputs while still allowing the user to quickly and intuitively perform the first operation. Doing so also improves the ergonomics and extensibility of the first input device, for example, allowing placement of the first input device in an area the user might touch or move across without wanting to perform the first operation and/or allowing movement on the first input device without first exceeding the first threshold intensity to be mapped to other functionality.

[0370] In some embodiments, after determining that the first set of one or more inputs satisfies the first criterion (e.g., as described with respect to input 616 at FIG. 6I and/or input 630 at FIG. 6W) (e.g., after the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity), the computer system detects a first movement input included in the first set of one or more inputs (e.g., a movement input detected before detecting an end of the first set of one or more inputs; in some embodiments, the end of the first set of one or more inputs is detected when a lift-off is detected and/or when a lift-off is detected and contact is not re-established within a threshold period of time), wherein the movement input is detected while an input intensity of the first set of one or more inputs does not exceed the first threshold intensity (e.g., 616B, 624B, 616C, 624B, 616D, 624C, 616E, 624D, 630A, and/or 630B) (e.g., the first movement input is detected after initially reaching the first threshold intensity (e.g., a threshold for activating a first control element) and then falling below the first threshold intensity). In some embodiments, in response to the first movement input, the computer system performs the first operation based on the first movement input (e.g., as described with respect to FIGS. 6L-6S, 6X, and/or 6Z) (e.g., responding to the first movement input). For example, the computer system performs the first operation based on movement that occurs after the press input shifts below the light/partial press threshold (e.g., an activation threshold). In some embodiments, the first movement is more than the threshold amount of movement of the first type, e.g., the second criterion can be satisfied by the first movement input. In some embodiments, the first movement input is detected while the input intensity exceeds a lower threshold intensity (e.g., a maintenance threshold; in some embodiments, a force or pressure threshold, e.g., 5 g/cm³, 10 g/cm³, or 24 g/cm³; in some embodiments, a threshold mechanical state corresponding to the lower threshold intensity). For example, after reaching the activation intensity, the computer system remains responsive to movement until contact ends and/or until a threshold period of time after contact ends. Performing the first operation based on movement that occurs after the input intensity exceeds and subsequently falls below the first intensity threshold makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, performing the first operation is initially gated by the first intensity threshold, which reduces inadvertent performance of the first operation (e.g., in response to a user unintentionally brushing, touching, or bumping an input device), but after the first intensity threshold is reached, the computer system remains responsive to movement even after the intensity drops, making it easier for users to continuously control the first operation.

[0371] In some embodiments, after determining that the first set of one or more inputs satisfies the first criterion (e.g., as described with respect to input 616 at FIG. 6I and/or input 630 at FIG. 6W) (e.g., after the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity), the computer system detects a lift-off of the first set of one or more inputs (e.g., as described with respect to FIGS. 6N, 6Q, 6R-6T, and/or 6AA) (in some embodiments, a period where contact with the first input device has ceased; in some embodiments, a period where input intensity has dropped below a maintenance intensity threshold). In some embodiments, after detecting the lift-off of the first set of one or more inputs, the computer system detects, via the first input device, a second movement input (e.g., 616D, 624C, 616E, 624D, 632A, and/or 632B). In some embodiments, in response to detecting the second movement input and in accordance with a determination that the second movement input was detected within a threshold period of time (e.g., 0.001 s, 0.07 s, 0.5 s, 1 s, or 1.3 s) after detecting the lift-off of the first set of one or more inputs, the computer system performs the first operation based on the movement input (e.g., as described with respect to FIGS. 6O-6P). In some embodiments, in accordance with a determination that the movement input was detected at least the threshold period of time after detecting the lift-off of the first set of one or more inputs, the computer system foregoes performing the first operation based on the movement input (e.g., as described with respect to FIG. 6AC). In some embodiments, in accordance with a determination that the movement input was detected at least the threshold period of time after detecting the lift-off of the first set of one or more inputs and that the first criterion was satisfied by a second set of inputs prior to detecting the movement input (e.g., re-activating responsiveness to motion), the computer system performs the first operation based on the movement input (e.g., as described with respect to FIGS. 6x and/or 6Z). Performing the first operation based on detected movement inputs until lift-off exceeds a threshold duration of time makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, the computer system automatically stops responding to movement inputs by performing the first operation after a threshold period of time passes without input contact, which reduces inadvertent performance of the first operation (e.g., in response to a user unintentionally brushing, touching, or bumping an input device), but the computer system remains responsive to movement inputs after brief lift-offs, allowing users to better maintain and adjust control of the first operation.

[0372] In some embodiments, after determining that the first set of one or more inputs satisfies the first criterion (e.g., as described with respect to input 616 at FIG. 6I and/or input 630 at FIG. 6W) (e.g., after the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity), the computer system detects a third movement input. In some embodiments, in response to detecting the third movement input and in accordance with a determination that a lift-off of the first set of one or more inputs (in some embodiments, a period where contact with the first input device has ceased; in some embodiments, a period where input intensity has dropped below a maintenance intensity threshold) was not detected prior to detecting the third movement input, performing the first operation based on the third movement input (e.g., as described with respect to FIGS. 6L-6S). In some embodiments, in accordance with a determination that a lift-off of the first set of one or more inputs was detected prior to detecting the movement input, the computer system foregoes performing the first operation based on the movement input. In some embodiments, in accordance with a determination that a lift-off of the first set of one or more inputs was detected prior to detecting the movement input and that the movement input was detected within a threshold period of time after detecting lift-off, the computer system performs the first operation based on the movement input. Performing the first operation based on movements detected while maintaining an input via an input device (e.g., by maintaining contact or proximity) makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, performing the first operation is initially gated by the first intensity threshold, which reduces inadvertent performance of the first operation (e.g., in response to a user unintentionally brushing, touching, or bumping an input device), but after the first intensity threshold is reached, the computer system remains responsive to movement as long as input is maintained (e.g., by maintaining contact or proximity), making it easier for users to continuously control the first operation.

[0373] In some embodiments, after performing the second operation (e.g., as described with respect to FIG. 6Y), the computer system detects, via the first input device, a fourth movement input (e.g., 630B, 632A, and/or 632B) (e.g., a swipe, drag, flick, and/or tap), and in response to detecting the fourth movement input and in accordance with a determination that a lift-off event (in some embodiments, a period where contact with the first input device has ceased; in some embodiments, a period where input intensity has dropped below a maintenance intensity threshold) was not detected in between detecting the second input intensity that exceeds the second threshold intensity and detecting the fourth movement input, the computer system performs the first operation based on the fourth movement input (e.g., as described with respect to FIG. 6Z). For example, after an input reaches the second threshold intensity (e.g., the full/hard press threshold), triggering performance of the second operation, the computer system remains responsive to movement inputs as long as/until the input is ended via lift-off. For example, a user can take a picture (second operation) using a full/hard press and then continue to adjust media capture settings (first operation) via movement inputs without needing to re-apply or maintain the first threshold intensity (e.g., light/partial press activation intensity).

[0374] In some embodiments, in response to detecting the fourth movement input and in accordance with a determination that a lift-off event (in some embodiments, a period where contact with the first input device has ceased; in some embodiments, a period where input intensity has dropped below a maintenance intensity threshold) was detected in between detecting the second input intensity that exceeds the second threshold intensity and detecting the fourth movement input, the computer system forgoes performing the first operation based on the fourth movement input (e.g., as described with respect to FIG. 6AC). For example, after an input reaches the second threshold intensity (e.g., the full/hard press threshold), triggering performance of the second operation, the computer system remains responsive to movement inputs as long as/until the input is ended via lift-off. For example, after a user takes a picture (second operation) using a full/hard press and ends the first set of inputs (e.g., lifts off of the first input device), the user must re-apply the first threshold intensity (e.g., light/partial press activation intensity) before adjusting media capture settings (first operation) using movement inputs.

[0375] In some embodiments, in accordance with a determination that the first set of one or more inputs satisfies a set of feedback criteria, the computer system provides a non-visual feedback output (e.g., 620) (e.g., an audio and/or tactile output), wherein the set of feedback criteria includes the first criterion that is satisfied when the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity (e.g., as described with respect to FIG. 6I) (e.g., the activation intensity threshold). For example, when the user presses the first input device with sufficient intensity to exceed the first threshold intensity, the computer system generates non-visual feedback, such as an audio chime or click, a vibration, and/or a haptic response such as a haptic simulating the tactile sensation of physically depressing a button. In some embodiments, the set of feedback criteria includes a criterion that is satisfied when the first set of one or more inputs did not include an intensity that exceeds the first threshold intensity prior to detecting the first detected intensity, e.g., the non-visual feedback is only provided when the threshold is initially reached, and is not provided again in response to the first set of one or more inputs. Providing non-visual feedback when an input meets the first criterion (e.g., exceeds a threshold intensity) provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the non-visual feedback indicates to a user that the first criterion is met, and thus, that the computer system will respond to movements by performing the first operation, allowing the user to quickly initiate control of the first operation (e.g., without checking for displayed feedback) or to end the input if control of the first operation is not immediately desired.

[0376] In some embodiments, the first input device includes a first hardware button (e.g., 602A, 602B, 602C, and/or 602D) (e.g., as described with respect to FIG. 6C). In some embodiments, the first hardware button includes a mechanical button, such as a button that can be physically depressed to one or more states. In some embodiments, the first hardware button includes a solid-state button, such as a button that simulates the tactile sensation (e.g., via tactile/haptic output generators) of pressing a mechanical button. In some embodiments, the first hardware button includes one or more sensors, such as pressure sensors, touch sensors, capacitive sensors, and/or motion sensors. Providing control of multiple different operations using a hardware button provides improved control and ergonomics of computer systems without cluttering a displayed user interface with additional controls, which makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), and, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can control the first and second operations via a dedicated hardware button instead of via touch-sensitive display, which reduces the need to display controls for the first and second operations and allows the user to control the first and second operations without obscuring the display. Conditionally providing control of multiple different operations using a hardware button based on intensity and movement characteristics of detected inputs also reduces the overall number of hardware components needed for control (e.g., compared to mapping different functions to different buttons), resulting in a more compact, lighter, and cheaper device.

[0377] In some embodiments, a first input element is activated based on the second input intensity exceeding a third intensity threshold. In some embodiments, the third threshold intensity is the same as the second threshold intensity, e.g., the initial full/hard press threshold, e.g., 100 g/cm³, 150 g/cm³, or 200 g/cm³. In some embodiments, the third threshold intensity is lower than the second threshold intensity, e.g., after exceeding the second threshold intensity, the user can maintain a full/hard press with a slightly lower intensity, e.g., 75 g/cm³, 90 g/cm³, or 120 g/cm³. For example, the first input element is activated when at least the third threshold intensity is measured (e.g., using intensity sensors) and/or determined from a corresponding mechanical state (e.g., a level/state of physical depression of a mechanical button). In some embodiments, performing the second operation includes, in accordance with a determination that the first input element remains activated for at least a second threshold amount of time (e.g., 0.05, 0.1, 0.2, 0.5 s, 1 s, or 1.3 s), capturing video media (e.g., as described with respect to FIGS. 6Y, 8C-8E, and/or 8H-8I). For example, the computer system captures video in response to a long (e.g., held) full/hard press. In some embodiments, performing the second operation includes, in accordance with a determination that the first input element remains activated for less than the second threshold amount of time (e.g., 0.5 s, 1 s, or 1.3 s), capturing photo media (e.g., as described with respect to FIGS. 6U-6V, 8A, and/or 8M). For example, the computer system captures photo media in response to a quick full/hard press. In some embodiments, the computer system captures photo media if, prior to reaching the second threshold amount of time, the full/hard press is released (e.g., the input intensity falls below a threshold intensity and/or a lift-off event occurs). In some embodiments, the computer system captures photo media in response to the full/hard press and, if the full/hard press duration later reaches the second threshold amount of time, also captures video. For example, the computer system preemptively captures photo media and may discard the photo media if the full/hard press resolves into a held press. In some embodiments, the photo media includes a still photo capture. In some embodiments, the photo media includes photo media with a limited duration, such as a short (e.g., 0.01, 0.02, 0.05, 0.1, 0.25, 0.5, 1, 3, and/or 5 second) multi-frame capture that includes content from before and/or after a capture input (e.g., the full/hard press) is detected, creating a “live” effect. Conditionally performing a photo capture or a video capture in response to a higher-intensity input based on the duration of the higher intensity provides improved control and ergonomics of computer systems without cluttering a displayed user interface with additional controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly select between performing photo and video captures using a full/hard press without needing to move the position of their hands or divert their attention from the capture to use a displayed control. Conditionally providing control of multiple different operations using a hardware button based on a duration of an intensity also reduces the overall number of hardware components needed for control (e.g., compared to mapping different functions to different buttons), resulting in a more compact, lighter, and cheaper device.

[0378] In some embodiments, the first set of criteria and the second set of criteria each include a requirement (e.g., a camera criterion) that is satisfied when the first set of one or more inputs is detected while the computer system is displaying, via the display generation component, a camera user interface (e.g., 612 and/or 1044) (e.g., a user interface for media capture, such as a camera application or a social media application with camera functionality; in some embodiments, any camera user interface included in a set of available camera user interfaces).

[0379] In some embodiments, in response to detecting the first set of one or more inputs and in accordance with a determination that the first set of one or more inputs satisfies a set of launch criteria, the computer system displays, via the display generation component, a respective camera user interface (e.g., as illustrated in FIGS. 6E and/or 10B) (in some embodiments, a particular camera user interface of the set of available camera user interfaces; in some embodiments, a default camera user interface), wherein the set of launch criteria includes a criterion that is satisfied when a first input element is activated (in some embodiments, the first input element is activated based on an input intensity exceeding a third intensity threshold) while the computer system is not displaying, via the display generation component, a camera user interface (e.g., as illustrated in FIGS. 6D and/or 10A) (e.g., any camera user interface included in a set of available camera user interfaces). For example, the computer system displays, surfaces, and/or launches a camera interface in response to press inputs detected while the camera interface is not already displayed, active, and/or running. In some embodiments, the computer system will open a particular camera application if the particular camera application is not already open. In some embodiments, the computer system will open the particular camera application unless any camera application is already open. In some embodiments, the set of one or more launch criteria include a criterion that is satisfied when the first set of one or more inputs includes input intensity that exceeds the second threshold intensity (e.g., the full/hard press threshold), e.g., the user can launch a camera application using a hard/full press, and then use a hard/full press while in the camera application to perform the second operation. In some embodiments, the set of launch criteria includes a criterion that is satisfied when the first input element is activated while the computer system is displaying a non-camera user interface (e.g., a home screen, a lock screen, a UI for an application that does not include a camera UI, and/or a non-camera UI for an application that does include a camera UI).

[0380] In some embodiments, in response to detecting the first set of one or more inputs and in accordance with a determination that the first set of one or more inputs satisfies a third set of criteria, the computer system ceases displaying, via the display generation component, a first set of one or more user interface objects (e.g., 612A, 612B, 612D, 612F, and/or 612G, as illustrated in FIGS. 6I-6J) (e.g., selectable user interface objects, such as touch controls, and/or other display elements), wherein the third set of criteria includes the first criterion that is satisfied when the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity and a criterion that is satisfied when the first set of one or more inputs is detected while displaying, via the display generation component, a user interface that includes the first set of one or more user interface objects (e.g., 612). For example, while displaying a particular user interface, the computer system hides certain display elements/affordances of the user interface in response a light/partial press, providing a “quiet” mode for the user interface. In some embodiments, the first set of one or more user interface objects includes media capture user interface objects, such as captured media preview and/or capture setting controls (e.g., zoom, flash, and/or mode controls), for example, as described with respect to FIG. 6E. In some embodiments, ceasing displaying the set of one or more user interface objects includes fading out one or more selectable user interface objects, e.g., by gradually increasing transparency, reducing contrast, and/or otherwise reducing their visual prominence. In some embodiments, ceasing displaying the set of one or more user interface objects includes animating one or more selectable user interface objects moving off of the display until no longer visible. In some embodiments, the computer system continues displaying the respective user interface without the set of one or more user interface objects (e.g., in the “quiet” mode) while the computer system is responsive to movement (e.g., when the computer system performs the first operation based on detected movements), and re-displays the hidden set of user interface objects in response to the inputs falling below a maintenance intensity threshold, ending or lifting off of the first input device, and/or exceeding the second threshold intensity. Hiding certain user interface objects of a user interface when an input meets the first criterion (e.g., in response to a light/partial press) provides users with real-time visual feedback about a state of the computer system, indicating to the user when a light/partial press state has been reached and allowing the user to quickly initiate control of the first operation (e.g., without checking for displayed feedback) or to end the input if control of the first operation is not immediately desired. Doing so also provides improved control and ergonomics of computer systems without cluttering a displayed user interface with additional controls, which makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), and, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, providing a “quiet” UI can help the user better observe the performance of the first operation (e.g., in response to movements detected after reaching the light/partial press state) and/or prepare to perform the second operation (e.g., by transitioning from a light/partial press to a hard/full press).

[0381] In some embodiments, in response to detecting the first set of one or more inputs and in accordance with a determination that the first set of one or more inputs satisfies a fourth set of criteria, the computer system displays, via the display generation component, a second set of one or more user interface objects (e.g., 612H, 612J, and/or capture guidance elements, such as the capture guidance grid and/or 647A, 547B, and/or 647C) (e.g., selectable user interface objects, such as touch controls, and/or other display elements) in a respective user interface (e.g., as illustrated in FIG. 6J), wherein the fourth set of criteria includes the first criterion that is satisfied when the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity; and a criterion that is satisfied when the first set of one or more inputs is detected while displaying, via the display generation component, the respective user interface (e.g., 612). For example, while displaying a particular user interface, the computer system displays additional display elements/affordances for the user interface in response a light/partial press, for example, providing a “ready” mode for the user interface. In some embodiments, the second set of one or more user interface objects includes capture guidance user interface objects, such as a capture guidance grid, capture guidance alignment indicator, detected subject indicator(s), and/or image histogram (e.g., a color histogram and/or tonality curve for the current capture). In some embodiments, the capture guidance user interface objects are conditionally displayed based on a current state of the computer system. For example, the computer system displays, changes the appearance of appearance, and/or stops displaying an alignment indicator based on how far displaced the computer system is from a target (e.g., level) orientation. For example, if certain subjects, such as people, pets, faces, and/or other subjects of determined significance, are detected in the camera preview, the computer system displays subject indicators framing the detected subjects in the camera preview. For example, the computer system updates the image histogram based on the current tonal content of the camera preview, such that the image histogram changes as the captured field-of-view changes (e.g., due to movement of the camera, changes to the captured environment, and/or changed media capture settings). In some embodiments, displaying the set of one or more user interface objects includes fading in one or more user interface objects, e.g., by gradually increasing opacity, increasing contrast, and/or otherwise increasing their visual prominence. In some embodiments, displaying the set of one or more user interface objects includes animating one or more selectable user interface objects moving onto the display. In some embodiments, the computer system continues displaying the user interface with the second set of one or more user interface objects (e.g., in the “ready” mode) while the computer system is responsive to movement (e.g., when the computer system performs the first operation based on detected movements), and hides the second set of user interface objects in response to the inputs falling below a maintenance intensity threshold, ending or lifting off of the first input device, and/or exceeding the second threshold intensity. Displaying additional user interface objects of a user interface when an input meets the first criterion (e.g., in response to a light/partial press) provides users with real-time visual feedback about a state of the computer system, indicating to the user when a light/partial press state has been reached and allowing the user to quickly initiate control of the first operation (e.g., without checking for displayed feedback) or to end the input if control of the first operation is not immediately desired. Doing so also provides improved control and ergonomics of computer systems without cluttering a displayed user interface with additional controls, which makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), and, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the computer system can refrain from displaying certain user interface elements that are relevant to the first and/or second operation until the light/partial press state is reached (e.g., when the user is preparing to perform the first and/or second operation).

[0382] In some embodiments, while displaying, via the display generation component, a user interface object corresponding to the first operation (e.g., 622) (e.g., a displayed control affordance or indicator for the first operation, such as a menu, slider, gauge, and/or wheel), the computer system detects a first tap input directed to the first input device (e.g., 616, 624E, and/or 624F as illustrated in FIGS. 6R-6S). In some embodiments, the user interface object corresponding to the first operation is initially displayed in response to detecting an input that satisfies the first criterion (e.g., exceeds the first threshold intensity). In some embodiments, computer system ceases displaying the user interface object corresponding to the first operation in response to detecting a lift-off, in response to detecting a lift-off and without detecting further input for at least a threshold period of time, and/or in response to detecting an input dismissing the user interface object corresponding to the first operation (e.g., a tap in another display region, a swipe across the first user interface object, and/or an input exiting the camera user interface). In some embodiments, the first tap input is included in the first set of one or more inputs. In some embodiments, the first tap input is separate from the first set of one or more inputs. In some embodiments, in response to detecting the first tap input, the computer system performs the first operation based on the first tap input, wherein performing the first operation based on the first tap input includes, in accordance with a determination that the first tap input is directed to a first region of the first input device (e.g., a tap on the upper, front, or left portion), changing a current settings value (e.g., a parameter value) from an initial settings value to a first updated settings value selected from a predetermined set of settings values (e.g., as illustrated in FIG. 6R) (e.g., a set of available, preselected, and/or preferred values for a setting; in some embodiments, “snapping values” of an ordered sequence of settings values), and in accordance with a determination that the first tap input is directed to a second region of the first input device that is different from the first region of the first input device (e.g., a tap on the lower, back, or right portion), changing the current settings value from the initial settings value to a second updated settings value selected from the predetermined set of settings values (e.g., as illustrated in FIG. 6S), wherein the first updated settings value is different from the second updated settings value and a direction of change from the initial settings value to the first updated settings value is different from a direction of change from the initial settings value to the second updated settings value (e.g., tapping on different portions of the first input device effects changes in different directions). For example, for a first operation of adjusting a camera zoom setting, in response to a tap detected in one region of the first input device, the computer system zooms in to the next designated zoom level, and in response to a tap detected in a different region of the first input device, the computer system zooms out to the next designated zoom level. As another example, for a first operation of selecting a camera filter, the computer system advances forward through the available filters in response to a tap detected in one region of the first input device and reverses backward through the available filters in response to a tap detected in the other region. In some embodiments, the first region and second region of the first input device are different regions of a touch-sensitive surface. In some embodiments, the first region and the second region of the first input device are regions with different hardware buttons and/or sensors (e.g., different operable regions of a compound button). In some embodiments, the user interface corresponding to the first operation is displayed in response to detecting a light/partial press (e.g., an input that satisfies the first criterion, e.g., exceeding the first threshold intensity). In some embodiments, the user interface corresponding to the first operation remains displayed until the input transitions into a full/hard press or until the first set of one or more inputs ends (e.g., until a lift-off event is detected or until a threshold period of time passes after a lift-off event without detecting subsequent inputs). Adjusting an operation setting in different directions in response to a tap input depending on where the tap input is detected provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, selecting from the predetermined settings values using tap inputs allows the user to adjust settings in a quick and intuitive manner without needing to display additional controls.

[0383] In some embodiments, in response to detecting the first set of one or more inputs (in some embodiments, and in accordance with a determination that the first set of one or more inputs has not yet satisfied the first criterion), the computer system displays (e.g., initially displays), via the display generation component, an indication of one or more characteristics (e.g., location and/or intensity) of the first set of one or more inputs (e.g., 618). For example, the computer system displays an indication of an initial contact with the first input device, even before the contact resolves into a light/partial press (e.g., exceeds the first intensity threshold) or a full/hard press (e.g., exceeds the second intensity threshold). In some embodiments, the displayed indication is displayed near the first input device, e.g., at the edge of a display nearest to a hardware button. For example, the displayed indication may include a “cut out” displayed near the hardware button appearing as though the inputs were pushing the hardware button into the display. Displaying an indication of input characteristics in response to detected inputs provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the input indication shows a user that input is being detected, even if the input does not yet satisfy the criteria to perform the first or second operation, allowing the user to adjust the input if performance of the first or second operation is desired or to stop the input if not.

[0384] In some embodiments, displaying the indication (e.g., 618) of one or more characteristics of the first set of one or more inputs includes, in accordance with a determination that the first set of one or more inputs includes a contact (e.g., 616) (e.g., a touch or press input) at a first location of the first input device, displaying the indication with a first appearance (e.g., as illustrated in FIG. 6F) (e.g., at a first display location); For example, the computer system displays the indication near the first location, e.g., at the edge of the display near the first location of the first input device. In some embodiments, the computer system displays the indication with other visual characteristics (e.g., size, shape, color, and/or transparency) based on where (or in which region) contact is detected via the first input device. In some embodiments, displaying the indication of one or more characteristics of the first set of one or more inputs includes, in accordance with a determination that the first set of one or more inputs includes a contact at a second location, different from the first location, of the first input device, displaying the indication with a second appearance different from the first appearance (e.g., as illustrated in FIGS. 6G-6H) (e.g., at a second, different display location). For example, the computer system displays the indication near the second location. In some embodiments, the computer system moves the indication relative to the first input device (e.g., moving along the edge of the display parallel to the first input device) as the input moves along the first input device, such that the indication appears to follow contact with the first input device. Visually indicating a location of a detected input provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, indicating the location of an input orients the user with respect to the first input device, preparing the user to provide movement inputs to control the first operation.

[0385] In some embodiments, displaying the indication (e.g., 618) of one or more characteristics of the first set of one or more inputs includes, in accordance with a determination that the first set of one or more inputs includes an input (e.g., a touch or press input) of a first input intensity, displaying the indication with a third appearance (e.g., as illustrated in FIG. 6F). In some embodiments, displaying the indication of one or more characteristics of the first set of one or more inputs includes, in accordance with a determination that the first set of one or more inputs includes an input of a second input intensity different from the first input intensity, displaying the indication with a fourth appearance different from the third appearance (e.g., as illustrated in FIG. 6H). For example, the computer system displays the indication with particular visual characteristics (e.g., location, size, shape, color, and/or transparency) based on how much or how hard the user is pressing the first input device. For example, the computer system increases the size of the indication as intensity increases and decreases the size of the indication as intensity decreases, e.g., displaying the indication at its smallest size when the input is resting on the first input device without pressing and displaying the indication at its largest size as the input intensity reaches the first intensity threshold. For example, the computer system displays the indication as a round bump when the input is resting on the first input device without pressing and displays the indication as a wide tab (e.g., morphing into a displayed control corresponding to the first operation). Visually indicating an intensity of a detected input provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, indicating the intensity of an input helps the user know to increase the intensity if performance of the first or second operation is desired or to decrease the intensity (and/or end the input) if performance of the first or second operation is not desired.

[0386] In some embodiments, while displaying the indication (e.g., 618) of the one or more characteristics of the first set of one or more inputs (e.g., as illustrated in FIG. 6F), the computer system detects a change to at least one of the one or more characteristics of the first set of one or more inputs (e.g., a change in location and/or intensity), and in response to detecting the change to at least one of the one or more characteristics of the first set of one or more inputs, the computer system changes (e.g., based on the change to the input characteristics) an appearance (e.g., visual characteristics of the indication, such as location, size, shape, color, and/or transparency) of the indication of the one or more characteristics of the first set of one or more inputs based on the change to the one or more characteristics of the first set of one or more inputs (e.g., as illustrated in FIGS. 6G-6I) (e.g., based on the magnitude and/or direction of the change). For example, the computer system moves the indication in a direction and/or by an amount on the display to reflect the direction and/or magnitude of movement of the input across the first input device. For example, the computer system grows, shrinks, warps, or changes the visual prominence of the indication in a direction and/or by an amount to reflect the direction and/or magnitude of changes to the intensity, e.g., as the applied intensity approaches or retreats from the first threshold intensity. In some embodiments, the computer system changes the appearance of the indication based on multiple changes to the characteristics of the inputs, such as moving the indication to follow movement of the input while also increasing the size and opacity of the indication as the intensity of the input increases. Visually indicating a change to the characteristics of a detected input provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, visually indicating changes to the characteristics of an input indicates how the user can control the first input device, e.g., visually indicating that the computer system can detect and respond to changes in location and intensity, and allows the user to adjust the characteristics of the input to achieve an intended effect.

[0387] In some embodiments, while displaying the indication (e.g., 618) of the one or more characteristics of the first set of one or more inputs, detecting that the first set of one or more inputs satisfies a fifth set of criteria, wherein the fifth set of criteria includes the first criterion that is satisfied when the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity. In some embodiments, in response to detecting that the first set of one or more inputs satisfies the fifth set of criteria, the computer system displays the indication of the one or more characteristics of the first set of one or more inputs displaying a respective user interface object corresponding to the first operation (e.g., a displayed control affordance or indicator for the first operation, such as a menu, slider, gauge, and/or wheel) in place of the indication of the one or more characteristics of the first set of one or more inputs (e.g., as illustrated in FIGS. 6I-6J). In some embodiments, the computer system displays (e.g., animates with a plurality of intermediate states that are displayed over time) the indication of the one or more characteristics of the first set of one or more inputs morphing into the respective user interface object. For example, before the input reaches the first threshold intensity, the computer system displays the indicator as a small bump extending from the edge of the display near the first input device, then displays the indicator expanding into a wide tab with control information for the first operation once the first criterion is met. In some embodiments, the tenth set of criteria includes a criterion that is met when the intensity of the input does not exceed the second threshold intensity for at least a threshold period of time after satisfying the first criterion, e.g., the computer system does not display the indication morphing into the control object in response to a quick full/hard press. Displaying an indication of one or more input characteristics that morphs into a user interface object corresponding to the first operation when the input transitions to a light/partial press provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, visually indicating changes to the characteristics of an input indicates how the user can control the first input device, e.g., visually indicating that the computer system can detect and respond to changes in location and intensity, and allows the user to adjust the characteristics of the input to achieve an intended result.

[0388] In some embodiments, in response to detecting the first set of one or more inputs and in accordance with a determination that the first set of one or more inputs satisfies an sixth set of criteria, the computer system displays (e.g., initially displays), via the display generation component, a user interface object (e.g., 622) corresponding to the first operation (e.g., as illustrated in FIG. 6J) (e.g., a displayed control affordance or indicator controlled by the first operation, such as a menu, slider, gauge, and/or wheel), wherein the sixth set of criteria includes the first criterion that is satisfied when the first set of one or more inputs includes the first input intensity that exceeds the first threshold intensity. In some embodiments, in response to detecting the first set of one or more inputs and in accordance with a determination that the first set of one or more inputs satisfies a seventh set of criteria, performing the first operation, wherein performing the first operation includes adjusting the user interface object (e.g., as illustrated in FIGS. 6L-6S, 6X, 6Z, 6AE-6AM, 10G, 10J, 10N, 10O, 10R, 10U, and/or 14A-14Z) (e.g., changing an appearance of the user interface object to indicate a result of the first operation) and the seventh set of criteria includes a criterion that is satisfied when the first set of one or more inputs includes a respective type of input (e.g., 616B, 624B, 616C, 624B, 616D, 624C, 616E, 624D, 630A, 630B, 644, 646, 648, 650, 652, 654, 656, 658, 660, 662, 664, 666, 668, 670, 672, and/or movement inputs described with respect to FIGS. 10G, 10J, 10N, 10O, 10R, 10U, and/or 14A-14Z) (e.g., a movement of more than a threshold amount of movement of the first type (e.g., a swipe, drag, and/or flick) and/or a tap; e.g., inputs directed to the first input device and/or to the displayed user interface object) detected while displaying the user interface object corresponding to the first operation. In some embodiments, in accordance with a determination that the respective type of input is detected while the user interface object associated with the first operation is not being displayed, the computer system foregoes performing the first operation in response to the respective type of input. For example, as long as the user interface object corresponding to the first operation is displayed, the computer system will perform the first operation in response to appropriate inputs (e.g., swipes, drags, flicks, and/or taps on the hardware button or on the displayed user interface object), but the computer system will not respond to those inputs while the user interface object is not being displayed (e.g., until the control is re-invoked via a light/partial press or full swipe). In some embodiments, displaying and adjusting the user interface object is performed as described with respect to FIGS. 14A-14Z and 15. Displaying a user interface object corresponding to the first operation in response to a light/partial press provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, initially displaying the user interface object indicates that the computer system is ready to respond to movement inputs via the first input device, and adjusting the user interface object provides visual feedback on the results of the computer system's response to movement inputs.

[0389] In some embodiments, while the user interface object corresponding to the first operation is not displayed, the computer system detects a respective input. In some embodiments, the respective input does not satisfy the first criterion. For example, the respective input does not include a input intensity that exceeds the first threshold intensity, e.g., the respective input does not include a light/partial press of sufficient intensity to activate the user interface object corresponding to the first operation. In some embodiments, in response to detecting the respective input and in accordance with a determination that the respective input includes more than a second threshold amount of movement of the first type (e.g., a swipe across the surface of the first input device; in some embodiments, the second threshold amount of movement is a lower amount of movement than the threshold amount of movement), the computer system displays (e.g., initially displays), via the display generation component, the user interface object (e.g., 622) corresponding to the first operation (e.g., as described with respect to FIG. 6J). For example, the first set of one or more inputs includes more than the second threshold amount of movement when the first set of one or more inputs includes a swipe across the entire length of the first input device, a swipe of at least a predetermined portion of the length of the first input device (e.g., 90%, 70%, 50%, or 45%), and/or a swipe off of the end of the first input device (e.g., a swipe across and off the surface of the first input device). In some embodiments, while displaying the user interface object corresponding to the first operation, in accordance with a determination that the first set of one or more inputs includes movement that satisfies the second criterion, the computer system performs the first operation based on the movement, e.g., the computer system performs the first operation in response to movement inputs while the user interface object corresponding to the first operation is displayed, whether the user interface object corresponding to the first operation was initially displayed in response to a light/partial press or in response to a movement of more than the second threshold amount. In some embodiments, if the respective input does not satisfy the first criterion, in accordance with a determination that the respective input does not include a movement input that exceeds the threshold amount of movement, the computer system forgoes displaying the user interface object corresponding to the first operation. Displaying a user interface object corresponding to the first operation in response to a long swipe of the first input device provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, initially displaying the user interface object indicates that the computer system is ready to respond to movement inputs via the first input device.

[0390] In some embodiments, while displaying the user interface object (e.g., 622) corresponding to the first operation, the computer system detects a lift-off event (e.g., as described with respect to FIGS. 6N, 6Q, 6R-6S, 6T, and/or 6AA). In some embodiments, a lift-off event is detected when contact with the first input device ends, for example, when contact is no longer detected by one or more touch/capacitive sensors of the first input device, e.g., due to the user moving their finger or stylus away from the surface of the first input device. In some embodiments, a lift-off event is detected when a input intensity of the one or more inputs falls below a light/partial press maintenance threshold, e.g., a force or pressure threshold, e.g., 0.5 g/cm³, 1 g/cm³, or 5 g/cm³, for example, when the user is resting a finger on the first input device but not pressing in.

[0391] In some embodiments, in response to detecting the lift-off event and in accordance with a determination that an input that satisfies an eighth set of criteria (e.g., a light/partial press, a movement of more than a threshold amount of movement of the first type (e.g., a swipe, drag, and/or flick) and/or a tap; e.g., inputs directed to the first input device and/or to the displayed user interface object) is not detected, via the first input device, within a threshold period of time after detecting the lift-off event (e.g., 0.5 s, 1 s, 1.3 s, or 2 s), the computer system ceases displaying the user interface object corresponding to the first operation (e.g., as described with respect to FIGS. 6U and/or 6AB). In some embodiments, in accordance with a determination that an input that satisfies the eighth set of criteria is detected within a threshold period of time after detecting the lift-off event, the computer system continues displaying the user interface object and performing the first operation in response to qualifying movement of the first type. For example, after a lift-off of the first set of one or more inputs, the computer system continues to display the user interface object for at least the threshold period of time, then dismisses the user interface object if no further interaction with the user interface object is detected in that time. Automatically ceasing display of the user interface object corresponding to the first operation a threshold period of time after a lift-off of the one or more inputs if no further inputs are detected following the lift-off provides improved control of computer system functionality without cluttering the user interface with additional displayed controls and provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, displaying the user interface object indicates that the computer system will continue to perform the first operation in response to appropriate movements even after a brief lift-off (e.g., without needing to provide another light/partial press first), while ceasing displaying the user interface object indicates that another light/partial press is needed to re-activate control of the first operation.

[0392] In some embodiments, displaying the user interface object (e.g., 622) corresponding to the first operation includes, in accordance with a determination that an orientation of the computer system (in some embodiments, a physical orientation, e.g., with respect to the direction of gravity's pull) is in a first state (e.g., one state of one or more portrait orientation states and one or more landscape orientation states), displaying the user interface object at a first location within a respective user interface, and in accordance with a determination that the orientation of the computer system is in second state different from the first state, displaying the user interface object at a second location, different from the first location, within the respective user interface (e.g., as described with respect to FIG. 6K). In some embodiments, the first location and the second location are different relative to the overall orientation of the respective user interface, but both the first location and the second location are displayed near the physical location of the first input device (e.g., the location of the user interface object is device- or hardware-locked). For example, while the computer system is in a portrait orientation, the user interface object is displayed on a side of the user interface relative to the user interface's overall orientation (e.g., the orientation of text, icons, and/or other elements in the user interface), and while the computer system is in a landscape orientation, the user interface object is displayed at the top or bottom of the user interface relative to object is displayed on a side of the user interface relative to the user interface's overall orientation. For example, where the first input device includes a hardware button located outside of the display on which the user interface is displayed, the user interface object is always displayed near the hardware button, e.g., at the bottom of the user interface when the computer system is oriented such that the hardware button is at the bottom of the user interface, and at the top of the user interface when the computer system is oriented such that the hardware button is at the top of the user interface. Displaying the user interface object at different locations within a user interface depending on the orientation of the computer system provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, changing where the user interface object is displayed within a user interface allows the user interface object to be consistently displayed near the first input device, thus providing the user with improved feedback about inputs performed via the first input device.

[0393] In some embodiments, displaying the user interface object (e.g., 622) corresponding to the first operation includes, in accordance with a determination that an orientation of the computer system (in some embodiments, a physical orientation, e.g., with respect to the direction of gravity's pull) is in a first state (e.g., one state of one or more portrait orientation states and one or more landscape orientation states), displaying one or more elements of the user interface object in a first display configuration, and in accordance with a determination that the orientation of the computer system is in a second state different from the first state, displaying the or more elements of the user interface object in a second display configuration, different from the first display configuration (e.g., as described with respect to FIG. 6K). For example, the first and second display configuration define how different elements of the user interface object, such as tick marks, text, icons, frame elements, and/or other graphical elements are positioned and/or rotated with respect to each other (e.g., within the frame of reference of the user interface object). In some embodiments, the first display configuration and the second display configuration differ in at least one way with respect to the overall orientation of the respective user interface. For example, a zoom user interface object in a camera user interface includes tick marks representing zoom levels, where tick marks representing higher zoom levels may be above, below, left, or right of tick marks representing lower zoom levels within the frame of reference of the camera user interface (e.g., where above, below, left, and right are defined with respect to the upright orientation of other text or elements within the camera user interface); however, the tick marks representing higher zoom levels may always be displayed further away from the one or more cameras (e.g., closer to the bottom of the device) than the tick marks representing lower zoom levels within the frame of reference of the hardware. In some embodiments, the first display configuration and the second display configuration differ in at least one way with respect to the hardware of the computer system. For example, the zoom user interface object includes text, representing a current zoom level, that the computer system orients in the same direction as other text in the camera user interface, but depending on the orientation of the computer system, the text is above, below, left, or right of the first input device. Displaying the user interface object in different configurations depending on the orientation of the computer system provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, changing the configuration of the user interface object as the orientation of the computer system provides an up-to-date and visually-clear indication of the polarity of movement needed to achieve a certain result with the first operation.

[0394] In some embodiments, while displaying the user interface object (e.g., 622) corresponding to the first operation, the computer system detects (e.g., via a touch sensitive display that is displaying the user interface object) a third set of one or more inputs including an input directed to a display location of the user interface object (e.g., 624B, 624B1, 624C, 624D, 624E, 624F, 642, 646, 650, 654, 658, 662, 666, 670, and/or 674) (e.g., a swipe, flick, drag, tap, and/or press at a location on the touch sensitive display on the user interface object). In some embodiments, in response to detecting the third set of one or more inputs, the computer system performs the first operation based on the input directed to the display location of the user interface object (e.g., as described with respect to FIGS. 6L-6S and/or 6AE-6AM) (e.g., based on the location, direction of movement, magnitude of movement, and/or speed of movement of the input to the user interface object). For example, in computer systems where the first input device includes a hardware button or sensor separate from a touch-sensitive display, the computer system performs the first operation both in response to light/partial press inputs with movement detected via the hardware button/sensor and in response to inputs manipulating the user interface object via the touch-sensitive display. Performing the first operation in response to inputs directed to the displayed user interface object in addition to in response to inputs satisfying the first set of criteria provides improved control of computer system functionality. Doing so makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, after movement control of the first operation is activated (e.g., using a light/partial press and/or a full swipe of a hardware button), the computer system provides flexible control of the first operation, where the user can provide inputs via either a hardware button or the displayed touch control for the first operation.

[0395] In some embodiments, displaying the user interface object corresponding to the first operation (e.g., 622) includes displaying one or more graphical elements of a plurality of graphical elements (e.g., tick marks, dots, text, icons, and/or symbols) within a first display region. In some embodiments, performing the first operation includes adjusting a parameter value for a setting, and the plurality of graphical elements represent a respective plurality of parameter values (e.g., zoom levels, filter types, filter intensities, exposure values, f-stop values, and/or focus subjects). In some embodiments, displaying the one or more graphical elements of the plurality of graphical elements within the first display region includes: distorting an appearance (e.g., blurring, warping, changing color, changing brightness, and/or changing opacity of) of the one or more graphical elements at a first portion of the first display region corresponding to a first edge of the first display region; and distorting an appearance of the one or more graphical elements at a second portion of the first display region, different from the first portion of the display region, corresponding to a second edge of the first display region different from the first edge of the display region (e.g., as illustrated in FIG. 6J1). For example, the plurality of graphical elements are represented in the user interface object as options on simulated dial that curves (e.g., outwards or inwards) relative to the user (or a viewpoint of the user), a front of the user interface, or a surface of the display (e.g., simulating a round dial that can be rotated by lateral movements across the surface of the display), so the graphical elements are distorted (e.g., blurring, warping, changing color, changing brightness, and/or changing opacity of) to appear as though they are curving away from the user (e.g., around the edge of the simulated dial and/or into a plane of the display or user interface) towards the edges of the user interface object. In some embodiments, the distortion is progressive and increases toward the edges of the option user interface. In some embodiments, performing the first operation includes adjusting a parameter value for a setting, and the user interface object corresponding to the first operation includes a platter or slider for selecting a value of the parameter. For example, the platter or slider is distorted near the edges of the operation user interface to simulate a curved dial. Distorting elements of the user interface object corresponding to the first operation at the edges of the user interface object (e.g., to simulate the appearance of a curved dial) provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, displaying the user interface object as a simulated curved dial intuitively indicates to the user how to perform the first operation (e.g., using lateral gesture inputs, as if rotating the dial) and/or the range of values available for the first operation (e.g., the user can “rotate” the dial to display additional parameter values).

[0396] In some embodiments, while displaying a user interface object (e.g., 622) corresponding to the first operation, the computer system detects (in some embodiments, via the first input device; in some embodiments, via another input device) a second set of one or more inputs (e.g., 626A and/or 626B). In some embodiments, the user interface object corresponding to the first operation is initially displayed in response to detecting an input that satisfies the first criterion (e.g., exceeds the first threshold intensity). In some embodiments, computer system ceases displaying the user interface object corresponding to the first operation in response to detecting a lift-off and without detecting further input for at least a threshold period of time. In some embodiments, in response to detecting the second set of one or more inputs and in accordance with a determination that the second set of one or more inputs corresponds to a request to dismiss the user interface object corresponding to the first operation, the computer system ceases displaying the user interface object corresponding to the first operation (e.g., as illustrated in FIG. 6U). In some embodiments, the second set of one or more inputs corresponds to a request to dismiss the user interface object if it includes a tap directed to a location outside of the display region of the user interface object (e.g., on a touch sensitive display). In some embodiments, the second set of one or more inputs corresponds to a request to dismiss the user interface object if it includes a swipe across the user interface object towards an edge of the display, e.g., swiping from the interior of the display, across the user interface object, and off the edge of the display. For example, the user can tap outside of the user interface object or swipe over the user interface object to dismiss it prior to the threshold period of time elapsing following a lift-off. Automatically ceasing display of the user interface object corresponding to the first operation a threshold period of time after a lift-off of the one or more inputs if no further inputs are detected following the lift-off provides improved control of computer system functionality without cluttering the user interface with additional displayed controls and provides users with real-time feedback about a state of the computer system, which assists the user with control of the computer system via the first input device. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system), which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

[0397] In some embodiments, the first set of one or more inputs includes a first movement input, wherein the first movement input is more than the threshold amount of movement of the first type and the first movement input moves in a first direction (in some embodiments, relative to a user interface in which the UI object is displayed, e.g., up, down, left, or right with respect to the user interface's orientation; in some embodiments, relative to the direction of gravity's pull; in some embodiments, relative to the first input device and/or the computer system, e.g., towards the top, bottom, left side, or right side of the electronic device). In some embodiments, performing the first operation (e.g., in response to the first set of one or more inputs) includes, in accordance with a determination that the first movement input is detected while an orientation of the computer system is in a first state, changing a current settings value (e.g., a parameter value) from an initial settings value to a first updated settings value (e.g., as illustrated in FIGS. 6L-6M, where the computer system increases zoom in response to right-to-left movements 616B, 624A, 616C, and/or 624B). In some embodiments, performing the first operation includes, in accordance with a determination that the first movement input is detected while the orientation of the computer system is in a second state different from the first state, changing the current settings value from the initial settings value to a second updated settings value different from the second updated settings value, wherein a direction of change from the initial settings value to the first updated settings value (e.g., increasing a parameter value, decreasing a parameter value, cycling forward through parameter values, and/or cycling backwards through parameter values) is different from a direction of change from the initial settings value to the second updated settings value (e.g., as illustrated in FIG. 6Z, where the computer system decreases zoom in response to right-to-left movement 630B). In some embodiments, the first direction is defined relative to the hardware of the computer system, e.g., towards the top (e.g., towards one or more cameras), bottom (e.g., towards a charge port), left (e.g., with respect to the display), or right (e.g., with respect to the display) of the device. For example, for a first operation of controlling a zoom level in a camera user interface, swiping towards the cameras increases zoom regardless of how the camera user interface is oriented (e.g., regardless of whether the swipe is moving towards the top, bottom, left, or right of the user interface) and/or the direction of gravity's pull (e.g., regardless of how the computer system is oriented within the environment). Changing the direction of adjustment made by the first operation in response to a particular direction of movement based on the orientation of the computer system provides improved control of computer system functionality. Doing so makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems. For example, although the orientation of the user interface might change as the orientation of the computer system changes, the user can achieve consistent results for the first operation by swiping in the same direction with respect to the first input device.

[0398] Note that details of the processes described above with respect to method 700 (e.g., FIG. 7) are also applicable in an analogous manner to the methods described above and below. For example, controls based on variable characteristics of hardware inputs as described with respect to method 700 can be used for capturing media as described with respect to method 900, controlling customizable functions as described with respect to method 1100, controlling media playback as described with respect to method 1300, and/or adjusting a setting as described with respect to method 1500. For brevity, these details are not repeated below.

[0399] FIGS. 8A-8P illustrate example techniques and systems for controlling media capture operations based on variable characteristics of hardware inputs in accordance with some embodiments. For example, FIGS. 8A-8P illustrate capturing photo media using short press inputs, capturing video media using long press inputs, and locking the video media for capture after a press input ends using movement inputs.

[0400] At FIG. 8A, computer system 600 displays camera user interface 612, as described with respect to FIG. 6E. In particular, at FIG. 8A, camera user interface 612 is in a standard photo capture mode, indicated by the “PHOTO” menu item being centered and emphasized in capture mode affordance 612A. For example, in the standard photo capture mode, in response to inputs selecting shutter affordance 612C, computer system 600 captures photo media without simulated depth-of-field effects (e.g., the captured photo media is designated for display without the simulated blurring described with respect to FIGS. 6AE-6AH). While displaying camera user interface 612, computer system 600 detects press input 802 of first button 602A. As illustrated in FIG. 8A, press input 802 is a hard/full press of first button 602A, e.g., a press with enough intensity to place first button 602a into hardware button state (E). In some embodiments, press input 802 is a “quick” hard/full press, which places first button 602a into hardware button state (E) (e.g., passing the hard/full press threshold intensity) less than a first threshold period of time (e.g., 0.05 s, 0.1 s, 0.25 s, or 0.5 s) after press input 802 places first button 602a into hardware button state (D) (e.g., passing the light/partial press threshold intensity), so computer system 600 does not update camera user interface 612 to a “quiet” or “ready to capture” mode/appearance as described with respect to FIGS. 6I-6J.

[0401] At FIG. 8B, less than a second threshold period of time (e.g., 0.25 s, 0.5 s, 0.8 s, or 1 s) after press input 802 places first button 602a into hardware button state (E), computer system 600 detects end 802′ of press input 802. In some embodiments, computer system 600 detects end 802′ of press input 802 when the intensity of press input 802 falls below a maintenance threshold, for instance, transitioning into hardware button state (B), but finger 608 may remain resting on first button 602a, e.g., a press-and-release without lift-off. In some embodiments, computer system 600 detects end 802′ of press input 802 when finger 608 is lifted off of first button 602a, for instance, transitioning into hardware button state (A), e.g., a press-and-release with lift-off. Because press input 802 ends within the second threshold period of time, computer system 600 registers press input 802 is a “short” hard/full press (e.g., a hard/full press with a short duration, in contrast to the quick hard/full press, which resolves quickly into a hard/full press from a less-intense state).

[0402] In response to press input 802 (e.g., a short hard/full press), at FIG. 8B, computer system 600 captures photo media and updates captured media icon 612D to include a thumbnail of the captured photo media. As press input 802 was detected while camera user interface 612 is in the standard photo capture mode, computer system 600 captures the photo media without applying simulated depth-of-field effects.

[0403] While remaining in the standard photo capture mode of camera user interface 612, computer system 600 detects press input 804, another hard/full press of first button 602A. At FIG. 8D, as the duration of press input 804 (e.g., the elapsed time since initially registering press input 804 as a hard/full press without detecting an end of press input 804) approaches the second threshold period of time (e.g., nears 0.25 s, 0.5 s, 0.8 s, or 1 s), computer system 600 begins to transition the display of camera user interface 612 to a video capture mode (e.g., as described at FIG. 6Y). In particular, as illustrated in FIG. 8D, computer system 600 begins to lengthen the aspect ratio of camera preview 614 (e.g., from an initial aspect ratio of 4:3), animates shutter affordance 612C morphing into a stop recording button (e.g., showing a white center circle of shutter affordance 612C shrinking, changing shape, and changing color), and begins to fade out (e.g., increases the transparency of and/or visually deemphasizes) several of the touch controls included in camera user interface 612, including capture mode affordance 612A, camera selection affordance 612B, captured media icon 612D, multi-frame photo affordance 612F, and camera flash affordance 612G.

[0404] Additionally, at FIG. 8D, computer system 600 begins displaying lock affordance 806. Lock affordance 806 (illustrated in full at FIG. 8E) is a slider user interface element displayed within a tab-shaped cut-out from camera user interface 612 extending into display 606 from the location of first button 602A (e.g., the lower-right edge of display 606 adjacent to first button 602A). As illustrated in FIG. 8D, computer system 600 animates lock affordance 806 beginning to emerge from the location of first button 602A as the duration of press input 804 approaches the second threshold period of time. In some embodiments, if press input 804 ends before reaching the second threshold period of time, computer system 600 reverts the changes to camera user interface 612 to return to the appearance illustrated at FIG. 8C.

[0405] At FIG. 8E, the duration of press input 804 exceeds the second threshold period of time, registering as a “held” long/full press, and in response, computer system 600 initiates capturing video media. Because press input 804 is detected while camera user interface 612 is in the standard photo capture mode, computer system 600 initiates a standard video capture, without applying simulated depth-of-field effects to camera preview 614 and/or the captured media. As illustrated in FIG. 8E, when the capture of video media begins, computer system 600 displays camera user interface 612 in the video capture mode, completing the transition started at FIG. 8D. In particular, at FIG. 8E, the faded touch controls are removed completely, the aspect ratio of camera preview 614 has lengthened to a video capture aspect ratio (e.g., 16:9), and shutter affordance 612C is displayed as a stop recording button (e.g., a circle with a red square in the middle). Additionally, computer system 600 displays capture timer 612I, indicating the current elapsed time of the capture of video media.

[0406] At FIG. 8E, computer system 600 displays lock affordance 806 fully emerged from the edge of display 606 near first button 602A. As illustrated in FIG. 8E, lock affordance 806 includes slider element 806A, a lock icon with an arrow pointing down, e.g., away from the lock icon and the set of cameras along the edge of first button 602A. Lock affordance 806 indicates that the ongoing capture of video media is currently a temporary video media capture, which will continue at least as long as press input 804 continues (e.g., at least until computer system 600 detects press input 804 ending, as described with respect to end 802′). Lock affordance 806 also indicates how to “lock” the initiated capture of video media in order to continue the capture after press input 804 ends (e.g., a persistent video capture, as described in further detail with respect to FIGS. 8I-8L, below). Specifically, lock affordance 806 indicates the direction (e.g., downward) and magnitude (e.g., distance) of a movement input needed to lock the capture. For example, the magnitude may be a predetermined distance (e.g., the full length of first button 602A, 75% of the length of first button 602A, or 50% of the length of first button 602A) and/or a dynamic distance (e.g., swiping from the initial contact position all the way to the bottom edge of first button 602A, 90% of the way to the bottom edge of first button 602A, or 75% of the way to the bottom edge of first button 602A).

[0407] At FIG. 8F, while capturing the video media, computer system 600 detects movement 804A, where press input 804 begins to slide downwards across the surface of first button 602A (e.g., away from the set of cameras). In some embodiments, as illustrated in FIG. 8F, movement 804A is detected while press input 804 maintains a hard/full press of first button 602A.

[0408] In response to detecting movement 804A, computer system 600 updates slider element 806A to show the lock icon sliding down along the direction of the arrow towards an end point of slider element 806A by an amount corresponding to the distance traveled along the edge of display 606 by movement 804A. In some embodiments, if computer system 600 detects movement in the opposite direction (e.g., up), computer system 600 animates the lock icon sliding back up, opposite the direction of the arrow and away from the end point. In some embodiments, computer system 600 animates the lock icon sliding in a direction corresponding to current the direction of detected movement of press input 804 and at a speed corresponding to the current speed of detected movement of press input 804, such that the lock icon travels along the slider to follow press input 804 as finger 608 moves up and down along first button 602A and the instant location of the lock icon relative to the end point of slider element 806A corresponds to the distance press input 804 still needs to travel to lock the video capture. For example, if movement 804A has traveled three-quarters of the distance needed to lock the video capture, computer system 600 displays the lock icon three-quarters of the way down the initial length of slider element 806A.

[0409] Alternatively, in some embodiments, computer system 600 detects swipe 807 directed to lock affordance 806 on the touch-sensitive surface of display 606 and updates slider element 806A based on swipe 807 as described with respect to movement 804A, animating the lock icon to follow swipe 807 along slider element 806A. In some embodiments, computer system 600 continues the video capture for at least as long as swipe 807 is detected on lock affordance 806 via the touch-sensitive surface of display 606, for instance, allowing the user to maintain the temporary video capture via either first button 602A or lock affordance 806. For example, while displaying lock affordance 806, computer system 600 may continue the video capture for a third threshold period of time (e.g., 0.05 s, 0.1 s, or 0.25 s) after detecting input 804 end and only stops the video capture as described with respect to FIG. 8G if contact with lock affordance 806 is not established before the end of the third threshold period of time.

[0410] As illustrated in FIG. 8F, movement 804A (and/or swipe 807) does not move the lock icon all the way to the end point of slider element 806A. Accordingly, at FIG. 8G, when computer system 600 detects end 804′ of press input 804, computer system 600 stops the capture of video media and updates captured media icon 612D to include a thumbnail of the captured video media. As illustrated in FIG. 8G, computer system 600 begins to revert camera user interface 612 back to the standard photo capture mode, removing capture timer 612I, fading the removed touch controls back in, shrinking the aspect ratio of camera preview 614 back to 4:3, and retracting lock affordance 806 (e.g., sliding off of display 606 towards first button 602A).

[0411] At FIG. 8H, computer system 600 displays camera user interface 612 in a portrait photo capture mode, indicated by the “PORTRAIT” menu item being centered and emphasized in capture mode affordance 612A. For example, in the portrait photo capture mode, in response to inputs selecting shutter affordance 612C, computer system 600 captures photo media with simulated depth-of-field effects and/or other portrait photo effects (e.g., simulated lighting effects, filters, and/or other effects) applied. As illustrated in FIG. 8H, in the portrait photo capture mode, computer system 600 displays camera preview 614 with simulated depth-of-field effects applied, blurring portions of the foreground (e.g., including the sandcastle, volleyball, and portions of the beach closest to the set of cameras) and background (e.g., including the ocean and sky) while leaving the midground (e.g., including the person) in focus. Additionally, computer system 600 displays depth capture affordance 612J, portrait effect affordances 612K (e.g., touch controls for applying different types of portrait effects), and subject indicator 612L (e.g., framing the person identified as a subject within camera preview 614).

[0412] At FIG. 8H, while displaying camera user interface 612 in the portrait photo capture mode, computer system 600 detects press input 808, another hard/full press of first button 602A. As described with respect to FIG. 8E, once the duration of press input 808 exceeds the second threshold period of time (e.g., registering as a held long/full press), at FIG. 8I, computer system 600 initiates capturing video media. Because press input 808 is detected while camera user interface 612 is in the portrait photo capture mode, computer system 600 initiates a cinematic video capture (e.g., a video capture mode corresponding to the portrait photo capture mode), applying simulated depth-of-field effects to camera preview 614 and the captured video media. As illustrated in FIG. 8I, during the cinematic video capture, computer system 600 displays camera user interface in the video capture mode, with certain touch elements faded out, camera preview 614 expanded to the 16:9 aspect ratio, shutter affordance 612C displayed as the video stop button, and capture timer 612I indicating the current elapsed time of the capture. Additionally, computer system 600 initiates display of lock affordance 806. In some embodiments, computer system 600 displays camera user interface 612 transitioning to the video capture mode and lock affordance 806 emerging from first button 602A as the duration of press input 808 nears the second threshold period of time as described with respect to FIG. 8D.

[0413] At FIG. 8J, while capturing the video media, computer system 600 detects movement 808A of press input 808, where press input 808 begins to slide downwards across the surface of first button 602A. Alternatively, as described with respect to FIG. 8F, computer system 600 detects a corresponding swipe 810 directed to lock affordance 806 via the touch-sensitive surface of display 606. In response to detecting movement 808A, computer system 600 updates slider element 806A as described with respect to FIG. 8F, animating the lock icon sliding down slider element 806A to follow movement 808A. In some embodiments, computer system 600 continues displaying lock affordance 806 at least as long as press input 808 is maintained, allowing the user to provide movement 808A at any time and/or at any speed. For example, as illustrated in FIG. 8F, movement 808A moves the lock icon most of the way down slider element 806A when the elapsed time of the video capture is at 4 seconds (e.g., indicated by capture timer 612I).

[0414] At FIG. 8K, while capturing the video media, computer system 600 detects movement 808B of press input 808, a further movement downwards across first button 602A. Based on movement 808B, computer system 600 displays the lock icon sliding the remainder of the way to the end point of slider element 806A, e.g., reaching a locked position. In some embodiments, computer system 600 displays additional indications that the movement inputs have reached the locked position, for instance, displaying the lock icon with increased emphasis as illustrated in FIG. 8K. The updated appearance of lock affordance 806 indicates that the ongoing capture of video media is currently a persistent video capture, which continues without the user needing to maintain press input 808. In some embodiments, after detecting movement 808B and/or displaying slider element 806A with the lock icon in the locked position, computer system 600 stops displaying lock affordance 806, for instance, animating lock affordance 806 retracting into first button 602A.

[0415] As illustrated in FIG. 8L, once the video capture is locked in response to movement 808A and movement 808B swiping down a sufficient distance along first button 602A, computer system 600 continues capturing the video media after press input 808 ends (e.g., as described with respect to FIGS. 8B and 8G). Accordingly, at FIG. 8L, the user is free to provide other inputs without needing to keep pressing first button 602A, such as interacting with camera user interface 612 via the touch-sensitive surface of display 606 and/or adjusting capture settings via first button 602A/settings control 622 (e.g., as described with respect to FIG. 6Z).

[0416] At FIG. 8M, while the ongoing video capture is locked, computer system 600 detects press input 812, a hard/full press of first button 602A. In some embodiments, in response to detecting end 812′ of press input 812, at FIG. 8N, computer system 600 captures photo media while continuing the capture of the video media. As illustrated in FIG. 8N, computer system 600 temporarily displays thumbnail 814 of the captured photo media, for example, before fading thumbnail 814 and/or sliding thumbnail 814 off of display 606. As illustrated in thumbnail 814, the captured photo media is displayed with simulated depth-of-field effects applied, e.g., the captured photo media is a portrait photo capture. In some embodiments, computer system 600 captures the photo media in response to detecting end 812′ of press input 812 within the first threshold period of time (e.g., in response to a short hard/full press, as described with respect to FIGS. 8A-8B).

[0417] At FIG. 8O, while the ongoing video capture is locked, computer system 600 detects an input requesting to end the video capture, such as press input 816 of first button 602A and/or touch input 818 directed to shutter affordance 612C via the touch-sensitive surface of display 606. In response to detecting press input 816 and/or touch input 818, at FIG. 8P computer system 600 ends the capture of video media, reverting camera user interface 612 to the portrait photo capture mode (e.g., the state camera user interface 612 was in prior to starting the video capture) and updating captured media icon 612D to show a thumbnail of the captured video media. As illustrated in captured media icon 612D, the captured video media is displayed with the cinematic video capture mode simulated depth-of-field effects. In some embodiments, computer system 600 captures the photo media in response to detecting press input 812 end after the first threshold period of time.

[0418] FIGS. 9A-9B are a flow diagram illustrating method 900 for controlling a computer system based on variable characteristics of hardware inputs, in accordance with some embodiments. The method is performed at a computer system (e.g., 100, 300, 500, and/or 600) that is in communication with a display generation component (e.g., 606) (e.g., a display controller; a touch-sensitive display system; a display (e.g., integrated and/or connected), a 3D display, a transparent display, a projector, and/or a heads-up display), one or more cameras (e.g., 604A, 604B, 604C, and/or 604D) (e.g., one or more rear (user-facing) cameras and/or one or more forward (environment-facing) cameras), and a first input device (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606) (e.g., including one or more hardware buttons and/or surfaces, such as mechanical (e.g., physically depressible), solid-state, intensity-sensitive, and/or touch-sensitive (e.g., capacitive) buttons and/or surfaces), e.g., as illustrated in FIGS. 6A-6B. In some embodiments, the one or more cameras include one or more cameras with different lenses/lens types, such as a standard camera, a telephoto camera, and/or a wide-angle camera. In some embodiments, the first input device is included in a plurality of input devices in communication with the computer system. In some embodiments, the computer system is optionally in communication with one or more sensors, such as camera sensors, optical sensors, depth sensors, capacitive sensors, intensity sensors, motion sensors, vibration sensors, and/or audio sensors.

[0419] The computer system detects (902), via the first input device (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606), a first set of one or more inputs directed to the first input device (e.g., 802, 804, 807, 808, 810, 812, 816, and/or other inputs as described with respect to FIGS. 6A-7 and 10A-11B, and/or 14A-15) (e.g., a press, tap, click, swipe, and/or other manipulation of the first input device). In response to detecting the first set of one or more inputs (904) (in some embodiments, a single input; in some embodiments, a single continuous contact with the first input device that includes multiple component inputs, such as a press, followed by movement) and in accordance with a determination that the first set of one or more inputs satisfies a first set of criteria (906), the computer system captures (908), via the one or more cameras, first photo media (e.g., as described with respect to FIGS. 8A-8B and/or 8M-8N) (in some embodiments, the first photo media includes still (e.g., single-frame) photo media. In some embodiments, the first photo media includes photo media with a limited (e.g., 0.5 s, 1 s, 3 s, and/or 5 s) duration, such as a multi-frame capture that includes content (e.g., frames) from before and/or after a capture input is detected, creating a “live” effect. In some embodiments, the first photo media includes one or more images (e.g., frames) that are displayed in sequence, such as a media item that saved in the graphical interface file format. In some embodiments, the first photo media includes spatial media content such as depth information), wherein the first set of criteria includes a first criterion that is satisfied when the first set of one or more inputs includes a press input of a first type (in some embodiments, the press input of the first type is a hard/full press input, e.g., a detected contact that applies at least a threshold intensity and/or depresses a mechanical input device at least a threshold amount. In some embodiments, the press input of the first type is a short press input, where the press is released and/or lifted off within a threshold amount of time (e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s) after initially registering).

[0420] In response to detecting the first set of one or more inputs (904) and in accordance with a determination that the first set of one or more inputs satisfies a second set of criteria (910), the computer system captures (912), via the one or more cameras, first video media (e.g., as described with respect to FIGS. 8E-8F and/or 8I-8P) (in some embodiments, the first video media includes spatial media content such as depth information), wherein the second set of criteria includes a second criterion that is satisfied when the first set of one or more inputs includes a press input of a second type different from the first type. In some embodiments, a press input of the second type is a hard/full press input, e.g., a detected contact that applies at least the threshold intensity and/or depresses a mechanical input device at least the threshold amount. In some embodiments, the press input of the second type is a long/held press input, where the threshold intensity is maintained (e.g., continuously and/or without dropping below a respective threshold intensity) for over the threshold amount of time (e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s) after initially registering. In some embodiments, a detected contact is maintained (e.g., continues to register) until the contact intensity falls below the hard/full threshold intensity and/or ceases to depress the mechanical input device to at least the threshold amount. In some embodiments, a detected contact is maintained until the contact intensity falls below a lower threshold intensity than the hard/full threshold and/or ceases to depress the mechanical input device to a less-depressed threshold amount. In some embodiments, in accordance with a determination that the first input includes the second type of press input different from the first type of press input, the computer system discards photo media captured in response to detecting the first input. In some embodiments, both the first set of criteria and the second set of criteria include a criterion that is met when the first set of one or more inputs is detected while displaying a camera user interface for capturing media using the one or more cameras.

[0421] At FIG. 9B, while capturing the first video media (914), the computer system detects an end of the first set of one or more inputs (e.g., as described with respect to FIGS. 8G and/or 8L). In some embodiments detecting the end of the first input includes detecting a lift-off of an input element (e.g., a user's finger or a stylus) from the first input device. In some embodiments, detecting the end of the first set of one or more inputs includes detecting the input intensity of the one or more inputs falling below a maintenance threshold intensity and/or ceasing to depress the mechanical input device to at least the threshold amount. In some embodiments, detecting the end of the first set of one or more inputs includes determining that movement of the first set of one or more inputs has not been detected for at least a threshold period of time. In response to detecting the end of the first set of one or more inputs (916) and in accordance with a determination that the first set of one or more inputs included a movement of a first type (918), the computer system continues (920) to capture the first video media after detecting the end of the first set of one or more inputs (e.g., as described with respect to FIGS. 8L-8O) (e.g., if a movement of the first type (e.g., a downwards/leftwards swipe) was detected subsequent to the second type of press input (e.g., a long/held press), the video capture is a persistent capture that continues after the press is released. E.g., a user can lock an initiated video capture using the movement of the first type). In some embodiments, in accordance with a determination that the first input does not include a movement of a first type, the computer system ceases capturing the video media. For example, if a movement of the first type (e.g., a downwards/leftwards swipe) was not detected prior to the release of the press input, the video capture is a temporary capture that stops when the press is released (e.g., as illustrated in FIG. 8G). For example, the user can capture “quick-take” video without locking the initiated video capture with the movement of the first type. In some embodiments, a movement of the first type includes a movement detected after detecting the second type of press input, e.g., the movement of the first type includes a movement detected after the press has been maintained for over the threshold amount of time. In some embodiments, a movement of the first type includes a movement detected prior to detecting the cessation of the first set of one or more inputs. In some embodiments, a movement of the first type includes a movement detected while the first set of one or more inputs includes a detected contact of at least a threshold intensity, e.g., the movement of the first type includes a movement detected while detecting at least the hard/full threshold intensity and/or the maintenance threshold intensity. In some embodiments, a movement of the first type includes a movement component perpendicular to the direction of contact intensity, such as swiping, scrolling, sliding, and/or rotating movements/gestures across, over, and/or around a surface of the first input device. In some embodiments, a movement of the first type includes a movement component of at least a threshold distance/length, e.g., 0.1 mm, 1 mm, 2.5 mm, or 1 cm. In some embodiments, a movement of the first type includes a movement component in a particular direction, e.g., down, up, left, and/or right. In some embodiments, the particular direction is based on the computer system hardware, e.g., away from the location of the cameras and/or towards a respective edge of a device. In some embodiments, the particular direction is based on the orientation of media capture. For example, when capturing in portrait orientation, the first set of one or more inputs includes a movement of the first type if it includes a downwards movement, and when capturing in a landscape orientation, the first set of one or more inputs includes a movement of the first type if it includes a leftwards movement.

[0422] Conditionally performing different types of media captures, and in particular, a photo media capture, a persistent video capture, or a temporary video capture, based on input type and input movement, provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily capture a photo, capture video, end video capture, and/or “lock” the capture of video (e.g., switch to a persistent video capture mode) all via the first input device, without the computer system needing to detect additional inputs, wait for the user to navigate between different user interface elements or input devices (e.g., a hardware button and a touch-sensitive display), and/or display additional dedicated user interface elements for controlling the media capture type. Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using a particular input device and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, blocking the user's view or distracting the user from transient media capture opportunities.

[0423] In some embodiments, the press input of the first type includes a first input portion (e.g., 802 and/or 812), detected (e.g., via the first input device) at a first time, that has an input intensity that exceeds a first threshold intensity (e.g., as described with respect to FIGS. 8A and/or 8M), and a second input portion (e.g., 802′ and/or 812′), detected (e.g., via the first input device) at a second time after the first time, that includes an input intensity that is below the first intensity threshold and is detected while an input element maintains contact with the first input device (e.g., as described with respect to FIGS. 8B and/or 8N). For example, the first threshold intensity corresponds to a press activation threshold (e.g., the intensity at which an input is registered as a press) or a hard/full press threshold. In some embodiments, the first threshold intensity includes a force or pressure threshold, e.g., 75 g/cm³, 100 g/cm³, or 150 g/cm³. In some embodiments, the first threshold intensity includes a threshold mechanical state corresponding to the first threshold intensity, e.g., detecting physical depression of a mechanical button to a “full” press state as a substitute measurement for force/pressure. For example, the computer system captures the first photo media in response to a press and release without fully lifting off of the first input device. For example, the second threshold intensity corresponds to a press release threshold, e.g., the intensity at which the input is no longer registered as a press. In some embodiments, the second threshold intensity includes a force or pressure threshold, e.g., 15 g/cm³, 25 g/cm³, or 36 g/cm³. In some embodiments, the second threshold intensity includes a threshold mechanical state corresponding to the second threshold intensity, e.g., detecting physical depression of a mechanical button as a substitute measurement for force/pressure. In some embodiments, the second time is less than a threshold period of time (e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s) after the first time, e.g., the press input of the first type is a quick press-and-release. Conditionally performing a photo capture in response to a press-and-release input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily capture a photo via the first input device, without the computer system needing to detect additional inputs, wait for the user to navigate between different user interface elements or input devices (e.g., a hardware button and a touch-sensitive display), and/or display additional dedicated user interface elements for controlling the media capture type. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, which can block the user's view of or distract the user from transient media capture opportunities.

[0424] In some embodiments, the press input of the first type includes a respective press input (e.g., 802 and/or 812) with a respective input intensity that falls below a first threshold intensity (e.g., a release threshold, e.g., 15 g/cm³, 25 g/cm³, or 36 g/cm³ and/or a corresponding mechanical state) within a first threshold period of time (e.g., a “quick” press threshold, e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s) after the respective press input is initially detected (e.g., as described with respect to FIGS. 8B and/or 8N). For example, the computer system captures the first photo media in response to a quick press-and-release, e.g., without a full lift-off. In some embodiments, the computer system initially detects the respective press input when an intensity greater than a threshold intensity (e.g., a press activation threshold or a hard/full press threshold, e.g., 75 g/cm³, 100 g/cm³, or 150 g/cm³ and/or a corresponding mechanical state) is detected. For example, a press input of the first type (e.g., a short press input) can follow a prolonged light/partial press as long as the press is quickly released after transitioning into a hard/full press. Conditionally performing a photo capture in response to a quick press-and-release input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily capture a photo via a short press of the first input device, without the computer system needing to detect additional inputs, wait for the user to navigate between different user interface elements or input devices (e.g., a hardware button and a touch-sensitive display), and/or display additional dedicated user interface elements for controlling media capture. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices to select and perform a photo media capture, which can block the user's view of or distract the user from transient media capture opportunities.

[0425] In some embodiments, the press input of the first type includes a respective press input (e.g., 802 and/or 812) that lifts off of the first input device within a second threshold period of time (e.g., a “quick” press threshold, e.g., 0.1 s, 0.6 s, is, or 1.5 s; in some embodiments, the second threshold period of time is the same as the first threshold period of time) after initially detecting the respective press input (e.g., as described with respect to FIGS. 8B and/or 8N). For example, the computer system captures the first photo media in response to a quick press-and-lift. In some embodiments, the computer system initially detects the respective press input when an intensity greater than a second threshold intensity (e.g., a press activation threshold or a hard/full press threshold, e.g., 75 g/cm³, 100 g/cm³, or 150 g/cm³ and/or a corresponding mechanical state) is detected. In some embodiments, the respective press input of the first set of one or more inputs lifts off of the first input device when the respective press input is no longer detected via one or more sensors of the first input device, e.g., intensity sensors, capacitive sensors, and/or mechanical sensors. Conditionally performing a photo capture in response to a quick press-and-lift input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily capture a photo via a short press of the first input device, without the computer system needing to detect additional inputs, wait for the user to navigate between different user interface elements or input devices (e.g., a hardware button and a touch-sensitive display), and/or display additional dedicated user interface elements for controlling media capture. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices to select and perform a photo media capture, which can block the user's view of or distract the user from transient media capture opportunities.

[0426] In some embodiments, the press input of the second type includes a respective press input (e.g., 804 and/or 808) with a respective input intensity that does not fall below a second threshold intensity (e.g., a release threshold e.g., 25 g/cm³, 36 g/cm³, or 50 g/cm³ and/or a corresponding mechanical state) within a third threshold period of time (e.g., a “held” or “long” press threshold, e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s; in some embodiments, the third threshold period of time is the same as the first threshold period of time and/or the second threshold period of time) after initially detecting the respective press input (e.g., as described with respect to FIGS. 8C-8E and/or 8H-8I). For example, the computer system captures the first video media in response to a long/held press, e.g., a press that is not quickly released and/or lifted off. In some embodiments, the computer system initially detects the respective press input when an intensity greater than a second threshold intensity (e.g., a press activation threshold or a hard/full press threshold, e.g., 75 g/cm³, 100 g/cm³, or 150 g/cm³ and/or a corresponding mechanical state) is detected. For example, a light/partial press is not registered as the second type of press (e.g., a held/long press) even if the light/partial press is held for more than the third threshold period of time. Providing video capture in response to a held/long press input where the video capture ends when the input ends unless a movement of the first type is included in the input provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, a user can quickly and easily capture a video of the desired duration simply by holding a press input to initiate capture and releasing the press input to end capture, reducing the need for users to move their hands back and forth between different user interface elements and/or input devices to select, initiate, and/or end a video media capture, which can block the user's view of or distract the user from transient media capture opportunities.

[0427] In some embodiments, the press input of the second type includes a respective press input (e.g., 804 and/or 808) with a respective input intensity that does not fall below a third threshold intensity (e.g., a release threshold, e.g., 25 g/cm³, 36 g/cm³, or 50 g/cm³ and/or a corresponding mechanical state) within a fourth threshold period of time (e.g., a “held” or “long” press threshold, e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s; in some embodiments, the third threshold period of time is the same as the first threshold period of time and/or the second threshold period of time) after initially detecting the respective press input (e.g., as described with respect to FIGS. 8C-8E and/or 8H-8I). For example, the computer system captures the first video media in response to a long/held press, e.g., a press that is not quickly released and/or lifted off. In some embodiments, the computer system initially detects the respective press input when an intensity greater than a second threshold intensity (e.g., a press activation threshold or a hard/full press threshold, e.g., 75 g/cm³, 100 g/cm³, or 150 g/cm³ and/or a corresponding mechanical state) is detected. For example, a light/partial press is not registered as the second type of press (e.g., a held/long press) even if the light/partial press is held for more than the fourth threshold period of time. In some embodiments, the movement of the first type includes a respective movement (e.g., 808A, 808B, and/or 810) (e.g., a swipe, drag, scroll, slide, and/or other gesture) detected (e.g., via the first input device) more than the fourth threshold period of time after initially detecting the respective press input (e.g., as described with respect to FIGS. 8J-8K). For example, the computer system continues to capture the first video media after detecting the end of the first set of one or more inputs if movement is detected after to the respective press input resolves into a held/long press. For example, while capturing video in response to a held/long press of the first input device, the user swipes the first input device to lock the capture. In some embodiments, the respective movement is detected before the input intensity falls below the third threshold intensity and/or before detecting the end of the first set of one or more inputs. Providing persistent video capture in response to a held/long press input with subsequent movement provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, after initiating a video capture with a held/long press of the first input device, the user can easily lock the video capture (e.g., to continue capturing without holding the first input device) via a swipe (e.g., or other movement) of the first input device, without inadvertently ending the video capture.

[0428] In some embodiments, the first input device includes a first hardware element (e.g., 602A, 602B, 602C, and/or 602D) (e.g., hardware button or physically differentiated input region). For example, the first hardware element includes at least one hardware button (e.g., mechanical and/or solid-state buttons) that includes a touch-sensitive surface (e.g., touch and/or proximity sensors; e.g., capacitive sensors). In some embodiments, the first hardware element is distinct from a touch-sensitive surface of the display generation component, e.g., a button or touch-sensitive surface separate from a touch-sensitive display. In some embodiments, the movement of the first type includes a movement in a first direction across a first surface of the first hardware element (e.g., 808A and/or 808B) (e.g., hardware button or physically differentiated input region). For example, the movement of the first type (e.g., the movement used to lock the video capture) includes a swipe, drag, and/or other gesture performed on the surface of the first hardware element. In some embodiments, the first surface of the first hardware element is a top surface of the first hardware element, e.g., the surface that the user presses into when pressing the button, e.g., the movement in the first direction is a movement perpendicular to the direction of a press. In some embodiments, the computer system displays an indication of the first direction, e.g., displaying an arrow near the location of the first hardware element pointing in the first direction. In some embodiments, the first direction is defined with respect to the computer system hardware, e.g., a swipe moving in a direction away from the one or more cameras. In some embodiments, the first direction is defined with respect to a current orientation of the device, e.g., downwards while in a portrait orientation and/or to the right while in a landscape orientation. In some embodiments, the movement of the first type does not include a movement in a direction different from the first direction across the first surface of the first hardware element. Conditionally performing temporary or persistent video capture based on whether a movement across a hardware input element is detected provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using the hardware element (e.g., allowing different mappings for inputs with movements vs. inputs without) and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, which can block the user's view, distract the user from transient media capture opportunities, or risk accidentally ending a temporary video capture.

[0429] In some embodiments, the first input device includes a touch-sensitive surface of the display generation component (e.g., 606). In some embodiments, the movement of the first type includes a movement in a second direction (in some embodiments, the second direction is the same as the first direction, e.g., corresponding movements are used to lock capture via the touch-sensitive surface and the hardware element) across the touch-sensitive surface of the display generation component (e.g., 810). For example, the movement of the first type (e.g., the movement used to lock the video capture) includes a swipe, drag, and/or other gesture performed on the touch-sensitive surface. In some embodiments, the computer system displays an indication of the second direction, e.g., displaying an arrow pointing in the second direction. In some embodiments, the movement in the second direction is directed to the displayed indication on the touch-sensitive surface, e.g., the user swipes or drags across the indication to lock the capture. In some embodiments, the second direction is defined with respect to the computer system hardware, e.g., a swipe moving in a direction away from the one or more cameras. In some embodiments, the second direction is defined with respect to a current orientation of the device, e.g., downwards while in a portrait orientation and/or to the right while in a landscape orientation. In some embodiments, the movement of the first type does not include a movement in a direction different from the second direction across the first touch-sensitive surface. Conditionally performing temporary or persistent video capture based on whether a particular movement across a touch-sensitive surface is detected assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using the touch-sensitive surface (e.g., allowing different mappings for inputs with movements vs. inputs without).

[0430] In some embodiments, while capturing the first video media and prior to detecting the end of the first set of one or more inputs (e.g., as illustrated in FIGS. 8E-8F and/or 8I-8K) (and, In some embodiments, prior to detecting the movement of the first type and/or locking the video capture), the computer system displays, via the display generation component, a graphical indicator (e.g., 806) prompting the movement of the first type. In some embodiments, the graphical indicator indicates a direction and/or a magnitude of the movement of the first type, e.g., an arrow, text, and/or a slider indicating which way and how far the input need to move to lock the video capture. In some embodiments, the graphical indicator includes a selectable graphical user interface object (e.g., a touch control, such as a slider), where a movement of the first type directed to the selectable graphical user interface object via a touch-sensitive surface of the display locks the video capture. In some embodiments, the graphical indicator is displayed near a hardware input element. For example, the computer system displays the graphical indicator at the edge of the display near a hardware button, indicating the direction and distance of movement the user needs to provide via the hardware button to lock the video capture. Displaying an indicator prompting the movement of the first type provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the displayed indicator both indicates that the video capture is currently in a temporary state and indicates how to put the video capture into a persistent state.

[0431] In some embodiments, the first input device includes a second hardware element (in some embodiments, the second hardware element is the same as the first hardware element) located outside of a display region of the display generation component (e.g., 602A, 602B, 602C, and/or 602D). For example, the second hardware element includes at least one hardware button (e.g., mechanical and/or solid-state buttons) that includes a touch-sensitive surface (e.g., touch and/or proximity sensors; e.g., capacitive sensors). In some embodiments, the second hardware element is located on a side or edge of the computer system outside of the display. In some embodiments, the graphical indicator (e.g., 806) prompting the movement of the first type is displayed proximate to the second hardware element within the display region of the display generation component (e.g., as illustrated in FIGS. 8E-8F and/or 8I-8K). For example, the computer system displays graphical indicator at the edge of the display closest to the second hardware element. Displaying an indicator prompting the movement of the first type near a hardware input device that can be used to detect the movement of the first type provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the displayed indicator both indicates that the video capture is currently in a temporary state and indicates how to put the video capture into a persistent state using the hardware input device, including indicating to the user that video capture can be locked without moving their finger from the hardware input device.

[0432] In some embodiments, the graphical indicator prompting the movement of the first type includes a first indication of a respective direction of the movement of the first type (e.g., as illustrated in FIGS. 8E-8F and/or 8I-8K). For example, the graphical indicator includes an arrow, text, and/or a slider element showing the direction of movement needed to lock the video capture. Displaying an indicator prompting movement in a respective direction provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the displayed indicator both indicates that the video capture is currently in a temporary state and indicates how to put the video capture into a persistent state.

[0433] In some embodiments, movement of at least a first threshold magnitude is required to continuing to capture the first video media after detecting the end of the first set of one or more inputs (e.g., as described with respect to FIGS. 8J-8K) (e.g., a threshold overall distance moved in a respective direction). In some embodiments, the first distance is a predetermined distance, e.g., a swipe or drag of at least half the length of the hardware button is used to lock video capture. In some embodiments, the first distance is a dynamic distance, e.g., a swipe or drag from the initial contact position to or past a terminus, such as the edge of the hardware button or the graphical indication, is used to lock video capture. In some embodiments, while displaying the graphical indicator prompting the movement of the first type, the computer system detects a first movement input of the first set of one or more inputs, wherein the first movement input is a movement of a second magnitude that is less than the first threshold magnitude (e.g., 804, 807, and/or 808A) (e.g., a second distance moved along an axis of the respective direction). In some embodiments, the second magnitude is a negative magnitude, e.g., the first movement input moves opposite the respective direction. In some embodiments, in response to detecting the first movement input of the first set of one or more inputs, the computer system updates the graphical indicator (e.g., 806) prompting the movement of the first type to indicate how much additional movement is needed to get to the first threshold magnitude of movement (e.g., as illustrated in FIGS. 8F and/or 8J). For example, the computer system updates the graphical indicator to show progress towards the threshold to lock the video capture. For example, the computer system displays a slider with a track/path of a length corresponding to the first magnitude, that moves to track input movement along the axis of the respective direction, moving the slider closer to a “goal” end of the track in response to movement in the respective direction and moving the slider away from the goal end of the track in response to movement opposite the respective direction. In some embodiments, updating the graphical indicator includes changing an appearance of the graphical indicator based on how much additional movement is needed to get to the first threshold magnitude of movement. For example, in accordance with a determination that a particular amount of additional movement is still needed, the computer system may display the graphical indicator with a first appearance, and in accordance with a determination that a different amount of additional movement is still needed, the computer system may display the graphical indicator with a second, different appearance. For example, for a graphical indicator including a lock icon that moves along with the input movement, the computer system may display the lock icon growing, shrinking, changing in opacity, changing in color, and/or morphing into a different shape as it moves closer to the lock threshold. Displaying an indicator that updates to indicate how much movement is still required to lock video capture provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, updating the displayed indicator both indicates that the video capture remains in a temporary state and indicates how to put the video capture into a persistent state.

[0434] In some embodiments, while displaying the graphical indicator prompting the movement of the first type, the computer system detects a second movement input (in some embodiments, the second movement input is the same as the first movement input) of the first set of one or more inputs (e.g., 804, 807, 808A, 808B, and/or 810), and, in response to detecting the second movement input and in accordance with a determination that the second movement input includes movement of at least the first threshold magnitude (e.g., the movement needed to lock the video capture), the computer system ceases displaying the graphical indicator (e.g., as described with respect to FIG. 8L). For example, when the input has moved at least a threshold distance in a respective direction (e.g., as indicated by the graphical indicator), the graphical indicator disappears, indicating that the video capture has been placed in a persistent capture state. Ceasing displaying an indicator prompting the first type of movement after the first type movement has been detected provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, ceasing displaying the indicator indicates that the provided inputs have placed the video capture into a persistent state and thus that the user can end the set of one or more inputs (e.g., stopping movement and/or lifting off) without ending the video capture.

[0435] In some embodiments, the press input of the second type includes a press input (e.g., 804 and/or 808) (in some embodiments, of at least a first threshold intensity, e.g., a hard/full press threshold; e.g., 100 g/cm³, 150 g/cm³, or 200 g/cm³) maintained (e.g., held continuously and/or without dropping below a maintenance threshold intensity, e.g., 90 g/cm³, 140 g/cm³, or 190 g/cm³) for at least a first threshold period of time (e.g., as described with respect to FIGS. 8E and/or 8I) (e.g., 0.1 s, 0.6 s, 1 s, or 1.5 s). In some embodiments, at a first time prior to capturing the first video media, the computer system detects (e.g., initially detecting) a first press input (in some embodiments, of at least the first threshold intensity) of the first set of one or more inputs (e.g., 804 and/or 808), and, while detecting the first press input (e.g., while the first press input is maintained, e.g., with at least the second and/or first threshold intensity) and less than the first threshold period of time after the first time (e.g., before the first input qualifies as a press input of the second type; e.g., before capturing the first video media), the computer system changes an appearance of a media capture user interface (e.g., 612) (e.g., a camera UI) from a first appearance state (e.g., an initial state; in some embodiments, a photo capture mode appearance of the media capture user interface, e.g., for a standard or portrait photo capture mode) to a second appearance state (e.g., as described with respect to FIG. 8D) (e.g., an intermediate appearance between the initial appearance and a video capture mode appearance of the media capture user interface, e.g., for a standard or cinematic video capture mode). In some embodiments, the computer system gradually transitions the appearance of the capture user interface between the first appearance state and a third appearance state (e.g., a video capture mode appearance) as the first press input is held. In some embodiments, after the first press input is held for at least the first threshold period of time, the computer system changes the appearance of the media capture user interface from the second appearance state to the third appearance state, e.g., completing the transition to the video capture mode appearance. Changing the appearance of a media capture interface as a press input is held provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls, and additionally reduces latency in transitioning the media capture user interface between photo and video capture modes. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, beginning to change the appearance of the media capture user interface from a photo capture appearance to a video capture appearance while a press input is being held indicates that continuing to hold the input will initiate a video capture.

[0436] In some embodiments, while displaying the media capture user interface in the second appearance state (e.g., as described with respect to FIG. 8D) (in some embodiments, less than the first threshold period of time after the first time, In some embodiments, before beginning to capture the first video media), the computer system detects an end of the first press input. In some embodiments, detecting the end of the first press input includes detecting that an intensity of the first press input has fallen below a maintenance threshold intensity, e.g., the first press is no longer a full/hard press. In some embodiments, detecting the end of the first press input includes detecting that the first press input has lifted off of the first input device. In some embodiments, in response to detecting the end of the first press input, the computer system changes the appearance of the media capture user interface from the second appearance state to the first appearance state (e.g., as described with respect to FIG. 8A). For example, if the press input ends before the first threshold period of time/before capturing the first video media is initiated, the computer system reverts the changes made to the camera UI while the press input was being maintained, e.g., returning the appearance of the camera UI to the photo capture mode appearance. Reverting changes the appearance of a media capture interface when a press input is released before initiating video capture provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, reverting changes the appearance of the media capture user interface back to a photo capture appearance indicates when the press input is no longer qualifying to initiate a video capture.

[0437] In some embodiments, changing the appearance of the media capture user interface from the first appearance state to the second appearance state includes displaying (e.g., animating) a capture mode selection user interface element (e.g., 612A) of the media capture user interface (e.g., a capture mode menu, slider, and/or other affordance) transitioning from a photo capture mode to a video capture mode (e.g., as described with respect to FIG. 8D). For example, the computer system animates the capture mode selection user interface element moving from a photo capture mode menu item to a video capture mode menu item, e.g., shifting the menu, reducing the visual emphasis of a photo capture mode menu item, and/or increasing the visual emphasis of a video capture mode menu item. Changing the appearance of a capture mode selection element as a press input is held provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls, and additionally reduces latency in transitioning the media capture user interface between photo and video capture modes. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, showing the capture mode selection transitioning between photo capture and video capture while a press input is being held indicates that continuing to hold the input will initiate a video capture.

[0438] In some embodiments, changing the appearance of the media capture user interface from the first appearance state to the second appearance state includes displaying (e.g., animating) a media capture user interface element (e.g., 612C) of the media capture user interface (e.g., a software button that can be selected to initiate and/or end media capture) changing (e.g., morphing) from a photo capture user interface element to a video capture user interface element (e.g., as described with respect to FIG. 8D). For example, the computer system animates a software capture button morphing from a photo capture shutter button (e.g., an affordance that can be selected to capture photo media) into a video recording button (e.g., an affordance that can be selected to stop capturing the first video media). Changing the appearance of a media capture affordance as a press input is held provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls, and additionally reduces latency in transitioning the media capture user interface between photo and video capture modes. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, showing the media capture affordance morphing from a photo capture button into a video recording button while a press input is being held indicates that continuing to hold the input will initiate a video capture.

[0439] In some embodiments, changing the appearance of the media capture user interface from the first appearance state to the second appearance state includes displaying an aspect ratio of a media capture preview (e.g., 614) of the media capture user interface (e.g., a camera viewfinder region including the portion of the current field-of-view of the one or more captures that will be included in a media capture) changing (e.g., growing and/or shrinking in one or more dimensions) from a first aspect ratio (e.g., a photo capture aspect ratio, e.g., 4:3, 1:1, and/or 16:9) to a second aspect ratio (e.g., as described with respect to FIG. 8D) (e.g., a video capture aspect ratio, e.g., 16:9, 4:3, and/or 1:1). Changing the aspect ratio of a media capture preview as a press input is held provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls, and additionally reduces latency in transitioning the media capture user interface between photo and video capture modes. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed and/or captured with unintended settings, which enhances the operability and ergonomics of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, beginning to change the aspect ratio of the camera preview while a press input is being held both indicates that continuing to hold the input will initiate a video capture and previews the framing (e.g., the aspect ratio and what is included within the frame from the field-of-view of the one or more cameras) of the video capture that will be initiated, allowing the user to adjust framing as desired before the video capture begins.

[0440] In some embodiments, in accordance with a determination that the first set of one or more inputs is detected while a first photo media capture mode is selected (e.g., as described with respect to FIGS. 8A and/or 8C), capturing the first photo media includes capturing the first photo media in the first photo media capture mode (e.g., as described with respect to FIGS. 8A-8B), and capturing the first video media includes capturing the first video media in a first video media capture mode (e.g., as described with respect to FIGS. 8E-8F). In some embodiments, the first video media capture mode corresponds to the first photo media capture mode, e.g., the first photo media capture mode is a standard photo mode, without applied simulated depth-of-field effects, and the video media capture mode is a standard video mode, also without applied simulated depth-of-field effects. In some embodiments, in accordance with a determination that the first set of one or more inputs is detected while a second photo media capture mode, different from the first photo media capture mode, is selected (e.g., as described with respect to FIG. 8H), capturing the first photo media includes capturing the first photo media in the second photo media capture mode (e.g., as described with respect to FIGS. 8M-8N), and capturing the first video media includes capturing the first video media in a second video media capture mode, different from the first video media capture mode (e.g., as described with respect to FIGS. 8J-8O). In some embodiments, the second video media capture mode corresponds to the second photo media capture mode, e.g., the second photo media capture mode is a portrait photo mode, with applied simulated depth-of-field effects, and the second video media capture mode is a cinematic video capture, also with applied simulated depth-of-field effects. In some embodiments, capturing media (photo or video) with simulated depth-of-field effects includes capturing depth information. In some embodiments, after capturing media (photo or video) with simulated depth-of-field effects, the simulated depth-of-field effects can be enabled, disabled, and/or adjusted (e.g., to change which regions/subjects in the media appear in focus). Conditionally performing different types of video captures in response to the second type of press input based on the current photo capture mode when the second type of press input is detected provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, performing different types of video captures based on the current photo capture mode increases the range of functionality available via the first input device/the second type of press input and reduces the number of inputs needed to change capture mode (e.g., the user only needs to change between photo capture modes, and does not need to also change between video capture modes).

[0441] In some embodiments, capturing the first photo media in the first photo media capture mode includes capturing the first photo media with a set of one or more standard photo settings (e.g., as described with respect to FIGS. 8A-8B) (e.g., a standard resolution, a standard aspect ratio, and/or without applying simulated capture effects, such as simulated depth-of-field effects and/or simulated lighting effects), and capturing the first video media in the first video media capture mode includes capturing the first video media with a set of one or more standard video settings (e.g., as described with respect to FIGS. 8E-8F) (e.g., a standard resolution, a standard aspect ratio, a standard frame rate, and/or without applying simulated capture effects). In some embodiments, the set of one or more standard photo settings and the set of one or more standard video settings have one or more overlapping (e.g., shared) and/or corresponding settings, e.g., both capture without applying simulated capture effects. Performing a standard video capture in response to the second type of press input when in a standard photo capture mode provides improved control of media capture and improved feedback on a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, while enabling the user to switch between corresponding standard photo capture and standard video capture using different types of press inputs, the computer system provides a zero-latency preview of capture settings shared between the standard photo capture mode and standard video capture.

[0442] In some embodiments, capturing the first photo media in the second photo media capture mode includes capturing the first photo media with a set of one or more portrait photo settings, wherein the set of one or more portrait photo settings includes applying simulated depth-of-field to the first photo media (e.g., as described with respect to FIGS. 8M-8N), and capturing the first video media in the second video media capture mode includes capturing the first video media with a set of one or more cinematic video settings, wherein the set of one or more portrait video settings includes applying the simulated depth-of-field effects to the first video media (e.g., as described with respect to FIGS. 8J-8O). In some embodiments, applying the simulated depth-of-field effects includes simulating capture with a particular focal length (f-stop) by selectively blurring portions of a media capture that would not be in focus (e.g., would be outside of the depth-of-field) when captured using a lens with the particular focal length. In some embodiments, while the second photo media capture mode is selected and/or while capturing the first video media in the second video media capture mode, the computer system applies the simulated depth-of-field effects to a preview of the media capture (e.g., a camera viewfinder displaying at least a portion of the field-of-view of the one or more cameras). In some embodiments, the set of one or more cinematic video settings includes one or more settings differing from the one or more standard video settings, such as a higher resolution and/or a higher frame rate. Performing a cinematic video capture in response to the second type of press input when in a portrait photo capture mode provides improved control of media capture and improved feedback on a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, while enabling the user to switch between corresponding portrait photo capture and cinematic video capture using different types of press inputs, the computer system also provides a zero-latency preview of the simulated depth-of-field effects shared between the corresponding photo and video modes.

[0443] In some embodiments, the computer system detects, via the first input device, a second set of one or more inputs directed to the first input device, and in response to detecting the second set of one or more inputs and in accordance with a determination that the second set of one or more inputs satisfies a set of launch criteria, displaying, via the display generation component, a respective camera user interface (e.g., 612 and/or 1046) (in some embodiments, launching (e.g., opening and/or displaying) a camera application or user interface; in some embodiments, a camera application/UI included in a set of available camera user interfaces; in some embodiments, a default camera application/UI), wherein the set of launch criteria includes a criterion that is satisfied when a first input element is activated (in some embodiments, the first input element is activated based on an input intensity exceeding a particular intensity threshold) while the computer system is not displaying, via the display generation component, a camera user interface (e.g., as described with respect to FIGS. 6D-6E and/or 10A-10B) (e.g., a user interface for media capture, such as a camera application or a social media application with camera functionality; in some embodiments, any camera user interface included in a set of available camera user interfaces). In some embodiments, the first set of criteria and the second set of criteria both include a criterion that is met when a camera user interface is displayed when detecting the press input. For example, while the camera user interface is not open or displayed, the computer system launches the camera user interface in response to press inputs, and while the camera user interface is displayed, the computer system captures media (e.g., photo or video media) in response press inputs. For example, the computer system displays, surfaces, and/or launches a camera interface in response to press inputs detected while the camera interface is not already displayed, active, and/or running. In some embodiments, the computer system will open a particular camera application if the particular camera application is not already open. In some embodiments, the computer system will open the particular camera application unless any camera application is already open. In some embodiments, the set of launch criteria includes a criterion that is satisfied when the first input element is activated while the computer system is displaying a non-camera user interface (e.g., a home screen, a lock screen, a UI for an application that does not include a camera UI, and/or a non-camera UI for an application that does include a camera UI). Launching a camera user interface in response to press inputs detected while the camera user interface is not displayed provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can launch the camera user interface then quickly capture media in the camera user interface via press inputs of the first input device, without needing to move their hands and/or change input mode.

[0444] In some embodiments, while capturing the first video media, the computer system detects, via the first input device, a first movement input of the first set of one or more inputs, wherein the first movement input is a movement of the first type (e.g., 808A and 808B) (e.g., the first movement input locks the ongoing video capture, e.g., making the video capture a persistent video capture), and, after detecting the first movement input of the first set of one or more inputs (e.g., while the video capture is locked/persistent), the computer system detects, via the first input device, a first press input (e.g., 812) (in some embodiments, a full/hard press); in some embodiments, the first press input is detected after the end of the first set of one or more inputs. In some embodiments, the first press input is a full/hard press followed by a lift-off from the first input device. In some embodiments, the first press input is a full/hard press without subsequent lift-off from the first input device. In some embodiments, in response to detecting the first press input (in some embodiments, and in accordance with a determination that the first press input satisfies capture criteria), the computer system captures, via the one or more cameras, second photo media (e.g., as described with respect to FIGS. 8M-8N). Capturing photo media in response to press inputs detected while capturing video in a persistent capture mode provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, via press and movement inputs on the first input device, the user can initiate and lock the video capture, then quickly capture photo media during the video capture, without needing to move their hands and/or change input mode.

[0445] In some embodiments, while capturing the first video media, the computer system detects, via the first input device, a second movement input of the first set of one or more inputs, wherein the second movement input is a movement of the first type (e.g., 808A and 808B) (e.g., the first movement input locks the ongoing video capture, e.g., making the video capture a persistent video capture), and, after detecting the second movement input of the first set of one or more inputs (e.g., while the video capture is locked/persistent), the computer system detects, via the first input device, a second press input (e.g., 816) (in some embodiments, a full/hard press). In some embodiments, the first press input is detected after the end of the first set of one or more inputs. In some embodiments, the first press input is a full/hard press followed by a lift-off from the first input device. In some embodiments, the first press input is a full/hard press without subsequent lift-off from the first input device. In some embodiments, in response to detecting the second press input (in some embodiments, and in accordance with a determination that the first press input satisfies video control criteria), the computer system ceases capturing the first video media (e.g., as described with respect to FIGS. 8O-8P). Stopping a persistent video capture in response to press inputs detected after locking the video capture provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, via press and movement inputs on the first input device, the user can initiate, lock, and stop the video capture without needing to move their hands and/or change input mode.

[0446] Note that details of the processes described above with respect to method 900 (e.g., FIGS. 9A-9B) are also applicable in an analogous manner to the methods described above and below. For example, media capture controls based on variable characteristics of hardware inputs as described with respect to method 900 can be used along with the controls described with respect to method 700, the customizable functions as described with respect to method 1100, and/or the settings adjustments described with respect to method 1500, and may be used to capture media for playback as described with respect to method 1300. For brevity, these details are not repeated below.

[0447] FIGS. 10A-10U illustrate example techniques and systems for customizing and controlling operations of a computer system using hardware inputs in accordance with some embodiments. For example, FIGS. 10A-10U illustrate using a swipe input to open a menu for selecting between a zoom function, an exposure function, and a synthetic depth-of-field function to associate with the hardware button, where the computer system adjusts the function currently associated with the hardware button in response to inputs via the hardware button, e.g., as described with respect to FIGS. 6A-6AI.

[0448] FIGS. 10A-10B illustrate using a press of first button 602A to launch a camera user interface from a non-camera context, as also discussed with respect to FIGS. 6D-6E. As illustrated in FIG. 10A, computer system 600 displays user interface 610 for a media player application. Although user interface 610 includes a displayed representation of media (e.g., a television show), user interface 610 for the media player application is not a media capture user interface, e.g., a camera utility or application for capturing media content with the set of cameras and/or other sensors of computer system 600. Accordingly, while displaying user interface 610 for a media player application, computer system detects input 1002, a press input of first button 602A, and in response, at FIG. 10B, computer system launches camera user interface 612, which is a media capture user interface for a first-party camera application of computer system 600. In some embodiments, input 1002 is a particular type of input, such as a hard/full press placing first button 602A into hardware button state (E) or a light/partial press placing first button 602A into hardware button state (D).

[0449] In some embodiments, camera user interface 612 is associated with first button 602A when input 1002 is detected. For example, camera user interface 612 may be associated with first button 602A by default, or a user may select to associate camera user interface 612 with first button 602A via the settings of computer system 600 in order to launch camera user interface 612 in response to presses of first button 602A while a media capture user interface is not being displayed. In some embodiments, camera user interface 612 is one of a plurality of media capture user interfaces that can be associated with first button 602A, and the user may select a different camera user interface, such as camera user interface 612 described below, to launch in response to presses of first button 602A while a media capture user interface is not being displayed.

[0450] As illustrated in FIG. 10B, while displaying camera user interface 612 and, in some embodiments, while displaying settings control 622 for controlling a setting of camera user interface 612 (e.g., as described with respect to FIGS. 6E-6AM, above), computer system 600 detects input 1004 via the touch-sensitive surface of display 606. Input 1004 is a gesture originating near the location of first button 602A (e.g., off, at, or near the edge of display 606 adjacent to first button 602A) and moving substantially towards the center of display 606, e.g., swiping inwards from first button 602A. In some embodiments, input 1004 is a swipe inwards across settings control 622. As described in further detail with respect to FIGS. 18J-18K, in some embodiments, in response to detecting a contact on first button 602A (e.g., finger 608 resting on the surface of first button 602A without pressing down and/or moving more than a threshold amount) that lasts for at least a threshold duration (e.g., 0.1, 0.2, 0.25, 0.5, 1, 3, or 5 s), system 600 displays an indicator near first button 602A to indicate that a swipe input, such as input 1004, can be used to display customization menu 1006 as described below.

[0451] In response to detecting input 1004, at FIG. 10C, computer system 600 displays customization menu 1006. Customization menu 1006 provides options of operations that can be associated with first button 602A in camera user interface 612 to control using first button 602A and/or settings control 622 as described above with respect to FIGS. 6E-6AM. As illustrated in FIG. 10C, customization menu 1006 is displayed as a cut-out (e.g., a platter or tab) from camera user interface 612 (e.g., blocking out a portion of camera user interface 612 and/or overlaying settings control 622) adjacent to first button 602A, which includes menu items with icons corresponding to the operations available to associate with first button 602A. In some embodiments (e.g., as illustrated in FIGS. 18L-18M), customization menu 1006 is displayed with an appearance that simulates a curved, rotatable dial, such as described with respect to FIG. 6J1. For example, computer system 600 gradually blurs, darkens, fades, and/or distorts the icons at the edges of customization menu 1006 to create the appearance of a three-dimensional curve.

[0452] In particular, going from left to right, the icons correspond to a zoom setting (e.g., as described with respect to FIGS. 6J-6AD), an exposure setting (e.g., for controlling an exposure length of capture and/or a brightness level), a simulated depth-of-field setting (e.g., as described with respect to FIGS. 6AE-6AF), a focus setting (e.g., as described with respect to FIGS. 6AG-6AH), a filter setting (e.g., as described with respect to FIGS. 6AI-6AK), and a capture guidance setting (e.g., for controlling guidance elements such as a capture grid and/or level indicator). In some embodiments, customization menu 1006 includes an option for a camera selection setting, as described in further detail with respect to FIGS. 18A-18T. As further described with respect to FIG. 10T1, in some embodiments, the set of options provided in customization menu 1006 depends on the application and/or user interface in which customization menu 1006 is opened. For example, opening customization menu 1006 in camera user interface 612 provides the options illustrated in FIG. 10C, and opening customization menu 1006 in a different user interface (e.g., a home screen, a lock screen, a different application, and/or a different camera user interface) provides more, fewer, and/or different options than illustrated in FIG. 10C. While displaying customization menu 1006, computer system 600 deemphasizes (e.g., increases transparency of and/or grays out) other elements of camera user interface 612, including settings control 622.

[0453] Alternatively, as illustrated in FIG. 10D, customization menu 1006 is displayed as a pull-out menu emerging from first button 602A, including menu items with icons and text corresponding to the available operations, and a full-screen overlay dimming out camera user interface 612 behind the menu items while displaying customization menu 1006. As illustrated in both FIGS. 10C and 10D, when input 1004 is detected, the zoom setting of camera user interface 612 is associated with first button 602A, indicated by the icon corresponding to the zoom setting being emphasized (e.g., highlighted, framed, and/or otherwise increased in prominence) compared to the other icons or menu items in customization menu 1006.

[0454] While displaying customization menu 1006, computer system 600 detects input 1008 directed to customization menu 1006 via the touch-sensitive surface of display 606. Input 1008 selects the menu item corresponding to the exposure setting of camera user interface 612 to associate the exposure setting with first button 602A. For example, input 1008 may include a tap, touch, or press directed to the location of menu item within customization menu 1006, and/or a movement input (e.g., a swipe or flick) across customization menu 1006 to scroll or drag the exposure menu item into a “selected” position (e.g., at the top or center of customization menu 1006) and/or drag the highlighting/selection frame from the zoom menu item onto the exposure menu item. In some embodiments, input 1008 may include inputs provided via first button 602A, such as swipes, flicks, taps, or presses on the surface of first button 602A. For example, repeated light/partial presses of first button 602A cycle through selecting each of the options in customization menu 1006.

[0455] In response to detecting input 1008, computer system 600 associates the exposure setting of camera user interface 612 with first button 602A. After camera system 600 associates the exposure setting of camera user interface 612 with first button 602A, at FIG. 10E, computer system 600 closes customization menu 1006. In some embodiments, computer system 600 closes customization menu 1006 in response to input 1008 (e.g., an input selecting a new operation to associate with first button 602A) and/or in response to a separate input for closing customization menu 1006, such as a touch input outside of the region of customization menu 1006 and/or a swipe back up across customization menu 1006 (e.g., similar to touch inputs 626A and 626B for dismissing settings control 622, described with respect to FIG. 6T). In some embodiments, as illustrated in FIG. 10E, when computer system 600 stops displaying customization menu 1006, computer system 600 displays customization indicator 1010, including the exposure setting icon, near first button 602A, indicating that the setting associated with first button 602A has been successfully changed. Additionally, in some embodiments, computer system 600 returns the appearance of camera user interface 612 to its default state (e.g., returning the other user interface elements to their standard prominence and/or removing the overlay) and/or stops displaying settings control 622 (e.g., if settings control 622 was displayed when input 1004 was detected). As further described with respect to FIGS. 18M-18P, in some embodiments, computer system 600 closes customization menu 1006 in response to an input swiping outwards (e.g., toward an edge of the device) across customization menu 1006 (e.g., opposite to input 1004). As further described with respect to FIGS. 18M-18P, in some embodiments, in response to the input swiping outwards across customization menu 1006, computer system 600 replaces customization menu 1006 with settings control 622, configured to control the currently-selected setting.

[0456] After computer system 600 associates the exposure setting of camera user interface 612 with first button 602A, at FIG. 10F, computer system 600 detects input 1012, a light/partial press of first button 602A, and in response (e.g., as described with respect to FIGS. 6E-6J), displays settings control 622 for the exposure setting of camera user interface 612. As illustrated in FIG. 10F, settings control 622 for the exposure setting includes text indicating the current exposure value (“0.0”), an icon representing the exposure setting, and a representation of an exposure scale. In particular, the representation of the exposure scale includes a plurality of tick marks representing ordered exposure values in intervals of 0.1, with lower exposure values (e.g., −1.0) are displayed closer to the set of cameras and higher exposure values (e.g., +1.0) are displayed further from the set of cameras. For example, the exposure setting controls media capture brightness, for instance, by simulating different camera shutter speeds, aperture sizes, and/or ISO speeds, where higher exposure setting values correspond to brighter captures (e.g., slower shutter speeds, slower ISO speeds, and/or larger aperture sizes) and lower exposure setting values correspond to darker captures (e.g., faster shutter speeds, faster ISO speeds, and/or smaller aperture sizes).

[0457] At FIG. 10G, while displaying settings control 622 for the exposure setting of camera user interface 612, computer system 600 detects a right-to-left movement input (e.g., moving towards the set of cameras) such as movement input 1014 directed to first button 602A and/or touch input 1016 directed to settings control 622 on the touch-sensitive surface of display 606, which may include swipe/drag movements, flick movements, and/or directional tap inputs. As illustrated in FIG. 10G, in response to movement input 1014 and/or touch input 1016, computer system 600 adjusts the exposure setting of camera user interface 612 to an exposure value of +0.7 (e.g., a longer exposure setting for media capture). At the exposure value of +0.7, computer system 600 displays camera preview 614 with increased brightness, represented in FIG. 10G by the lightly dashed lines of the field-of-view of the environment. In some embodiments, the adjustment to the exposure setting of camera user interface 612, and likewise the update of settings control 622 and/or camera user interface 612, based on movement input 1014 and/or touch input 1016 is performed as described with respect to FIGS. 6J-6AM and 7.

[0458] After the exposure setting of camera user interface 612 is adjusted via settings control 622, the exposure setting remains set to a value of +0.7 after computer system 600 ceases display of settings control 622 for the exposure setting (e.g., after a threshold period of time without further inputs and/or in response to an input dismissing settings control 622, as described with respect to FIG. 6T), as illustrated by camera preview 614 in FIG. 10H remaining at the increased brightness level.

[0459] At FIG. 10H, computer system 600 detects an input requesting to capture media, such as press input 1018 directed to first button 602A (e.g., as described with respect to FIGS. 6U-6V and/or FIGS. 8A-8P) and/or touch input 1020 directed to shutter affordance 612C. In response to press input 1018 and/or touch input 1020, computer system 600 captures media with an exposure level of +0.7, the exposure level selected via settings control 622. As illustrated in FIG. 10I, computer system 600 updates captured media icon 612D to display a thumbnail of the media captured with the selected settings, represented in FIG. 10I by the dashed lines of the thumbnail.

[0460] At FIG. 10J, the exposure setting of camera user interface 612 remains associated with first button 602A, and accordingly, in response to detecting movement input 1022 and/or touch input 1024 (e.g., swipe/drag, flick, and/or directional tap inputs) while displaying settings control 622 for the exposure setting of camera user interface 612 (e.g., in response to a light/partial press and/or full swipe of first button 602A), computer system 600 again adjusts the exposure setting. As illustrated in FIG. 10J, based on the left-to-right movement of movement input 1022 and/or touch input 1024, computer system 600 reduces the exposure value to +0.2, decreasing the brightness of camera preview 614, represented in FIG. 10J by the darker dashed lines of the field-of-view of the environment (e.g., media capture is reduced in brightness compared to at FIGS. 10G-10H, but remains brighter than at FIGS. 10B-10F).

[0461] At FIG. 10K, at a later time, the exposure setting of camera user interface 612 remains associated with first button 602A and the exposure value remains set to +0.2 (e.g., computer system 600 maintains the custom operation selected via customization menu 1006 and the settings value selected via settings control 622 until new selections are made). While displaying camera user interface 612 and settings control 622 for the exposure setting, computer system 600 detects input 1026, a gesture swiping inwards from first button 602A, e.g., as described with respect to input 1004 at FIG. 10B.

[0462] In response to detecting input 1026, at FIG. 10L, computer system 600 displays customization menu 1006 with the icon corresponding to the exposure setting emphasized, indicating the current selection. While displaying customization menu 1006, computer system 600 detects input 1028 directed to customization menu 1006 via the touch-sensitive surface of display 606, selecting the menu item corresponding to the simulated depth-of-field setting of camera user interface 612 to associate the simulated depth-of-field setting with first button 602A. In response to detecting input 1028, computer system 600 associates the simulated depth-of-field setting with first button 602A as illustrated in FIG. 10M, displaying customization indicator 1010, including the simulated depth-of-field setting icon, near first button 602A to indicate that the setting associated with first button 602A has been successfully changed (e.g., as described with respect to FIG. 10E).

[0463] After computer system 600 associates the simulated depth-of-field setting of camera user interface 612 with first button 602A, the user can control the simulated depth-of-field setting via first button 602A and settings control 622, as described with respect to FIGS. 6J-6AM and 10F-10J. As illustrated in FIG. 10N, while displaying settings control 622 for the simulated depth-of-field setting, computer system 600 detects movement input 1030 and/or touch input 1032 and, in response, adjusts the simulated depth-of-field setting of camera user interface 612 to an f-stop value of f/1.8 (e.g., as described with respect to FIG. 6AE). Accordingly, media captured using an input such as input 1034 is designated for display with the midground (e.g., including the woman sitting at the table) in focus and the foreground (e.g., including the coffee cup) and background (e.g., including the person standing behind the table and the mountains in the distance) blurred, as shown in camera preview 614. In some embodiments, while the simulated depth-of-field setting is associated with first button 602A, while displaying settings control 622 for the simulated depth-of-field setting, and/or while capture of depth information is enabled, computer system 600 displays depth capture affordance 612J.

[0464] After adjusting the simulated depth-of-field setting of camera user interface 612 to an f-stop value of f/1.8, the user again updates the customized operation associated with first button 602A, for instance, opening customization menu 1006 using inward swipe input 1036 across settings control 622 and selecting the menu item corresponding to the zoom setting. At FIG. 10O, while the zoom setting is associated with first button 602A and settings control 622 for the zoom setting is displayed, computer system 600 adjusts the zoom setting of camera user interface 612 to 0.5× zoom based on movement input 1038 and/or touch input 1040 (e.g., as described with respect to FIGS. 6O-6Q and 6S). As illustrated in FIG. 10O, the f-stop value for the simulated depth-of-field setting remains set to f/1.8 when the zoom value is changed to 0.5× zoom (e.g., even after the simulated depth-of-field setting is no longer associated with first button 602A), so media captured using an input such as input 1042 is captured at 0.5× magnification and with the foreground and background blurred as shown in camera preview 614. Accordingly, the user can adjust one setting using settings control 622 (e.g., as described with respect to FIGS. 6E-6AM), swipe in from first button 602A to select a different setting using customization menu 1006, adjust the different setting using settings control 622, and so forth to select the desired combination of settings for media capture, then capture media via shutter affordance 612C and/or first button 602A (e.g., as described with respect to FIGS. 6U-6V, 6Y-6AD, and 8A-8P) with the selected settings.

[0465] At FIG. 10P, computer system 600 displays camera user interface 1044, for example, a user interface for a camera utility embedded in a social media application. As illustrated in FIG. 10P, camera user interface 1044 includes shutter affordance 1044A, filter affordances 1044B, and other control affordances 1044C. Camera user interface 1044 also includes camera preview 1046, which, like camera preview 614 of camera user interface 612, represents a portion of the field-of-view of the set of cameras of computer system 600. For example, computer system 600 provides the camera feed from the set of cameras as an input to both the camera application of camera user interface 612 and the embedded camera utility within the social media application of camera user interface 1044. As discussed with respect to camera user interface 612, in some embodiments, camera user interface 1044 can be associated with first button 602A. If camera user interface 1044 is associated with first button 602A, in response to a press input of first button 602A detected while displaying a non-camera user interface (e.g., user interface 610 for the media player application, but not camera user interface 612), computer system 600 displays camera user interface 1044, for example, opening the social media application and navigating directly to the camera utility.

[0466] At FIG. 10Q, while displaying camera user interface 1044, computer system 600 displays settings control 622 in response to input 1048, a light/partial press of first button 602A (e.g., as described with respect to displaying settings control 622 in camera user interface 612). As in the context of camera user interface 612, computer system 600 displays settings control 622 as a tab-shaped cut-out extending into display 606 from the location of first button 602A and obscuring or overlaying a portion of camera user interface 1044. As illustrated in FIG. 10Q, computer system 600 displays settings control 622 for the zoom setting in response to input 1048, reflecting the setting previously associated with first button 602A (e.g., from within camera user interface 612). As in camera user interface 612, in camera user interface 1044, settings control 622 for the zoom setting includes text indicating the current zoom level (“1×”), the icon representing the zoom setting, and the representation of a zoom scale, with the zoom levels represented by the plurality of tick marks increasing from top (e.g., the side closer to the set of cameras) to bottom (e.g., the side further from the set of cameras). In some embodiments, as illustrated in FIG. 10Q, computer system 600 does not change other elements of camera user interface 1044 while displaying settings control 622, e.g., unlike camera user interface 612, a light/partial press of first button 602A does not cause displaying camera user interface 1044 in a “quiet” or “ready to capture” mode.

[0467] At FIG. 10R, while displaying settings control 622 for the zoom setting, computer system 600 detects movement input 1050, an upwards swipe/drag, flick, or directional tap directed to first button 602A. In some embodiments, as in the context of camera user interface 612, computer system 600 also detects movement inputs directed to settings control 622 via the touch-sensitive surface of display 606 while displaying settings control 622 in camera user interface 1044. As illustrated in FIG. 10R, computer system 600 adjusts the zoom setting based on movement input 1050, increasing the zoom level to 8.0× and displaying the representation of the zoom scale with the tick mark representing 8.0× pulled up to the center point of settings control 622, for example, as described with respect to FIG. 6N.

[0468] As discussed with respect to FIG. 6L, in some embodiments, adjusting the zoom level includes performing an optical zoom (e.g., switching between capturing camera data using first camera 604A, second camera 604B, and/or third camera 604C for the different magnifications produced by each different lens) and/or performing a digital zoom (e.g., digitally cropping the portion of the field-of-view of the environment represented in camera preview 1046). In some embodiments, computer system 600 adjusts the zoom level of the camera feed being captured via the set of cameras and provides the adjusted camera feed to the social media application as an input to display in camera preview 1046 of camera user interface 1044.

[0469] At FIG. 10S, while displaying settings control 622 for the zoom setting within camera user interface 1044, computer system 600 detects input 1052, a gesture swiping inwards from first button 602A, e.g., as described with respect to inputs 1004 and 1026. In response, at FIG. 10T, computer system 600 displays customization menu 1006 in camera user interface 1044, e.g., as described with respect to displaying customization menu 1006 in camera user interface 612.

[0470] As illustrated in FIG. 10T, when invoked in camera user interface 1044, customization menu 1006 includes a different set of menu items than in camera user interface 612, providing different options of operations that can be associated with first button 602A in camera user interface 1044 than the options that can be associated with first button 602A in camera user interface 612. In particular, at FIG. 10T, customization menu 1006 includes, from top to bottom, menu items for the zoom setting, the exposure setting, the simulated depth-of-field setting, and the focus setting. However, the filter setting (e.g., as described with respect to FIGS. 6AI-6AK) may be omitted as redundant or incompatible with the custom media filter options (e.g., via filter affordances 1044B) for the social media application of camera user interface 1044, or the capture guidance setting may be omitted as unnecessary for the type of media typically captured from within a social media application.

[0471] As illustrated in FIG. 10T1, in some embodiments, the different options provided in customization menu 1006 for camera user interface 1044 include one or more additional options (e.g., application-specific options other than those provided in customization menu 1006 for camera user interface 612, such as the zoom, exposure, depth, focus, filter, grid, and camera selection options described with respect to FIGS. 10C-10D and 18L). In some embodiments, developers of third-party applications for computer system 600 define (e.g., within the application installation and/or software data) which operations to include in customization menu 1006 when invoked from within the applications, selecting between system-provided options (e.g., the menu options described with respect to FIGS. 10C-10D and/or 18A-18L), and/or defining application-specific options to include. For example, the social media application defines a menu item (illustrated in FIG. 10T1 by a heart icon) for an audio setting (e.g., for selecting background audio for media capture) to include in customization menu 1006 for camera user interface 1044, allowing the user to associate the audio setting with, and to control the audio setting using, first button 602A. In some embodiments an API is provided for an application to select which system-provided options are used and to define and or identify application-provided options that should be included in the customization menu. Accordingly, the user can customize first button 602A to be associated with appropriate operations for the different camera user interfaces.

[0472] At FIG. 10T, computer system 600 detects input 1054 directed to customization menu 1006 via the touch-sensitive surface of display 606. Input 1054 selects the menu item corresponding to the exposure setting (e.g., as discussed with respect to input 1008), and in response, computer system 600 associates the exposure setting with first button 602A.

[0473] As illustrated in FIG. 10U, while the exposure setting is associated with first button 602A, computer system 600 displays settings control 622 for the exposure setting in camera user interface 1044, for instance, in response to another light/partial press of first button 602A to invoke settings control 622. While displaying settings control 622 for the exposure setting in camera user interface 1044, computer system 600 detects movement input 1056, a downwards swipe/drag, flick, or directional tap directed to first button 602A. As illustrated in FIG. 6U, computer system 600 adjusts the zoom setting based on movement input 1056, reducing the exposure value to −0.5 (e.g., a shorter exposure setting for media capture) and displaying camera preview 1046 with decreased brightness. In some embodiments, computer system 600 adjusts the exposure level (e.g., the simulated camera shutter speed, aperture size, and/or ISO speed) of the camera feed being captured via the set of cameras and provides the adjusted camera feed to the social media application as an input to display in camera preview 1046 of camera user interface 1044. In some embodiments, computer system 600 performs the other available operations for camera user interface 1044 in the same manner, for instance, applying simulated depth-of-field or selective focus blurring effects to the camera feed from the set of cameras and providing the camera data with the applied effects as an input to camera user interface 1044.

[0474] In some embodiments, system 600 adjusts the appearance of settings control 622, including the indicator of the current settings value (e.g., the text “−0.5”), based on changes to the appearance of the underlying user interface. For example, as illustrated in FIG. 10U1, when the appearance of camera preview 1046 darkens behind settings control 622 (e.g., in response to movement input 1056, the downwards swipe/drag, flick, or directional tap directed to first button 602A reducing the exposure value), system 600 adjusts the appearance of settings control 622 to increase contrast and visibility against the darkened background. In particular, system 600 displays settings control 622 and the indicator of the current settings value with high-contrast (e.g., white, light, and/or brightly-colored) borders (e.g., keylines) and changes the colors of settings control 622 (e.g., changing to dark-colored tick marks on a light-colored background). In some embodiments, system 600 adjusts the brightness of the display pixels used to display settings control 622 and/or the indicator of the current settings value to increase visual prominence against the background. In some embodiments, system 600 adjusts the appearance of customization menu 1006 based on changes to the appearance of the underlying user interface in a similar manner.

[0475] At FIG. 10V, while displaying camera user interface 1044, computer system 600 detects an input requesting to capture media, such as press input 1058 directed to first button 602A (e.g., as described with respect to FIGS. 6U-6V and/or FIGS. 8A-8P) or touch input 1060 directed to shutter affordance 1044C of camera user interface 1044. As illustrated in FIG. 10W, in response to press input 1058 and/or touch input 1060, computer system 600 captures media (e.g., photo and/or video media) and displays a representation of the captured media in media editing user interface 1062 of the social media application (e.g., a user interface for adding text, adding annotations, applying visual effects, applying filters, adding music, and/or otherwise editing media to post on the social media application). As shown in the representation of the captured media, the media capture is performed at 8× zoom and with −0.5 exposure, as set using first button 602A, customization menu 1006, and setting control 622 within camera user interface 1044. In some embodiments, although press input 1058 may be the same type of press input as input 609 and/or input 1002, computer system 600 does not launch camera user interface 612 in response to press input 1058, as a camera user interface is already being displayed. Accordingly, press inputs of first button 602A can be used both to capture media from within a variety of different camera user interfaces and to launch a selected or default camera user interface from outside of the camera user interfaces.

[0476] FIGS. 11A-11B are a flow diagram illustrating method 1100 for customizing and controlling operations of a computer system using hardware inputs, in accordance with some embodiments. The method is performed at a computer system (e.g., 100, 300, 500, and/or 600) that is in communication with a display generation component (e.g., 606) (e.g., a display controller; a touch-sensitive display system; a display (e.g., integrated and/or connected), a 3D display, a transparent display, a projector, and/or a heads-up display) and a first input device (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606) (e.g., including one or more hardware buttons and/or surfaces, such as mechanical (e.g., physically depressible), solid-state, intensity-sensitive, and/or touch-sensitive (e.g., capacitive) buttons and/or surfaces), e.g., as illustrated in FIGS. 6A-6B. In some embodiments, the first input device is included in a plurality of input devices in communication with the computer system. In some embodiments, the computer system is optionally in communication with one or more cameras (e.g., 604A, 604B, 604C, and/or 604D), such as a rear (user-facing) camera and a forward (environment-facing) camera and/or a plurality of cameras with different lenses, such as a standard camera, a telephoto camera, and/or a wide-angle camera. In some embodiments, the computer system is optionally in communication with one or more sensors, such as camera sensors, optical sensors, depth sensors, capacitive sensors, intensity sensors, motion sensors, vibration sensors, and/or audio sensors.

[0477] The computer system detects (1102) (e.g., via the first input device and/or via a second input device, such as a touch-sensitive surface located adjacent to the first input device) a first input including a movement (1004, 1026, 1036, and/or 1052) (e.g., a swipe gesture) that starts at a first location corresponding to the first input device (e.g., an edge/region of a touch sensitive surface close to where the first input device (e.g., hardware button) is situated) (in some embodiments, the display generation component is a touch-sensitive display and the first input is detected on a region of the display that corresponds to and/or is adjacent to the first input device) and ends at a second location that is different from the first location (e.g., as described with respect to FIGS. 10B, 10K, 10N, and/or 10S) (e.g., an gesture input swiping from the first input device inwards towards the center of the touch sensitive surface). In some embodiments, the second location is farther from the first input device than the first location, e.g., the movement includes an inward swipe from the edge of the touch-sensitive display closest to the hardware button towards the center of the touch-sensitive display.

[0478] In response to detecting the first input (1104) (in some embodiments, in accordance with a determination that the first input includes the movement), the computer system displays (1106), via the display generation component, an option user interface (e.g., 1006), (e.g., a menu with controls for selecting/changing a customizable function of the first input device (e.g., the hardware button). In some embodiments, the options user interface is displayed overlaying (e.g., semi-transparently and/or opaquely) a user interface displayed when the first input is detected.) including a plurality of selectable user interface objects corresponding to a respective plurality of operations that can be associated with the first input device (e.g., as described with respect to FIGS. 10C-10D, 10L, and/or 10T) (e.g., the one or more respective operations are operations that can be associated with the first input device, such as operations for launching an application, capturing media, and/or changing a setting, such as changing a zoom level, simulated depth-of-field setting, exposure setting, filter setting, and/or capture guidance setting). In some embodiments, one selectable user interface object of the plurality of selectable user interface objects corresponds to two or more related operations, e.g., a simulated depth-of-field menu item corresponds to both toggling displaying of a camera preview with simulated depth-of-field effects applied and adjusting a simulated f-stop value for the simulated depth-of-field effects. In some embodiments, the plurality of selectable user interface objects includes a first selectable user interface object that corresponds to a first operation and a second selectable user interface object, different from the first selectable user interface object, that corresponds to a second operation different from the first operation.

[0479] While displaying the options user interface (1108), the computer system detects (1110) (in some embodiments, via the second input device) a second input (e.g., 1008, 1028, and/or 1054) (in some embodiments, a tap input) selecting a respective selectable user interface object of the plurality of selectable user interface objects (e.g., as described with respect to FIGS. 10C-10D, 10L, and/or 10T) (in some embodiments, in response to detecting the second input, the computer system associates the respective operation that corresponds to the selected user interface object with the first input device). After detecting the second input (1112) (e.g., and without detecting a subsequent input selecting one of the one or more selectable user interface objects from the option user interface, e.g., while the respective selectable user interface object is the most recently selected user interface object from the options user interface), the computer system detects (1114), via the first input device, a third input directed to the first input device (e.g., 1012, 1014, 1016, 1022, 1024, 1030, 1032, 1037, 1038, 1048, 1050, and/or 1056) (e.g., a press, tap, click, swipe, and/or other manipulation of the first input device).

[0480] At FIG. 11B, in response to detecting the third input directed to the first input device (1116): in accordance with a determination that a first set of one or more criteria is satisfied (1118), the computer system performs (1120) a first operation of the respective plurality of operations, wherein the first set of one or more criteria includes a first criterion that is satisfied when the respective selectable user interface object that was selected by the second input (e.g., the most recently selected user interface object from the options user interface) corresponds to the first operation (in some embodiments, the first criterion is satisfied if the first operation is currently (e.g., remains) associated with the first hardware button); and in accordance with a determination that a second set of one or more criteria is satisfied (1122), the computer system performs (1124) a second operation of the respective plurality of operations that is different from the first operation of the respective plurality of operations, wherein the second set of one or more criteria includes a second criterion that is satisfied when the respective selectable user interface object that was selected by the second input corresponds to the second operation (e.g., as described with respect to FIGS. 10F-10G, 10J, 10N, 10O, 10Q-10R, and/or 10U). For example, the first criterion is satisfied when the second input was a selection of a selectable user interface object corresponding to the first operation. For example, the second criterion is satisfied when the second input was a selection of a selectable user interface object corresponding to the second operation. In some embodiments, the second criterion is satisfied if the second operation is currently (e.g., remains) associated with the first hardware button. In some embodiments, the first criterion and the second criterion are mutually exclusive. In some embodiments, the first and/or second set of one or more criterion includes a criterion that is satisfied when the third input is detected while displaying a respective user interface. For example, the computer system only performs the first operation if an appropriate application (e.g., a camera application for a camera function) is open when the third input is detected. In some embodiments, if the third input is detected while displaying a different user interface, the computer system opens the respective user interface in response to the third input. In some embodiments, the first and/or second set of one or more criterion includes a criterion that is satisfied when the third input includes an input of a particular type, such as a press and/or a movement/gesture. In some embodiments, the first and/or second set of one or more criterion includes a criterion that is satisfied when the third input includes an input with particular characteristics, such as a press of a certain intensity (e.g., a light/partial press or a hard/full press), a press of a certain duration, a certain type of gesture, and/or a certain magnitude of gesture. In some embodiments, if the third input does not include an input of the particular type/characteristics, the computer system performs an operation other than the first operation, the second operation, and/or the one or more respective operations. Customizing an operation performed using a first input device, where the operation is customized by selecting from multiple available operations via a menu accessed by a gesture input starting from the first input device, provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, by providing users with a menu to customize the operations controlled by the first input device, the computer system reduces the number of display elements and/or inputs needed to control a wide variety of functionality (e.g., the available custom operations). Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using a particular input device and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, which also reduces the overall number of hardware components needed for control (e.g., compared to mapping the first and second operation to different input devices), resulting in a more compact, lighter, and cheaper device. For example, a user can open the customization menu, select between multiple custom operations, and control the multiple custom operations operation using only inputs in the vicinity of the first input device. Opening the menu in response to a gesture input starting from the first input device also provides users with real-time feedback about a state of the computer system, namely, intuitively presenting information about the current operational capabilities of the first input device.

[0481] In some embodiments, the computer system displays, via the display generation component, a first user interface (e.g., 612 and/or 1046) (in some embodiments, a media capture user interface, such as a user interface for a camera application or a camera utility embedded within an application), wherein the first user interface is displayed while detecting the first input and while displaying the option user interface (e.g., 1006). For example, the option user interface is displayed within, near, and/or overlaying the user interface being displayed when the swipe from the first user interface is detected. In some embodiments, while displaying the option user interface (e.g., 1006) (e.g., in response to detecting the first input), the computer system reduces a visual prominence of the first user interface relative to a visual prominence of the option user interface (e.g., as illustrated in FIGS. 10C-10D and/or 10L). In some embodiments, the computer system fades, darkens, blurs, increases transparency of, shrinks, moves, and/or ceases display of one or more regions, selectable user interface objects, and/or other graphical elements in the first user interface such that the first user interface is deemphasized in comparison to the option user interface. In some embodiments, the computer system brightens, sharpens, increases opacity of, grows, and/or moves the option user interface such that the option user interface is emphasized in comparison to the first user interface. Reducing the visual prominence of another user interface while displaying the option user interface provides users with real-time feedback about a state of the computer system, which also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, deemphasizing other UI elements reduces visual clutter and draws attention to the option user interface, making it easier to view and customize controls associated with the first input device.

[0482] In some embodiments, reducing the visual prominence of the first user interface relative to the visual prominence of the option user interface includes ceasing displaying a first portion of (e.g., ceasing displaying one or more regions, selectable user interface objects, and/or graphical elements of) the first user interface in a first display region, wherein the option user interface is displayed in the first display region (e.g., as described with respect to FIGS. 10C and/or 10L). For example, the option user interface is displayed in a cut-out and/or or opaque overlay of the first user interface, such as a tab and/or platter covering the first portion of the first user interface. In some embodiments, the computer system continues displaying a second portion of the first user interface in a second display region different from the first display region. For example, the option user interface cut-out or overlay only removes or obscures part of the first user interface. In some embodiments, the second portion of the first user interface is visually deemphasized in another way while continuing to be displayed, e.g., the portion of the first user interface outside of the first display region (e.g., the option user interface cut out) is faded and/or darkened while the option user interface is displayed. Ceasing displaying a portion of another user interface while displaying the option user interface provides users with real-time feedback about a state of the computer system, which also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, ceasing displaying a portion of the underlying user interface reduces visual clutter and draws attention to the option user interface, making it easier to view and customize controls associated with the first input device.

[0483] In some embodiments, reducing the visual prominence of the first user interface relative to the visual prominence of the option user interface includes fading (e.g., darkening, lightening, reducing contrast of, and/or increasing transparency of) a second portion of the first user interface (e.g., as illustrated in FIG. 10D) (e.g., one or more regions, selectable user interface objects, and/or graphical elements of the first user interface). In some embodiments, the second portion of the first user interface is the portion of the first user interface displayed outside of the first display region, e.g., the portion of the first user interface that is not removed/obscured by the option user interface cut-out. Fading portions of another user interface while displaying the option user interface provides users with real-time feedback about a state of the computer system, which also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, fading other UI elements reduces visual clutter and draws attention to the option user interface, making it easier to view and customize controls associated with the first input device.

[0484] In some embodiments, the first set of one or more criteria includes a press criterion that is satisfied when the third input includes a first press input (e.g., 1012, 1022, 1030, 1037, 1048, and/or 1056) directed to the first input device (e.g., as described with respect to FIGS. 10F-10G, 10J, 10N, 10O, 10Q-10R, 10U, and/or 6A-6AM). In some embodiments, the third input includes a first press input when the first input device detects at least a threshold intensity, e.g., detecting an applied pressure of at least 25 g/cm³, 50 g/cm³, 100 g/cm³, 150 g/cm³, or 200 g/cm³ and/or detecting a corresponding mechanical state. For example, the computer system performs the first operation in response to a light/partial press and/or a full/hard press of the first input device. In some embodiments, the second set of one or more criteria also includes the press criterion. For example, the option user interface provides customization of operations corresponding to press inputs of the first input device. For example, the first operation includes toggling an option in response to a press input, and the second operation includes launching an application in response to a press input. Customizing an operation performed using a press input of the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, customizing the first input device to cause performance of the first operation in response to a press input reduces the number of display elements and/or inputs needed to perform the first operation.

[0485] In some embodiments, the first set of one or more criteria includes a movement criterion that is satisfied when the third input includes a movement input (e.g., 1014, 1016, 1022, 1024, 1030, 1032, 1037, 1038, 1050, and/or 1056) (e.g., a swipe, flick, drag, and/or other gesture) directed to the first input device (e.g., as described with respect to FIGS. 10G, 10J, 10N, 10O, 10R, 10U, 6A-6AM, and/or 14A-14Z). In some embodiments, the third input includes a movement input when the first input device detects at least a threshold amount of movement in a respective direction, e.g., across or above the surface of the first input device and along the edge of a display. In some embodiments, performing the first operation includes performing the first operation based on one or more characteristics of the movement input, e.g., magnitude, direction, speed, acceleration, duration, and/or intensity. For example, the first operation includes adjusting a parameter by an amount and in a direction corresponding to the magnitude and direction of movement along the edge of the display. In some embodiments, the second set of one or more criteria also includes the movement criterion. For example, the option user interface provides customization of operations corresponding to movement inputs on the first input device. For example, the first operation includes adjusting a zoom setting using input movement, and the second operation includes adjusting a filter setting using input movement. Customizing an operation performed using a movement input on the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, customizing the first input device to cause performance of the first operation in response to a movement input reduces the number of display elements and/or inputs needed to perform the first operation.

[0486] In some embodiments, the computer system detects a fourth input directed to the first input device (e.g., 1018, 1020, 1034, 1058, and/or 1060), wherein the fourth input does not satisfy the movement criterion (e.g., the fourth input is not a touch, press, and/or tap input without a movement component in the respective direction), and, in response to detecting the fourth input directed to the first input device, the computer system performs a respective (e.g., standard) operation (e.g., as described with respect to FIGS. 10H-10I and/or 10V). In some embodiments, the standard operation is different from the first operation and different from the second operation. In some embodiments, the standard operation is not included in the plurality of operations and/or does not correspond to one of the plurality of selectable user interface objects, e.g., the standard operation is different from the customizable functions. For example, performance of the standard operation using the first input device remains unchanged even as the operation selected by the second input changes (e.g., when either the first criterion or the second criterion is satisfied). Customizing an operation performed using a movement input on the first input device while performing a standard operation in response to a different input on the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, providing both a customizable function and a standard function by using different types of input via the first input device reduces the number of display elements and/or inputs needed to perform operations while also providing a wider variety of functionality, allowing the user to quickly switch between performing a custom function and performing a standard function without needing to move their hands between different user interface elements and/or input devices.

[0487] In some embodiments, the fourth input includes a second press input directed to the first input device or a first tap gesture directed to the first input device (e.g., 1018, 1020, 1034, 1058, and/or 1060). In some embodiments, the third input includes a second press input when the first input device detects at least a threshold intensity, e.g., detecting an applied pressure of at least 25 g/cm³, 50 g/cm³, 100 g/cm³, 150 g/cm³, or 200 g/cm³ and/or detecting a corresponding mechanical state. For example, the computer system performs the standard operation in response to a light/partial press and/or a full/hard press of the first input device.

[0488] In some embodiments, performing the respective operation includes performing a media capture operation (e.g., as described with respect to FIGS. 10H-10I and/or 10V) (e.g., capturing photo media and/or video media, e.g., via one or more cameras). In some embodiments, the third set of criteria includes a criterion that is satisfied when the third input is detected while displaying a camera user interface, such as a user interface for a camera application and/or a user interface for a camera utility within another application (e.g., an embedded camera interface for a social media application). Customizing an operation performed using a movement input on the first input device while performing a standard operation in response to a tap or press input on the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, providing both a customizable function and a media capture function by using different types of input via the first input device reduces the number of display elements and/or inputs needed to perform operations and allows the user to quickly switch between performing a custom function (such as a media capture settings adjustment) and capturing media without needing to move their hands between different user interface elements and/or input devices.

[0489] In some embodiments, the first operation of the respective plurality of operations includes adjusting (e.g., changing) a first setting. In some embodiments, the first setting is a media capture setting, such as zoom, filter intensity, exposure, and/or simulated depth-of-field settings. In some embodiments, the second operation of the plurality of operations includes adjusting a second setting, different from the first setting. In some embodiments, the computer system displays, via the display generation component, a media capture user interface (e.g., 612 and/or 1044) (in some embodiments, a user interface for a camera application or a camera utility embedded within an application) that includes a representation of a field-of-view of one or more cameras (e.g., 614 and/or 1046) (e.g., a camera viewfinder, which displays a representation of the portion of the current field-of-view of one or more cameras of the computer system that will be included in a media capture), wherein the media capture user interface is displayed while detecting the third input, and, in response to detecting the third input directed to the first input device and while performing the first operation of the respective plurality of operations, the computer system displays, via the display generation component, an indicator of a current value of the first setting, wherein the indicator of the current value of the first setting is displayed overlaying (e.g., replacing and/or semi-transparently layering over) a portion of the representation of the field-of-view of the one or more cameras (e.g., as illustrated in FIGS. 6J-6T, 6W-6AA, 6AE-6AF, 6AI-6AM, 10F-10G, 10J-10K, 10N-10O, 10Q-10S, and/or 10U). In some embodiments, while performing the first operation, the computer system updates the appearance of the camera viewfinder based on the current value of the first setting, e.g., displaying a live preview of the changes to the setting. In some embodiments, while displaying the indicator of the current value of the first setting, the computer system updates the appearance of the indicator in response to adjustments made to the first setting, e.g., via the third input, via another input (e.g., adjusting the setting via displayed touch controls), and/or automatic adjustments. In some embodiments, after detecting an end of the third input, the computer system maintains display of the indicator of the current value of the first setting until either another input is detected or a threshold period of time elapses without further input (e.g., as described with respect to FIGS. 6A-7). In some embodiments, while performing the second operation of the respective plurality of operations, the computer system displays, via the display generation component, an indicator of a current value of the second setting overlaying at least a portion of the camera viewfinder. Displaying an indicator of a settings value overlaying a camera viewfinder while performing a custom operation to adjust the settings value provides users with improved visual feedback about a state of the computer system without cluttering the display, which assists the user with control of the computer system via the first input device. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, by overlaying the indicator of the settings value over the camera viewfinder when adjusting the setting using a hardware button, the computer system provides feedback on the results of the adjustment operations to the user without cluttering the camera user interface with additional displayed controls, which can distract from or obscure the camera viewfinder.

[0490] In some embodiments, while displaying the indicator of the current value of the first setting, the computer system detects a change in an appearance of the representation of the field-of-view of the one or more cameras (e.g., 614 and/or 1046) (in some embodiments, detecting a change in content within the camera viewfinder) within a respective display region that includes the portion of the representation of the field-of-view of the one or more cameras (e.g., the portion of the camera viewfinder overlaid by the indicator). In some embodiments, detecting the change in the appearance of the camera viewfinder includes determining (e.g., sampling, averaging, and/or otherwise analyzing) image data characteristics (e.g., brightness, hue, and/or contrast) of the portion of the field-of-view of the one or more cameras represented in the respective display region over time. In some embodiments, detecting the change in the appearance of the camera viewfinder includes determining that the appearance (e.g., the image data characteristics) has changed by at least a threshold amount (e.g., a 5%, 10%, and/or 50% change in average brightness) and/or has changed from one state to another state (e.g., the average hue has changed from red to green). In some embodiments, in response to detecting the change in the appearance of the representation of the field-of-view of the one or more cameras within the respective display region that includes the portion of the representation of the field-of-view of the one or more cameras, the computer system changes an appearance (e.g., color, brightness, luminosity, size, line weight, and/or border) of the indicator of the current value of the first setting based on the change in the appearance of the representation of the field-of-view of the one or more cameras within the respective display region that includes the portion of the representation of the field-of-view of the one or more cameras (e.g., as illustrated in FIG. 10U1). For example, changing the appearance of the indicator based on the change in the appearance of the media capture preview includes changing the appearance of the indicator to increase visual prominence of the indicator relative to the appearance of the camera viewfinder within the respective display region. For example, in accordance with a determination that the contents of the camera viewfinder darkened behind the indicator, the computer system changes the indicator to be brighter (e.g., more white content), and in accordance with a determination that the contents of the camera viewfinder lightened behind the indicator, the computer system changes the indicator to be darker (e.g., more black content) or to be displayed with increased luminosity. Adjusting the appearance of the indicator of the settings value based on the appearance of the camera viewfinder underlying the indicator provides improved visual feedback about a state of the computer system without cluttering the display, which assists the user with control of the computer system via the first input device. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, adjusting the appearance of the indicator improves the visibility of the indicator to the user even as the contents of the camera viewfinder change.

[0491] In some embodiments, the first set of one or more criteria includes a third criterion that is satisfied when the third input is detected while displaying, via the display generation component, a first user interface of a first application (e.g., 612) or a second user interface of a second application different from the first application (e.g., 1046). In some embodiments, the second set of one or more criteria also includes the third criterion, e.g., two or more of the respective plurality of operations can be performed via the first input device in multiple different user interfaces. In some embodiments, the first user interface is associated with a first application (e.g., a media capture user interface for a camera application) and the second user interface is associated with a second application different from the first application (e.g., an embedded camera user interface within a social media application). In some embodiments, the first application and the second application are created by different developers, managed by different entities, and/or distributed as separate products. For example, the first application may be a first-party camera application for a mobile device, and the second application may be a third-party social media application with embedded camera functionality. In some embodiments, the third criterion is satisfied when the third input is detected while displaying any one of a predetermined plurality of user interfaces/applications. For example, the customizable operations include adjustments to media capture settings (e.g., zoom, exposure, simulated depth-of-field effects, focus, filters, and/or other media capture options/parameters) that can be performed via the first input device in a variety of compatible media capture applications and/or user interfaces, such as a dedicated camera application and an embedded media capture user interface in a social media, messaging, and/or creative application. Customizing an operation to be performed via the first input device in multiple different user interfaces and/or applications provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, after selecting a custom operation via the option user interface, the first input device can be used to quickly and easily perform the custom operation across different applications and user interfaces.

[0492] In some embodiments, performing the first operation includes, changing a first property of (e.g., adjusting) a first set of data (e.g., as described with respect to FIGS. 10G, 10J, 10N, 10O, 10R, 10U, FIGS. 6A-6AM, and/or 14A-14Z) (in some embodiments, the first set of data includes a live data feed, e.g., a camera feed and/or another sensor data feed), wherein the first set of data is provided as an input to the first user interface of the first application (e.g., while displaying the first user interface) and the first set of data is provided as an input to the second user interface of the second application (e.g., while displaying the second user interface). For example, performing the first operation includes adjusting a property (e.g., zoom, exposure, simulated depth-of-field effect, focus, and/or filtering) of a camera feed used by multiple different applications/user interfaces. In some embodiments, performing the second operation includes changing a second property, different from the first property, of the first set of data. For example, the first operation changes a zoom level and the second operation changes an exposure level for a camera feed shared by multiple different applications/user interfaces. Customizing an operation adjusting a property of input data shared between different applications/user interfaces to be performed via the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, by adjusting the data being input to the different user interfaces/applications, performing the first operation with the first input device produces predictable and intuitive adjustments across the computer system without requiring the different user interfaces/applications to separately adjust the property.

[0493] In some embodiments, performing the first operation includes performing a first media capture operation (e.g., as described with respect to FIGS. 10G, 10J, 10N, 10O, 10R, 10U, FIGS. 6A-6AM, and/or 14A-14Z) (e.g., adjusting a capture setting, enabling or disabling a media capture feature, and/or changing a media capture state/mode). In some embodiments, performing the second operation includes performing a second media capture operation different from the first media capture operation. In some embodiments, performing the media capture operation is based on one or more characteristics of the third input, such as the movement (e.g., magnitude, speed, and/or direction), location, intensity, and/or duration of the input. Customizing a media capture operation to be performed using the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, using the first input device to perform a custom media capture operation reduces the number of display elements and/or inputs needed to perform the media capture operation, allowing for faster and less distracting control of media capture.

[0494] In some embodiments, performing the first media capture operation includes adjusting a zoom setting for media capture (e.g., as described with respect to FIGS. 10O, 10R, 6L-6S, 6X, 6Z, and/or 14P-14Z). In some embodiments, adjusting the zoom includes adjusting an optical zoom level (e.g., changing between lenses of different magnifications) and/or a digital zoom level (e.g., zooming in or out on camera data captured with a given lens), e.g., as described with respect to FIGS. 6A-7. In some embodiments, the first set of one or more criteria includes a movement criterion (e.g., that is satisfied when the third input includes a movement input, such as a swipe, flick, drag, and/or other gesture directed to the first input device), and adjusting the zoom level includes adjusting the zoom level based on the magnitude, direction, speed, and/or location of the movement.

[0495] In some embodiments, performing the first media capture operation includes adjusting a simulated depth-of-field setting for media capture (e.g., as described with respect to FIGS. 6AE-6AF and/or 10N) (e.g., a setting for simulating capture with a particular focal length (f-stop) by selectively blurring portions of a media capture that would not be in focus (e.g., would be outside of the depth-of-field) when captured using a lens with the particular focal length), e.g., as described with respect to FIGS. 6A-7. In some embodiments, changing the simulated depth-of-field setting includes changing the simulated focal length (f-stop), e.g., from f/1.8 to f/8.4. In some embodiments, changing the simulated depth-of-field setting includes enabling or disabling displaying simulated depth-of-field effects, e.g., in a media capture preview and/or when viewing captured media. In some embodiments, changing the simulated depth-of-field setting includes enabling or disabling capture of depth information with a media capture.

[0496] In some embodiments, performing the first media capture operation includes adjusting an exposure setting for media capture (e.g., as described with respect to FIGS. 10G, 10J, 10U, and/or 14C-14O). In some embodiments, adjusting an exposure setting includes simulating different camera exposure times, shutter speeds, aperture sizes, and/or ISO speeds for media capture, e.g., as described with respect to FIGS. 6A-7. In some embodiments, performing the first media capture operation includes adjusting a filter setting for media capture (e.g., as described with respect to FIGS. 6AI-6AK) (e.g., an adjustment to and/or overlay of media capture, such as filters for color grading, tone adjustment, blurring, smoothing, vignetting, noise reduction, and/or applying other visual and/or audio effects, e.g., as described with respect to FIGS. 6A-7). In some embodiments, adjusting the filter setting includes changing the type of filter being applied to the media capture. In some embodiments, changing the filter setting includes changing the intensity of a filter being applied.

[0497] In some embodiments, the computer system detects an additional set of one or more inputs directed to the first input device (e.g., 1002 and/or 609), and, in response to detecting the additional set of one or more inputs and in accordance with a determination that the additional set of one or more inputs satisfies a set of launch criteria, the computer system displays, via the display generation component, a respective camera user interface (e.g., 612 and/or 1046; e.g., as described with respect to FIGS. 10A-10B and/or 6D-6E) (in some embodiments, launching (e.g., opening and/or displaying) a camera application or user interface; in some embodiments, a camera application/UI included in a set of available camera user interfaces; in some embodiments, a default camera application/UI), wherein the set of launch criteria includes a criterion that is satisfied when a first input element is activated (in some embodiments, the first input element is activated based on an input intensity exceeding a particular intensity threshold) while the computer system is not displaying, via the display generation component, a camera user interface (e.g., 612 and/or 1046) (e.g., a user interface for media capture, such as a camera application or a social media application with camera functionality; in some embodiments, any camera user interface included in a set of available camera user interfaces). For example, the computer system displays, surfaces, and/or launches a camera interface in response to press inputs detected while the camera interface is not already displayed, active, and/or running. In some embodiments, the computer system will open a particular camera application if the particular camera application is not already open. In some embodiments, the computer system will open the particular camera application unless any camera application is already open. In some embodiments, the set of launch criteria includes a criterion that is satisfied when the first input element is activated while the computer system is displaying a non-camera user interface (e.g., a home screen, a lock screen, a UI for an application that does not include a camera UI, and/or a non-camera UI for an application that does include a camera UI). In some embodiments, the first set of one or more criteria and the second set of one or more criteria both include a criterion that is met when a respective camera user interface is displayed when detecting the third input (e.g., the first set of one or more criteria and the second set of criteria are not satisfied if the launch criterion is satisfied). For example, while the camera user interface is not open or displayed, the computer system launches the camera user interface in response to a press input of the first input device, and while the camera user interface is displayed, the computer system performs custom media capture operations using the first input device. Launching a camera user interface in response to press inputs detected while the camera user interface is not displayed provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can launch the camera user interface then quickly perform custom operations in the camera user interface via the first input device, without needing to move their hands and/or change input mode.

[0498] In some embodiments, the computer system detects a fourth input directed to the first input device (e.g., 1018, and/or 1058), wherein the fourth input includes a fourth press input directed to the first input device; in some embodiments, the fourth input includes a first press input when the first input device detects at least a threshold intensity, e.g., detecting an applied pressure of at least 25 g/cm³, 50 g/cm³, 100 g/cm³, 150 g/cm³, or 200 g/cm³ and/or detecting a corresponding mechanical state. In some embodiments, in response to detecting the fourth input directed to the first input device and in accordance with a determination that the fourth input directed to the first input device is detected while displaying a user interface of a first camera application (e.g., 612), the computer system performs a media capture operation using the first camera application (e.g., without performing a camera operation using the second camera application) (e.g., as described with respect to FIGS. 10H-10I) (in some embodiments, capturing, initiating capturing, and/or stopping capturing photo and/or video media). In some embodiments, in response to detecting the fourth input directed to the first input device and in accordance with a determination that the fourth input directed to the first input device is detected while displaying a user interface of a second camera application (e.g., 1046), the computer system performs the media capture operation (e.g., as described with respect to FIGS. 10V-10U). For example, the computer system performs a media capture operation in response to a press input detected both in a media capture user interface for a camera application and in an embedded camera user interface within a social media application, and or while displaying any one of a predetermined plurality of camera user interfaces/applications. In some embodiments, if none of the camera user interfaces/applications are displayed, the computer system displays the camera user interface in response to a press input. Using the first input device to perform media capture operations in multiple different camera applications/user interfaces provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed or captured with unintended settings, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, performing the media capture operation in different user interfaces/applications with the first device provides intuitive and predictable control of media capture across the computer system.

[0499] In some embodiments, displaying the option user interface (e.g., 1006) including the plurality of selectable user interface objects corresponding to the respective plurality of operations that can be associated with the first input device includes, in accordance with a determination that the first input is detected while displaying, via the display generation component, the user interface of the first camera application (e.g., 612), displaying a first selectable user interface object corresponding to a first operation that can be associated with the first input device (e.g., as illustrated in FIGS. 10C-10D and/or 10L). In some embodiments, displaying the option user interface (e.g., 1006) including the plurality of selectable user interface objects corresponding to the respective plurality of operations that can be associated with the first input device includes, in accordance with a determination that the first input is detected while displaying, via the display generation component, the user interface of the second camera application (e.g., 1046), the computer system foregoes displaying the first selectable user interface object corresponding to the first operation that can be associated with the first input device (e.g., as described with respect to FIG. 10T). For example, when accessed in a default camera application, the option user interface includes options to associate zoom adjustment, exposure adjustment, simulated depth-of-field setting adjustment, and filter adjustment operations with the first input device, and when accessed in an embedded camera user interface of a social media application, the option user interface includes the options to associate zoom adjustment, exposure adjustment, and simulated depth-of-field setting adjustment operations with the first input device, but not the option to associate the filter adjustment operation with the first input device. For example, different subsets of available operations can be associated with the first input device in different applications. Providing the menu for selecting a custom operation for the first input device in different user interfaces/applications, where different custom operation options are provided in the different user interfaces/applications, provides improved computer system functionality without cluttering the user interface with additional displayed controls. Doing so also provides users with real-time feedback about a state of the computer system, which also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, different custom operation options can be provided based on what is relevant to and/or compatible with the current user interface/application, which also intuitively indicates to the user what customization options are available in a particular context.

[0500] In some embodiments, in response to detecting the third input directed to the first input device and in accordance with a determination that a respective set of one or more criteria is satisfied, the computer system performs a respective operation different from the first operation and different from the second operation (e.g., as described with respect to FIGS. 10H, 10N-10O, and/or 10V). In some embodiments, the respective operation is not included in the respective plurality of operations that can be associated with the first input device via the option user interface), e.g., the respective operation is an operation other than the customizable operations. For example, the respective operation includes initiating a media capture (e.g., capturing photo media and/or initiating capturing video media). In some embodiments, in accordance with a determination that the respective set of one or more criteria is not satisfied, the computer system performs the first operation (e.g., if the first set of one or more criteria is satisfied), the second operation (e.g., if the second set of one or more criteria is satisfied), a different operation than the first operation, second operation, and respective operation, and/or foregoes performing an operation. In some embodiments, the respective set of one or more criteria includes a respective criterion that is satisfied when the third input directed to the first input device is a press input of a respective type (e.g., a hard/full press and/or a press without movement). In some embodiments, if the respective criterion is satisfied, the first set of one or more criteria and the second set of one or more criteria are not satisfied (e.g., the computer system does not perform the first operation and/or second operation in response to press inputs of the respective type). In some embodiments, the respective set of one or more criteria does not include the first criterion or the second criterion (e.g., the computer system performs the respective operation without regard to whether the first input device is configured to perform a first operation or a second operation) (e.g., the respective set of one or more criteria can be satisfied whether the respective selectable user interface object that was selected by the second input corresponds to the first operation, the second operation, and/or another operation of the respective plurality of operations). In some embodiments, the respective set of one or more criteria includes a criterion that is satisfied when the third input is detected while displaying a respective user interface. For example, the computer system optionally only performs the respective operation if an appropriate application (e.g., a camera application for a camera function) is open when the third input is detected. Performing an operation other than the customizable operations in response to a particular type of press input detected by the first input device provides improved control of computer system functionality without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, using the particular type of press input to perform a consistent operation, regardless of which customizable operation is currently associated with the hardware button, expands the functionality available to the user via the hardware button without sacrificing its customizability. Doing so also provides improved ergonomics of computer systems, for example, by expanding the controls available using a particular input device and reducing the need for users to move their hands back and forth between different user interface elements and/or input devices, which also reduces the overall number of hardware components needed for control (e.g., compared to mapping the first and second operation to different input devices), resulting in a more compact, lighter, and cheaper device.

[0501] In some embodiments, the computer system detects a press input directed to the first input device (e.g., 1002, 1012, 1018, 1022, 1030, 1037, 1048, 1056, and/or 1058). In some embodiments, in response to detecting the press input and in accordance with a determination that a user interface for a camera application (e.g., 612 and/or 1046) (e.g., a respective camera user interface/application of a plurality of camera user interfaces/applications associated with the first input device) was not displayed when the press input (e.g., 1002) was detected, displaying a user interface for a default camera application (e.g., as described with respect to FIGS. 10A-10B) (e.g., without performing an operation corresponding to the default camera application); in some embodiments, the user interface for the default camera application is included in the plurality of camera user interfaces/applications associated with the first input device. In some embodiments, in response to detecting the press input and in accordance with a determination that a user interface for a first camera application was displayed when the press input (e.g., 1012, 1018, 1022, 1030, 1037, 1048, 1056, and/or 1058) was detected, the computer system performs an operation corresponding to the first camera application (e.g., as described with respect to FIGS. 10F-10J, 10N, 10O, 10Q-10R, 10U, and/or 10Q). In some embodiments, in response to detecting the press input, in accordance with a determination that a user interface for a second camera application (e.g., that is different from the first camera application) was displayed when the press input was detected, performing an operation corresponding to the second camera application (e.g., without displaying the user interface for the first camera application or performing the operation corresponding to the first camera application). In some embodiments, in response to detecting the press input, in accordance with a determination that a user interface for a third camera application (e.g., that is different from the first camera application and the second camera application) was displayed when the press input was detected, performing an operation corresponding to the third camera application (e.g., without displaying the user interface for the first camera application or performing the operation corresponding to the first camera application, without displaying the user interface for the second camera application or performing the operation corresponding to the second camera application). In some embodiments the first camera application is the default camera application. In some embodiments the second camera application is the default camera application. In some embodiments, the third camera application is the default camera application. Launching a default camera user interface in response to press inputs detected while a camera user interface is not displayed and performing a media capture operation in response to press inputs detected while a camera application is displayed provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can quickly launch and control the default camera user interface by pressing the first input device, without needing to move their hands and/or change input mode, while also being able to control other camera user interfaces by pressing the first input device (e.g., without opening the default camera user interface).

[0502] In some embodiments, displaying the user interface for the default camera application includes, in accordance with a determination that a user has selected the first camera application as the default camera application, displaying the user interface for the first camera application (e.g., 612), and, in accordance with a determination that the user has selected a second camera application, different from the first camera application as the default camera application, displaying the user interface for the second camera application (e.g., 1046). In some embodiments, the user selection of the default camera user interface is received via a settings user interface for the first input device, such as a menu including available and/or compatible camera applications and user interfaces. In some embodiments, the user selection of the default camera user interface is included in a user profile, e.g., a user's favorited or preferred camera application or user interface. For example, the user can select the camera user interface that will be opened by default in response to a press from the plurality of camera user interfaces that can be opened and controlled using the first input device. Launching a camera user interface specified by a user in response to a press input while a camera user interface associated with the first input device is not displayed provides improved control of media capture without cluttering the user interface with additional displayed controls. Doing so also assists the user with composing media capture events and reduces the risk that transient media capture opportunities are missed, which enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can quickly launch and control the camera user interface of their choice by pressing the first input device, without needing to move their hands and/or change input mode.

[0503] In some embodiments, the computer system detects, via the first input device, a respective input at the first input device (e.g., an input physically contacting the first input device), and, in response to detecting the respective input at the first input device and in accordance with a determination that the respective input at the first input device satisfies a respective set of one or more criteria (e.g., prompt-display criteria) that includes a requirement (e.g., based on one or more criteria) that the respective input be maintained (e.g., with less than a threshold amount of movement, with less than a threshold amount of intensity, and/or less than a threshold amount of change in intensity) for more than a threshold amount of time (e.g., 0.1, 0.2, 0.25, 0.5, 1, 3, or 5 s) in order for the respective set of one or more criteria to be satisfied, the computer system displays, via the display generation component, a prompt (e.g., 1822) to provide additional input to display one or more controls (e.g., 622 and/or 1006) for adjusting a function of the first input device (e.g., as illustrated in FIGS. 18J-18K) (e.g., a hint of the gesture input that can be used to display the options user interface such as a movement input that starts at or near a location of the prompt and moves away from the first input device). In some embodiments, the indication of the movement is displayed at a hint location corresponding to the first input device (e.g., a location near the first input device). In some embodiments, the hint location is between the first location and the second location, e.g., that the indication of the movement is displayed in the path of the movement such that the user swipes across the hint location to display the option user interface. In some embodiments, the respective set of one or more criteria (e.g., prompt-display criteria) include a first criterion that is satisfied when the contact input is detected while the option user interface is not displayed. Displaying an indication of a movement used to invoke the option menu for customizing the first input device if detected contact with the first input device lasts longer than a threshold duration provides improved feedback on a state of the computer system without cluttering the user interface with additional displayed controls, which also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the indication provides the user with feedback on available functionality of the hardware button (e.g., the customizability) when the user rests or hesitates on the hardware button, but not if the user is providing another input via the hardware button or merely contacts the hardware button incidentally.

[0504] In some embodiments, while displaying the option user interface (e.g., 1006) (e.g., a user interface that indicates a current operation that has been selected of the plurality of operations to be controlled by inputs directed to the first input device), the computer system detects (e.g., via the first input device and/or via a second input device, such as a touch-sensitive surface located adjacent to the first input device) a first movement input (e.g., 1826) that includes movement (e.g., across a touch-sensitive display that is displaying the option user interface) toward a location of the first input device (e.g., a movement that starts at a third location and ends at a fourth location corresponding to the first input device, wherein the third location is farther from the first input device than the fourth location). In some embodiments, a direction of the movement that starts at the third location and ends at the third location is different than (e.g., at least partially opposite to) a direction of the movement that starts at the first location and ends at the second location. For example, the movement that starts at the first location and ends at the second location is a gesture input swiping away from the first input device towards the center of the touch-sensitive surface, and the movement that starts at the third location and ends at the fourth location is a gesture input swiping towards the edge of the touch-sensitive surface near the first input device. In some embodiments, the first location and the fourth location are both within a first region (e.g., a region of the touch-sensitive display near the first input device), and the second location and the third location are both within a second region different from the first region (e.g., a region of the touch-sensitive display that is closer to the center of the display than the first region). In some embodiments, in response to detecting the first movement input, the computer system ceases displaying at least a portion of the option user interface (e.g., as described with respect to FIGS. 18M-18N) (e.g., ceasing to display some or all of the option user interface). Dismissing the customizable operation menu in response to a gesture input moving towards the first input device (e.g., an inverse movement to the movement used to invoke the menu) provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices. For example, once the user finishes selecting a customizable operation to associate with a hardware button, the user can intuitively dismiss the menu for customization, which confirms to the user that the hardware button association has been set, without moving their hands away from the hardware button, allowing the user to intuitively and efficiently transition to controlling the selected customizable operation via the hardware button.

[0505] In some embodiments, in response to detecting the first movement input, the computer system displays an operation user interface (e.g., 622) for a respective operation of the plurality of operations that can be associated with the first input device (e.g., a user interface that indicates a current status of an operation of the plurality of operations, where the current status can be controlled by inputs directed to the first input device). For example, the operation user interface is a settings control affordance or indicator, such as a menu, slider, gauge, and/or wheel, as described with respect to FIGS. 6A-7 and/or 14A-15. In some embodiments, while displaying the operation user interface (e.g., 622), the computer system detects a second movement input (e.g., 1832) that includes movement (e.g., across a touch-sensitive display that is displaying the operation user interface) toward a location of the first input device (e.g., movement that starts at a fifth location and ends at a sixth location corresponding to the first input device, wherein the fifth location is farther from the first input device than the sixth location). In some embodiments, a direction of the movement that starts at the fifth location and ends at the sixth location is at least partially the same as a direction of the movement that starts at the third location and ends at the fourth location. In some embodiments, a direction of the movement that starts at the fifth location and ends at the sixth location is different than (e.g., at least partially opposite to) a direction of the movement that starts at the first location and ends at the second location. For example, the movement that starts at the first location and ends at the second location is a gesture input swiping away from the first input device towards the center of the touch-sensitive surface, and the movement that starts at the fifth location and ends at the sixth location is a gesture input swiping towards the edge of the touch-sensitive surface near the first input device. In some embodiments, the first location, fourth location, and sixth are all within a first region (e.g., a region of the touch-sensitive display near the first input device), and the second location, third location, and fifth location are all within a second region different from the first region (e.g., a region of the touch-sensitive display that is closer to the center of the display than the first region). In some embodiments, in response to detecting the second movement input, the computer system ceases displaying at least a portion of the operation user interface (e.g., as illustrated in FIGS. 18O-18P) (e.g., ceasing to display some or all of the operation user interface). In some embodiments, while displaying the operation user interface, in response to detecting a third movement input that starts at one location corresponding to the first input device and ends at another location corresponding to the first input device, the computer system performs the respective operation, e.g., adjusting a setting based on the third movement input, as described with respect to FIGS. 6A-7 and/or 14A-15. For example, the third movement input is a gesture swiping laterally along the edge of the touch-sensitive display near the first input device, while the second movement input is a gesture swiping outwards towards the first input device. In some embodiments, in response to detecting a movement input that starts at one location corresponding to the first input device and ends at another location corresponding to the first input device while the operation user interface is not being displayed, the computer system foregoes performing the respective operation. Displaying an operation user interface for a customizable operation associated with a first input device in response to an input dismissing a menu used to select the customizable operation, which can then be dismissed with the same input used to dismiss the menu, provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices. For example, once the user finishes selecting a customizable operation to associate with a hardware button and dismisses the menu for customization, displaying the user interface for the associated customizable operation confirms to the user that the hardware button association has been set and allows the user to intuitively and efficiently transition to controlling the selected customizable operation, while also allowing the user to efficiently and intuitively dismiss the controls for the selected customizable operation.

[0506] In some embodiments, performing the first operation of the respective plurality of operations includes, in accordance with a determination that the third input directed to the first input device satisfies light press criteria (e.g., as described with respect to 616, 630, 1012, and/or 1836), the computer system displays, via the display generation component, a control user interface (e.g., 622) for the first operation (e.g., as described with respect to FIGS. 6I-6J, 6W, 10F, and/or 18Q-18R), wherein the light press criteria include a criterion that is satisfied when the third input includes a press that reaches a first intensity threshold (e.g., an activation intensity threshold; in some embodiments, a force or pressure threshold, e.g., 25 g/cm3, 50 g/cm3, or 100 g/cm3; in some embodiments, a threshold mechanical state corresponding to the first intensity threshold, e.g., detecting physical depression of a mechanical button to a light/partial press state as a substitute measurement for force/pressure) without reaching a second intensity threshold (e.g., a hard/full press threshold; in some embodiments, a force or pressure threshold, e.g., 100 g/cm3, 150 g/cm3, or 200 g/cm³; in some embodiments, a threshold mechanical state corresponding to the second threshold intensity) that is higher than the first intensity threshold (e.g., the third input includes a light/partial press input). In some embodiments, performing the second operation of the respective plurality of operations includes, in accordance with a determination that the third input directed to the first input device satisfies the light press criteria, displaying, via the display generation component, a control user interface for the second operation (e.g., the computer system displays controls for the selected customizable function in response to a light/partial press) (e.g., as described with respect to FIGS. 6A-7). In some embodiments, the light press criteria include a criterion that is satisfied when the respective intensity exceeds a lower threshold intensity, e.g., an activation intensity threshold. In some embodiments, the light press criteria include a criterion that is satisfied when the light/partial press is a single light/partial press, e.g., when the light/partial press is maintained for over a threshold period of time and/or when a second light/partial press is not detected within a threshold period of time after the first light/partial press is released. Displaying a user interface for a customizable operation associated with a first input device in response to a light or partial press input of the first input device provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, providing users with controls for the customizable function associated with a hardware button in response to a light or partial press input assists the user with controlling the customizable function via the hardware button and improves ease of providing additional inputs, such as movement inputs, via the hardware button (e.g., without needing to change intensity).

[0507] In some embodiments, the option user interface (e.g., 1006) is not displayed when the third input is detected. In some embodiments, in response to detecting the third input directed to the first input device and in accordance with a determination that the third input directed to the first input device satisfies multiple-press criteria (e.g., as described with respect to 1820C), the computer system displays, via the display generation component, the option user interface (e.g., as described with respect to FIGS. 18K-18J), wherein the multiple-press criteria include a requirement that a plurality of press inputs were detected at the first input device within a threshold amount of time in order for the multiple press criteria to be satisfied. In some embodiments, the multiple-press criteria include a first multiple-press criterion that is satisfied when the third input includes a first press input with a first intensity that does not exceed an upper threshold intensity (e.g., a first light/partial press) and a second multiple-press criterion that is satisfied when the third input includes a second press input with a second intensity that does not exceed the respective threshold intensity (e.g., a second light/partial press), wherein the second press is detected within a threshold time after detecting the first intensity fall below a lower threshold intensity, wherein the lower threshold intensity is lower than the upper threshold intensity (e.g., the third input includes a double light/partial press, where a second light/partial press is detected quickly after a first light/partial press is released). In some embodiments, the multiple-press criteria include one or more criteria in common with the light press criteria, e.g., taken individually, the first press input and the second press input are light/partial presses. In some embodiments, the light press criteria are not satisfied if the second multiple-press criterion is satisfied, e.g., the light press criteria are satisfied by a single light/partial press input but not a double light/partial press input. In some embodiments, in accordance with a determination that the third input directed to the first input device does not satisfy the multiple-press criteria, the computer system foregoes displaying the option user interface in response to the third input. Displaying a menu used to select a customizable operation to associate with a first hardware button in response to a double press input on the first hardware button provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices. For example, displaying the customization menu in response to a double press input on the first hardware button allows the user to intuitively and efficiently transition between using the first hardware button to control the customizable operation and customizing the operation, informs the user of the wide variety of functionality and provides the user with access to said functionality without the user needing to move their finger off of the first hardware button.

[0508] In some embodiments, the computer system detects a fifth input directed to the first input device (e.g., 616A, 1818B, and/or 1820B), and, in response to detecting the fifth input directed to the first input device and in accordance with a determination that the fifth input directed to the first input device satisfies swipe criteria including a swipe criterion that is satisfied when the fifth input includes more than a threshold amount of movement along the first input device, the computer system displays, via the display generation component, a control (e.g., 622 and/or 1006) for adjusting a function associated with the first input device (e.g., as described with respect to FIGS. 6G-6J and/or 18J-18K). (e.g., a control for selecting which operation is associated with the first input device and/or a control for adjusting a parameter of an operation that is currently associated with the first input device) In some embodiments, the function associated with the first input device is the first operation (e.g., in accordance with a determination that the first operation is associated with the first input device, e.g., via the option user interface), the second operation (e.g., in accordance with a determination that the second operation is associated with the first input device), and/or another operation of the respective plurality of operations. For example, the control is a zoom control, exposure control, filter control, depth-of-field control, and/or lens selection control. In some embodiments, the swipe criteria include a criterion that is satisfied when the fifth input includes a movement that starts a first location on a surface (e.g., a touch-sensitive surface) of the first input device and ends at a second location, different from the first location, on the surface of the first input device. In some embodiments, the swipe criteria include a criterion that is satisfied when the magnitude of the movement exceeds a threshold amount (e.g., a swipe of at least a predetermined portion of the length of the first input device, such as a swipe traveling 25%, 50%, 70%, 90%, or 99% of the length of the button surface). In some embodiments, the swipe criteria include a criterion that is satisfied when the movement is a movement in a particular direction (e.g., along a particular axis of the button, such as the axis running parallel to the edge of the display, and/or in a specific direction along that axis, such as a swipe moving towards the cameras). Displaying a menu used to select a customizable operation to associate with a first hardware button in response to a swipe input on the first hardware button provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. Doing so also provides improved ergonomics of computer systems, for example, by reducing the need for users to move their hands back and forth between different user interface elements and/or input devices. For example, displaying the customization menu in response to a swipe input on the first hardware button allows the user to intuitively and efficiently transition between using the first hardware button to control the customizable operation and customizing the operation, informs the user of the wide variety of functionality and provides the user with access to said functionality without the user needing to move their finger off of the first hardware button.

[0509] In some embodiments, the second input selecting the respective selectable user interface object of the plurality of selectable user interface objects includes an input directed to a location of the respective selectable user interface object on a touch-sensitive surface of the display generation component (e.g., 1008, 1028, 1028, 1054, and/or 1824B) (e.g., a touch input on the touch-sensitive display, such as a tap or gesture input). Selecting a customizable operation to associate with a first hardware button in response to an input directed to the option menu makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can swipe to open the option menu and then quickly tap in the same region to select a customizable operation to associate with a first hardware button.

[0510] In some embodiments, the second input selecting the respective selectable user interface object of the plurality of selectable user interface objects includes an input (e.g., 1824) directed to the first input device (e.g., as described with respect to FIGS. 10C-10D), and the input directed to the first input device satisfies press criteria (e.g., hard/full press criteria or light/partial press criteria). In some embodiments, the light press criteria include a criterion that is satisfied when the input directed to the first input device includes a press with a characteristic intensity that reaches a first intensity threshold without reaching a second intensity threshold that is higher than the first intensity threshold. Selecting a customizable operation to associate with a first hardware button in response to a light or partial press input directed to the first hardware button makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the user can use the hardware button to select the customizable function, then quickly transition to using the hardware button to control the customizable function.

[0511] In some embodiments, in response to detecting, via the first input device, a respective input, the computer system compares a detected intensity of the respective input to a set of intensity thresholds to determine whether the respective input meets one or more criteria for detecting a respective type of gesture (e.g., detecting a touch that is not a press input, detecting a press input, detecting a light press input, and/or detecting a hard press input), wherein the set of intensity thresholds includes one or more intensity thresholds selected based on input from a user of the computer system (e.g., as described with respect to FIG. 6B). In some embodiments, the computer system responds (or forgoes responding) to the respective input based on the determined intensity characteristic, as described throughout with respect to the different responses to different types of hardware button inputs. In some embodiments, based on the determined intensity characteristic, the computer system registers the respective input as a particular type of input, e.g., a light/partial press, a hard/full press, and/or a contact. In some embodiments, the set of intensity thresholds include intensity thresholds that define the various criteria described throughout with respect to FIGS. 6A-7, such as the light press criteria. For example, a user can define the intensity threshold distinguishing light/partial presses from hard/full presses to be lower (e.g., requiring less pressure to be applied to achieve a hard/full press) or higher (e.g., requiring more pressure to be applied to achieve a hard/full press). Using user-customizable intensity thresholds to evaluate inputs detected via a first hardware button makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, user-customized intensity thresholds improve control of user interfaces via the hardware button by tailoring the hardware button's responsiveness to the user's needs or preferences, such as requiring less pressure to achieve a hard/full press for a user with reduced hand strength or requiring more pressure to be applied to achieve a hard/full press for a user who wants to avoid pressing the hardware button by accident.

[0512] In some embodiments, in response to detecting, via the first input device, the respective input and in accordance with a determination that the intensity of the respective input satisfies a first set of intensity criteria, displaying, via the display generation component, an input indicator with first appearance (e.g., as described with respect to FIGS. 6F-6J), (e.g., displaying the input indicator with an indication that the press input has been detected); and For example, the input indicator includes a notch, cut-out, icon, platter, deformation, user interface element, and/or other visual element (e.g., 618, 622, 1605, 1611, 1617, 1621, 1625A, 1625B, 1630A, and/or 1822). In some embodiments, the input indicator is displayed at a location corresponding to the first input device, e.g., at an edge of the display near the location of the first input device. In some embodiments, in response to detecting, via the first input device, the respective input and in accordance with a determination that the intensity of the respective input does not satisfy the first set of intensity criteria, forgoing displaying, via the display generation component, the input indicator with first appearance (e.g., as described with respect to FIG. 6E) (e.g., displaying the input indicator without an indication that the press input has been detected). In some embodiments, in accordance with a determination that the intensity of the respective input satisfies a second set of intensity criteria different from the first set of intensity criteria, the computer system displays, via the display generation component, the input indicator with second appearance different from the first appearance. For example, displaying the input indicator with the first appearance includes displaying the input indicator with a particular size, color, opacity, and/or shape, and displaying the input indicator with the second appearance includes displaying the input indicator with a different size, color, opacity, and/or shape. For example, the computer system displays the input indicator with the first appearance in response to a light/partial press as defined by the user-customized intensity thresholds used to determine the intensity characteristic, and displays the input indicator with the second appearance in response to a hard/full press as defined by the user-customized intensity thresholds used to determine the intensity characteristic. In some embodiments, in accordance with a determination that the intensity of the respective input does not satisfy the one or more criteria for detecting a respective type of gesture (e.g., the first set of intensity criteria, second set of intensity criteria, and/or another set of intensity criteria). In some embodiments, the respective input is detected while the computer system is displaying a configuration user interface associated with the first input device (e.g., a testing user interface), and, while displaying the configuration user interface, the computer system foregoes performing one or more operations (e.g., the plurality of respective operations) in response to detecting the respective input. For example, while in the testing user interface, the computer system displays input indicators in response to inputs via the first input device, but does not capture media or adjust settings in response to inputs via the first input device.

[0513] In some embodiments, displaying the option user interface (e.g., 1006) includes displaying one or more selectable user interface objects of the plurality of selectable user interface objects within a first display region, wherein displaying the one or more selectable user interface objects of the plurality of selectable user interface objects within a first display region includes: distorting an appearance (e.g., blurring, warping, changing color, changing brightness, and/or changing opacity of) of the one or more selectable user interface objects at a first portion of the first display region corresponding to a first edge of the first display region; and distorting an appearance of the one or more selectable user interface objects at a second portion of the first display region, different from the first portion of the display region, corresponding to a second edge of the first display region different from the first edge of the display region (e.g., as described with respect to FIG. 6J1). For example, the plurality of selectable user interface objects are represented in the option user interface as options on simulated dial that curves (e.g., outwards or inwards) relative to the user (or a viewpoint of the user), a front of the user interface, or a surface of the display (e.g., simulating a round dial that can be rotated by lateral movements across the surface of the display), so the selectable user interface objects are distorted (e.g., blurring, warping, changing color, changing brightness, and/or changing opacity of) to appear as though they are curving away from the user (e.g., around the edge of the simulated dial and/or into a plane of the display or user interface) towards the edges of the option user interface display region. In some embodiments, the distortion is progressive and increases toward the edges of the option user interface. In some embodiments, performing a respective operation of the respective plurality of operations (e.g., the first operation and/or second operation) includes displaying a corresponding operation user interface including one or more user interface objects corresponding to a parameter of the respective operation (e.g., such as described with respect to FIGS. 6A-7 and/or 14A-15), including distorting the appearance of the one or more user interface objects near the edges of the corresponding operation user interface, e.g., as described with respect to the option user interface. For example, the one or more user interface objects corresponding to the parameter of the respective operation include a platter or slider for selecting a value of the parameter, and the platter or slider is distorted near the edges of the operation user interface to simulate a curved dial. Distorting the option menu at the edges of the menu area (e.g., to simulate the appearance of a curved dial) provides users with real-time feedback about a state of the computer system without cluttering the user interface with additional displayed controls. Doing so also makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, displaying the option menu as a simulated curved dial intuitively indicates to the user how to adjust the selected customizable operation (e.g., using lateral gesture inputs, as if rotating the dial) and/or that additional customizable operations are available (e.g., the user can “rotate” the dial to display additional options).

[0514] Note that details of the processes described above with respect to method 1100 (e.g., FIGS. 11A-11B) are also applicable in an analogous manner to the methods described above and below. For example, controls for customizable functions as described with respect to method 1100 can be used with the controls based on variable hardware inputs described with respect to method 700, used when capturing media as described with respect to method 900, used when controlling media playback as described with respect to method 1300, and/or used to customize settings adjusted as described with respect to method 1500. For brevity, these details are not repeated below.

[0515] FIGS. 12A-12O illustrate example techniques and systems for customizing playback speed of video media in accordance with some embodiments. For example, FIGS. 12A-12O illustrate automatically identifying portions of video media to slow down during playback.

[0516] At FIG. 12A, computer system 600 displays media viewing user interface 1200, including a representation of media item 1202. Media item 1202 is a multi-frame media item, such as a video or a multi-frame photo capture that can be played back to create a “live” effect. Media viewing user interface 1200 includes edit affordance 1200A, which can be selected to initiate processes for editing media item 1202; play affordance 1200B, a play button for initiating playback of media item 1202; and media carousel 1200C, which includes thumbnails of media item 1202 and other media items that can be viewed in media viewing user interface 1200 (e.g., a camera roll).

[0517] Additionally, as illustrated in FIG. 12A, media viewing user interface 1200 includes speed effect affordance 1200D, a badge with the text “APEX.” Speed effect affordance 1200D indicates that computer system 600 has identified at least a portion of media item 1202 that could be slowed down to create a cinematic effect. In some embodiments, computer system 600 analyzes the contents of media items, including video data, audio data, and/or associated metadata to identify portions of the media items that include high amounts of action, high amounts of camera movement, high levels of detail, and/or other subject matter identified as exciting, important, or distinctive as “apex moments.” In some embodiments, computer system 600 automatically identifies whether at least one apex moment is present in a media item when viewing the media item in media viewing user interface 1200, when initiating playback of the media item, and/or when capturing the media item.

[0518] Media item 1202, illustrated in FIG. 12B as sequential frames A through H, depicts a ball rolling along a surface down a hill, off a ramp, into the air, and back down onto the surface. Computer system 600 identifies the highlighted segment D-E as an apex moment of media item 1202. For example, the video data (e.g., the frames of media item 1202) and/or metadata such as depth sensor data and/or motion sensor data of media item 1202 can be analyzed to determine that the ball jumps off the ramp into the air during segment D-E, indicating a high level of action in those segments. As another example, the audio data of media item 1202 can be analyzed to detect clapping and cheering during segment D-E, indicating a high level of excitement in those segments. Accordingly, computer system 600 selects the segment D-E to slow down during playback, showing the jump off of the ramp with a cinematic, slow motion (e.g., slo-mo) effect. Media item 1202 is depicted with only eight frames (and the apex moment D-E as only two frames) for clarity of description; it is to be understood that the techniques described herein can be scaled to media and apex moments of any number of frames.

[0519] Other examples of potential apex moments include: a segment of a ball flying towards a goal in a sports game, a segment right before music starts at a concert, a segment of a firework exploding in the air, a segment of a dog jumping off the ground to catch a treat, a segment after a dolly shot running up to a subject, a segment rotating quickly around a subject, a montage, and/or a fight scene. In some embodiments, in addition to selecting segments of a media item to slow down during playback, computer system 600 may select segments of a media item to speed up. For example, based on the video data, audio data, and/or associated metadata, computer system 600 can identify repetitive, slow, or uninteresting segments of a media item to fast-forward, such as a segment depicting transit between different locations, a theater filling before a performance begins, or time passing between dives at a swim meet.

[0520] At FIG. 12A, computer system 600 detects input 1204 selecting play affordance 1200B. In response, at FIG. 12C, computer system 600 begins playback of media item 1202, during which media viewing user interface 1200 is displayed with pause affordance 1200F replacing play affordance 1200B and playback timeline 1200E, a sequential representation of the segments of media item 1202, replacing media carousel 1200C. During playback of media item 1202, computer system 600 slows down segment D-E to appear at half speed compared to the other segments of media item 1202. As illustrated in FIG. 12C, the representations of frames D and E in playback timeline 1200E are wider than to other segments represented in playback timeline 1200E, indicating the location of the slowed-down portion within media item 1202.

[0521] FIG. 12D illustrates an example timing diagram for playing back media item 1202 with the apex moment, segment D-E, slowed down to half speed. The first line of the diagram represents the capture of media item 1202. Media item 1202 is captured at a capture frame rate of X frames per second, and the duration of segment D-E during capture (e.g., the real-time duration of segment D-E) is T seconds. Playing back media item 1202 at a playback frame rate of X frames per second throughout, as illustrated in the second line of the diagram, results in a normal-speed playback, where the ball appears to move at the speed at which it was actually moving during capture, and where the playback duration of segment D-E is still T seconds.

[0522] The third line of the diagram represents playback of media item 1202 with segment D-E slowed down. As illustrated in the third line of FIG. 12D, computer system plays media item 1202 back at the playback frame rate of X frames per second. Segments A-C and F-H are thus played back at their normal speed. However, interpolated frames D′ and E′ are inserted between frames D-E and E-F. Accordingly, the original frames D and E are effectively played back at a frame rate of 0.5×, appearing at half speed, and the playback of segment D-E, now including frames D-D′-E-E′, lasts 2 T seconds.

[0523] Referring to FIG. 12E, interpolated frames D′ and E′ are extra video frames generated by computer system 600. For example, using image processing, motion intelligence, and/or other artificial intelligence techniques to analyze the contents of media item 1202 before, during, and/or after segment D-E, computer system 600 generates interpolated frame D′, showing the ball in a position between its position in frame D and its position in frame E along an inferred path of movement, and interpolated frame E′, showing the ball in a position between its position in frame E and its position in frame F along the inferred path of movement. For example, if media item 1202 was captured at a lower frame rate such as 30 FPS, although original frames D and E are effectively played back at 15 FPS (e.g., a frame rate that can be perceived by the human as choppy), the insertion of interpolated frames D′ and E′ maintains the actual playback frame rate at 30 FPS. Accordingly, the half-speed movement of the ball depicted in the apex moment D-E appears smooth. In some embodiments, computer system 600 may generate more than one interpolated frame to insert between original frames of media item 1202, for example, inserting three interpolated frames between each pair of original frames to slow down playback to a quarter speed.

[0524] FIGS. 12F-12H illustrate additional example timing diagrams for playing back media item 1206, a media item including sequential frames A-P, with a half-speed apex moment, segment G-J. As illustrated in the first lines of FIGS. 12F-12H, media item 1206 is captured at a frame rate of 2×FPS (e.g., a higher frame rate, such as 60 FPS or 120 FPS), and the real-time duration of segment G-J is T seconds.

[0525] As illustrated in the second line of FIG. 12F, in some embodiments, computer system 600 plays back segments A-F and K-P at a playback frame rate of 2×FPS (e.g., the capture frame rate), such that movement in the non-apex segments appears at normal speed, and plays back segment G-J at a playback frame rate of X FPS (e.g., half the capture frame rate), such that the playback duration of segment G-J is 2 T seconds and movement in segment G-J appears at half speed. For higher frame rate video, such as 60 or 120 FPS video, the frame rate can be halved without movement appearing choppy. Accordingly, segment G-J can be slowed to half speed without needing to insert interpolated frames. However, as illustrated in the third line of FIG. 12F, computer system 600 can generate and insert interpolated frames (e.g., G′, H′, I′, and J′) in order to play back media item 1206 at a constant frame rate of 2×FPS and/or to slow down segment G-I to appear slower than half speed (e.g., playing segment G-G′-H-H′-I-I′-J-J′ at X FPS, extending the duration to 4 T seconds).

[0526] As illustrated in the second line of FIG. 12G, in some embodiments where the capture frame rate of 2×FPS is a high frame rate capture, computer system 600 may play back media item 1206 at X FPS, but drop half of the original frames such that the movement in media item 1206 appears at its normal (e.g., real-time) speed. Accordingly, in some embodiments, computer system slows down segment G-J during playback by playing back all of the frames of segment G-J at X FPS, e.g., refraining from dropping any frames from segment G-J, as illustrated in the third line of FIG. 12G.

[0527] As illustrated in FIG. 12H, in some embodiments, computer system 600 gradually transitions the speed of playback around the slowed-down apex moment. As illustrated in the first line of FIG. 12H, segment E-F (leading into segment G-I) and segment K-L (leading out of segment G-J) each have a real-time duration of T′. During playback of media item 1206, computer system 600 plays back segments E-F and K-L at 1.5×, extending their duration to 1.5 T′ such that the segments appear at two-thirds speed, ramping between the normal speed and the half-speed of the slowed down segment G-J. In some embodiments, computer system 600 may only slow down one of segment E-F (e.g., only gradually ramping the speed down) or segment K-L (e.g., only gradually ramping the speed back up) or slow down segments E-F and K-L by different amounts. In some embodiments, computer system 600 may ramp the speed before and/or after segment G-J over different segment lengths (e.g., 0.25 seconds, 0.5 seconds, and/or 1 second of real-time capture). In some embodiments, computer system 600 may generate interpolated frames as needed to slow down the ramping segments without changing the frame rate (e.g., as discussed with respect to FIG. 12F). In some embodiments, computer system 600 may gradually ramp the frame rate of the ramping segments, for instance, playing frames of the ramping segments successively farther apart or successively further together.

[0528] At FIG. 12I, computer system 600 displays a representation of media item 1202 in media viewing user interface 1200 (e.g., as described with respect to FIG. 12A), computer system 600 detects an input requesting to edit media item 1202, such as input 1210 selecting edit affordance 1200A and/or input 1212 selecting speed effect affordance 1200D. In response, at FIG. 12J, computer system 600 displays video editing user interface 1214 for editing media item 1202. Video editing user interface 1214 includes finish affordance 1214A, which can be selected to finalize edits made to media item 1202 and return to media viewing user interface 1200; cancel affordance 1214B, which can be selected to revert edits made to media item 1202 and return to media viewing user interface 1200; and timeline editing elements 1214C, including a representation (e.g., thumbnails) of sequential segments of media item 1202, framing affordances around the representation of sequential segments that can be dragged to cut media item 1202 at different points, and a timeline element graphically indicating the effective playback speed of the original frames of media item 1202. As illustrated in FIG. 12J, computer system 600 displays one or more indicators 1216 of segment of media item 1202 selected to slow down during playback (e.g., the identified apex moment), such as highlighting or framing the identified segment in the representation of sequential segments and/or displaying a speed effect badge above the segment in the representation of sequential segments. Additionally, the timeline element graphically indicates that the identified segment will be slowed down during playback, for instance, represented by the tick marks in the timeline element (e.g., representing frames, units of time, and/or other subdivided segments of media item 1202) being spaced twice as far apart below the identified apex segment than below the other segments of media item 1202.

[0529] While displaying media item 1202 in video editing user interface 1214, computer system 600 detects input 1218 directed to timeline editing elements 1214C, corresponding to an input editing the playback timing profile of media item 1202. In response, computer system 600 initiates a process for changing the playback timing profile of media item 1202, such as selecting one or more segments of media item 1202 to slow down or speed up. For example, input 1218 may include a “stretch” gesture, e.g., two contacts that initially frame a representation of a segment of media item 1202 in the sequential segments and/or the timeline element then slide apart in opposite directions, which results in computer system 600 slowing down the “stretched” segment. As another example, input 1218 may include a “pinch” gesture, e.g., two contacts that initially frame a representation of a segment of media item 1202 then slide towards each other, which results in computer system 600 slowing down the “pinched” segment. As another example, input 1218 may include a tap input directed to the speed effect badge, which provides access to different speed controls, such as a slider for precisely selecting the effective frame rate of a segment and/or an affordance for ramping speed in certain segments.

[0530] As illustrated by the timing diagram in FIG. 12K, in response to input 1218, computer system 600 edits the playback timing profile of media item 1202 such that, instead of playing back segment D-E at half speed, computer system 600 plays back segment E-G at one-third speed. Accordingly, the user can edit the apex moment to start and end at different times, to last a different duration, and/or to appear at a different speed than automatically selected by computer system 600. As illustrated in FIG. 12L, computer system 600 updates video editing user interface 1214 as inputs for editing the playback timing profile of media item 1202 are detected, moving the one or more indicators 1216 and changing the spacing of tick marks on the timeline element to indicate the new apex moment and playback timing profile of media item 1202.

[0531] FIG. 12M illustrates media item 1220 as sequential frames A-H, depicting a ball rolling along a surface down a hill, off a ramp, into the air, and back down onto the surface (e.g., as in media item 1202) before bouncing back up and towards the camera. As described with respect to selecting segment D-E of media item 1202 to slow down during playback, computer system 600 selects both highlighted segments D-E and G-I to slow down during playback, for instance, as both segments depict high amounts of action. In some embodiments, computer system 600 selects to slow down segment G-I more than segment D-E during playback, for instance, as segment G-I includes a higher amount of action with the ball flying towards the camera. When editing media item 1220, computer system 600 displays video editing user interface 1214 as illustrated in FIG. 12N, for instance, highlighting and displaying speed effect badges over both segments in timeline editing elements 1214C, and displaying the tick marks of the timeline element representing segment G-I spaced apart further than the tick marks representing segment D-E.

[0532] FIG. 12O illustrates a timing diagram for media item 1222, for instance, a 2×FPS capture consisting of frames A-P, with a playback timing profile combining the techniques described herein to produce a complex, cinematic playback speed profile. As illustrated in FIG. 10O, segment A-D (e.g., a low-interest moment identified by computer system 600 and/or a segment selected by the user in video editing user interface 1214) is sped up during playback, being played back at 4×FPS (e.g., or dropping half of the frames) to appear at double speed. Segments G-J and N-P (e.g., apex moments identified by computer system 600 and/or selected by the user) are played back at X FPS, appearing slowed down. However, as interpolated frames N′, O′, and P′ are inserted into segment N-P, segment N-P appears at one quarter speed while segment G-J appears at half speed. Segment E-F ramps down to the half-speed playback of segment G-J, being played back at 1.5×FPS and appearing at two-thirds speed, and segment K-M is played at normal speed. In some embodiments, computer system 600 automatically selects the playback frame rates and generates the interpolated frames illustrated in FIG. 12O based on the contents of media item 1222, as described with respect to FIG. 12B.

[0533] FIG. 13 is a flow diagram illustrating method 1300 for customizing playback speed of video media, in accordance with some embodiments. The method is performed at a computer system (e.g., 100, 300, 500, and/or 600) that is in communication with a display generation component (e.g., 606) (e.g., a display controller; a touch-sensitive display system; a display (e.g., integrated and/or connected), a 3D display, a transparent display, a projector, and/or a heads-up display), e.g., as illustrated in FIGS. 6A-6B. In some embodiments, the computer system is optionally in communication with one or more input devices (e.g., 602A, 602B, 602C, 602D, and/or a touch sensitive surface of display 606), such as mechanical (e.g., physically depressible), solid-state, intensity-sensitive, and/or touch-sensitive (e.g., capacitive) hardware buttons and/or surfaces. In some embodiments, the computer system is optionally in communication with one or more cameras (e.g., 604A, 604B, 604C, and/or 604D), such as a rear (user-facing) camera and a forward (environment-facing) camera and/or a plurality of cameras with different lenses, such as a standard camera, a telephoto camera, and/or a wide-angle camera. In some embodiments, the computer system is optionally in communication with one or more sensors, such as camera sensors, optical sensors, depth sensors, capacitive sensors, intensity sensors, motion sensors, vibration sensors, and/or audio sensors.

[0534] The computer system receives (1302) a request (e.g., 1204) to play a video media item (e.g., 1202, 1206, 1220, and/or 1222) (e.g., a multi-frame media capture, such as a standard video, a spatial video, and/or a multi-frame photo capture). in response to receiving the request to play the video media item, the computer system plays (1304) the video media item, including, while playing the video media item, decreasing (1306) (e.g., automatically and/or in response to a user input, such as an input selecting to enable cinematic speed adjustments) a playback speed (e.g., the speed at which time appears to advance in the video with respect to real time, wherein advancing one second of capture time (e.g., “real time”) per second of playback appears to the user as “normal” speed, advancing more than one second of capture time per second of playback appears to the user as fast motion/sped up video, and advancing less than one second of capture time per second of playback appears to the user as slow motion/slowed down video) of a respective portion (e.g., D-E of media item 1202, G-J of media item 1206, D-E and G-I of media item 1220, and/or G-J and N-P of media item 1222) of the video media item (e.g., the first video segment appears slowed down during playback with respect to the timescale of capture (e.g., real time) and/or with respect to the timescale of other segments of the video media item).

[0535] The respective portion of the video media item is automatically selected (e.g., by the computer system or by a remote computer system) based on content of the video media item (e.g., as described with respect to FIGS. 12C-12D, 12F-12H, 12K, and/or 12O) (the computer system automatically detects at least one “apex” segment of the video media item, which is a portion of the video media item depicting relatively high levels of activity, motion, detail, and/or significance, e.g., compared to at least one other segment of the video media item), including: in accordance with a determination that a first portion of the video media item satisfies a set of one or more video characteristic criteria, slowing down the first portion of the video media item relative to at least one other portion of the video media item while playing the video media item (1308) (e.g., the respective portion includes the first portion); and in accordance with a determination that a second portion of the video media item, different from the first portion of the video media item, satisfies the set of one or more video characteristic criteria, slowing down the second portion of the video media item relative to at least one other portion of the video media item while playing the video media item (1310) (e.g., the respective portion includes the second portion). In some embodiments, the computer system selects the respective portion (e.g., determines that the first video segment satisfies the one or more video characteristic criteria) based visual content (e.g., video component), audio content, spatial content (e.g., depth information and/or motion data), and/or other metadata (e.g., capture specifications, sensor data, image processing data, audio processing data, and/or user information) associated with the video media item. In some embodiments, computer system identifies the first video segment while displaying, via the display generation component, a representation of the video media item, e.g., in a media viewing user interface or a media editing user interface. In some embodiments, the set of one or more video characteristic criteria include a criterion that is met when a portion of the video media item includes (e.g., depicts) more than a threshold amount of activity, a criterion that is met when a portion of the video media item includes more than a threshold change in activity, a criterion that is met when a portion of the video media item includes more than a threshold amount of motion, a criterion that is met when a portion of the video media item includes more than a threshold change in motion, a criterion that is met when a portion of the video media item includes more than a threshold amount of detail, and/or a criterion that is met when a portion of the video media item includes content of determined significance (e.g., a recognized person, pet, and/or other subject).

[0536] In some embodiments, decreasing the playback speed of the respective portion of the video media item, including slowing down the first and/or second portions of the video media item, includes reducing the frame rate of playback of the respective portion. For example, for a video media item captured at 60 FPS, the computer system plays back the first and/or second portions at 30 FPS, so the timescale of the respective portion appears to the user at half speed. In some embodiments, decreasing the playback speed of the respective portion of the video media item, including slowing down the first and/or second portions of the video media item, includes including (e.g., playing) additional frames during playback of the first and/or second portions, e.g., by adding interpolated frames (e.g., if the video media item was captured at a lower frame rate and/or cannot be slowed down without negatively impacting playback quality, for instance, by reducing the playback frame rate below a desired playback frame rate) and/or foregoing skipping/dropping frames from the first and/or second portion (e.g., if the video media item was captured at higher frame rate than the desired playback frame rate). For example, for a video media item captured at 60 FPS, the computer system adds interpolated frames to the first and/or second portions of the video media item at a 1:1 ratio to effectively turn the first and/or second portions into 120 FPS video, such that playback of the first and/or second portions of the video media item at 60 FPS appears at a half-speed timescale. In some embodiments, decreasing the playback speed of the respective portion of the video media item, including slowing down the first and/or second portions of the video media item, includes increasing the frame rate of playback of a different segment of the video media item and/or dropping additional frames during playback of the different segment. For example, the computer system “fast forwards” non-apex moments.

[0537] In some embodiments, the computer system identifies the respective portion of the video media item, including the first and/or second portions, and in response to identifying the first video segment, the computer system displays, via the display generation component, a prompt (e.g., 1200D) (e.g., text, symbols, icons, highlighting, and/or other visual elements) for decreasing the playback speed of the respective portion of the video media item. In some embodiments, the prompt includes an indication of the first video segment, e.g., highlighting or otherwise visually indicating the “apex moment” portion of the video media item that satisfies the video characteristic criteria. In some embodiments, the prompt includes and/or is displayed concurrently with one or more selectable UI objects (e.g., affordances) that, when selected, initiate a process for changing the playback speed of the video media item to slow down the first video segment relative to the first timescale during playback. Automatically detecting and slowing down playback of portions of a video media item with certain characteristics provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the computer system automatically slows down dynamic or exciting portions of a video, such as portions with high amounts of content movement, camera movement, detail, and/or other detected subject matter, automatically creating a cinematic effect without requiring extensive editing of the video media item by the user. Doing so also provides improved feedback on a state of a computer system, indicating the computer system's capabilities with respect to modifying playback speed of video media items.

[0538] In some embodiments, playing the video media item includes, while playing the video media item, ramping (e.g., gradually increasing or decreasing) a playback speed of one or more transition portions of the video media item between a first playback speed (e.g., an initial or final playback speed; in some embodiments, a normal (e.g., not slowed) playback speed for the video media item) and a second playback speed that is lower than the first playback speed (e.g., as described with respect to FIGS. 12H and/or 12O). In some embodiments, the one or more transition portions are adjacent to a segment of the respective portion of the video media item (e.g., immediately before or immediately after at least one detected apex moment of the respective portion), and decreasing the playback speed of the respective portion of the video media item includes playing the segment of the respective portion of the video media item at the second playback speed (e.g., as described with respect to FIG. 12H). For example, the computer system gradually decreases (e.g., ramps down) the playback speed of the video media item leading into a slowed-down portion of the video media item and/or gradually increases (e.g., ramps up) the playback speed of the video media item coming out of a slowed-down portion of the video media item. Automatically ramping the playback speed of the video media item near the respective portion of the video media item provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the computer system automatically smooths down transitions between portions of the video media item played at different playback speeds, creating a cinematic effect without requiring extensive editing of the video media item by the user.

[0539] In some embodiments, the one or more transition portions of the video media item includes a first transition portion of the video media item (e.g., E-F, as described with respect to FIG. 12H), wherein the first transition portion of the video media item is before (e.g., immediately before) the segment of the respective portion of the video media item (e.g., G-J, as described with respect to FIG. 12H). In some embodiments, ramping the playback speed of the first transition portion includes decreasing the playback speed of the first transition portion from the first playback speed to the second playback speed, e.g., gradually lowering the playback speed leading into the slowed-down apex moment.

[0540] In some embodiments, the one or more transition portions of the video media item includes a second transition portion of the video media item (e.g., K-L, as described with respect to FIG. 12H), wherein the second transition portion of the video media item is after (e.g., immediately after) the segment of the respective portion of the video media item (e.g., G-J, as described with respect to FIG. 12H). In some embodiments, ramping the playback speed of the second transition portion includes decreasing the playback speed of the second transition portion from the second playback speed to the first playback speed, e.g., gradually increasing the playback speed coming out of the slowed-down apex moment.

[0541] In some embodiments, while playing the video media item, the computer system decreases a playback speed of a second respective portion of the video media item (e.g., as described with respect to FIGS. 12M-12O), different from the respective portion of the video media item. In some embodiments, the second respective portion of the video media item is automatically selected based on the content of the video media item, (e.g., the computer system identifies both the respective portion of the video media item and the second respective portion of the video media item as apex moments) including: in accordance with a determination that a fourth portion of the video media item satisfies the set of one or more video characteristic criteria, slowing down the fourth portion of the video media item relative to at least one other portion of the video media item while playing the video media item; and in accordance with a determination that a fifth portion of the video media item satisfies the set of one or more video characteristic criteria, slowing down the fifth portion of the video media item relative to at least one other portion of the video media item while playing the video media item. For example, the computer system detects multiple apex moments in a video, and slows down each of the multiple apex moments during playback. In some embodiments, the respective portion of the video media item and the second respective portion of the video media item are separated by another portion of the video media item not included in either respective portion (e.g., a non-apex moment). In some embodiments, the computer system slows down the respective portion of the video media item and the second respective portion of the video media item by the same amount; in some embodiments, the computer system slows down the respective portion of the video media item and the second respective portion of the video media item by different amounts. Automatically detecting and slowing down playback of multiple different portions of a video media item with certain characteristics provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the computer system automatically slows down multiple dynamic or exciting portions of a video, such as different portions with high amounts of content movement, camera movement, detail, and/or other detected subject matter, automatically creating a cinematic effect without requiring extensive editing of the video media item by the user. Doing so also provides improved feedback on a state of a computer system, indicating the computer system's capabilities with respect to modifying playback speed of video media items.

[0542] In some embodiments, playing the video media item includes, while playing the video media item, increasing the playback speed of a third respective portion of the video media item different from the respective portion of the video media item (e.g., as described with respect to segment ABCD in FIG. 12O). In some embodiments, the third respective portion of the video media item is automatically selected based on the content of the video media item, including: in accordance with a determination that a sixth portion of the video media item does not satisfy the set of one or more video characteristic criteria and in accordance with a determination that the sixth portion of the video media item satisfies a second set of one or more video characteristic criteria, speeding up the sixth portion of the video media item relative to at least one other portion of the video media item while playing the video media item. For example, the computer system automatically speeds up (e.g., fast forwards) certain portions of the video media item other than the detected apex moments. For example, the second set of one or more criteria include criteria satisfied when a portion of the video media item is repetitive, slow, low-motion, low-detail, and/or lacking content of determined significance. Automatically detecting different portions of a video media item to slow down and speed up provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, the computer system automatically slows down dynamic or exciting portions of a video, such as portions with high amounts of content movement, camera movement, detail, and/or other detected subject matter, automatically creating a cinematic effect without requiring extensive editing of the video media item by the user. Doing so also provides improved feedback on a state of a computer system, indicating the computer system's capabilities with respect to modifying playback speed of video media items.

[0543] In some embodiments, the respective portion of the video media item includes a plurality of frames, and decreasing the playback speed of the respective portion of the video media item includes inserting a plurality of interpolated fames into the plurality of frames for playback (e.g., as described with respect to FIGS. 12D-12F and/or 12O). In some embodiments, the plurality of interpolated frames includes a first interpolated frame (e.g., D′, as described with respect to FIG. 12E) generated (e.g., by the computer system) based on a first frame (e.g., D) of the plurality of frames and a second frame (e.g., E) of the plurality of frames, wherein the first interpolated frame is inserted between the first frame and the second frame for playback. In some embodiments, the plurality of interpolated frames includes a second interpolated frame (e.g., E′) generated (e.g., by the computer system) based on the second frame (e.g., E) of the plurality of frames and a third frame (e.g., F) of the plurality of frames, wherein the second interpolated frame is inserted between the second frame and the third frame for playback. For example, the computer system generates additional frames to insert between the existing (e.g., captured) frames of the apex moment. For example, the computer system uses motion intelligence technology to generate frames representing one or more intermediate states between two captured frames. Slowing down the respective portion of the video media item by inserting interpolated frames into the respective portion provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs, amount of time, and amount of video data needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, by interpolating frames to insert into the apex moment segment, the computer system improves the appearance of the slowed-down portion during playback, allowing the captured video frames to be played back at a slower frame rate without reducing the actual frame rate of playback to a point where playback quality degrades (e.g., below 24 FPS), which further allows the cinematic slowing effects to be applied even to video media items captured at lower frame rates.

[0544] In some embodiments, while displaying, via the display generation component, a representation of the video media item (e.g., in a media viewing and/or media editing user interface), the computer system receives a request (e.g., 1210 and/or 1212) to edit a playback speed profile of the video media item (e.g., as described with respect to FIG. 12I), and in response to receiving the request to edit the playback speed profile of the video media item, the computer system displays a set of one or more selectable user interface objects (e.g., 1214C, as described with respect to FIG. 12J) (e.g., touch controls; in some embodiments, included in an editing user interface). In some embodiments, the set of one or more controls includes a first selectable user interface object that, when selected, selects a seventh portion of the video media item to be slowed down, wherein slowing down the seventh portion of the video media item includes decreasing a playback speed of the seventh portion of the video media item during playback of the video media item, and a second selectable user interface objects that, when selected, selects a first playback speed for an eighth portion of the video media item, wherein selecting the first playback speed for the eight portion of the video media item causes the eighth portion of the video media item to be played at the first playback speed during playback. For example, the first control can be used to select a start point, end point, and/or duration of a portion of the video to slow down during playback. In some embodiments, the seventh (e.g., selected) portion includes some or all of the respective (e.g., automatically detected) portion. For example, the second control can be used to adjust how much a portion of the video is slowed down during playback. In some embodiments, the eighth portion includes some or all of the seventh portion and/or the respective portion. Providing user interface controls for modifying which portion(s) of the video media item is slowed down and by how much provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, in addition to automatically identifying the respective portion of the video media item to slow down, the computer system allows the user to modify the speed profile of the video media item.

[0545] In some embodiments, while displaying the set of one or more selectable user interface objects, the computer system displays (e.g., 1216) an indication of the respective portion of the video media item (e.g., as described with respect to FIGS. 12J, 12L, and/or 12N) (e.g., the automatically detected apex moment). For example, the computer system labels, marks, and/or visually emphasizes the respective portion of the video media item, e.g., in a timeline representing the video media item. In some embodiments, the computer system displays both the indication of the respective portion of the video media item and an indication of any additional/different portion of the video media item selected using the second control. Displaying an indication of an automatically-detected apex moment in a video provides improved control and performance of media playback, making the user-system interface more efficient by reducing the number of inputs and amount of time needed to produce desirable video speed effects, which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently. For example, by indicating the automatically detected portion, the computer system provides the user with a baseline for cinematic speed effects, which the user can then quickly and easily adjust.

[0546] In some embodiments, while displaying, via the display generation component, a representation of the video media item (e.g., in a media viewing and/or media editing user interface), in accordance with a determination that at least one portion of the video media item satisfies the set of one or more video characteristic criteria, the computer system displays, via the display generation component, a graphical indication (e.g., 1200D and/or 1216) (e.g., a selectable user interface object, icon, label, and/or text) that the at least one portion of the video media item has been automatically selected for playback with reduced speed. For example, the computer system displays an indication that an apex moment has been detected in the video media item. In some embodiments, the graphical indication includes a selectable user interface object. In some embodiments, the graphical indication can be selected to enable or disable decreasing the speed of the detected apex moment during playback. Displaying a graphical indication that a portion of a video has been automatically selected for playback with slowed-down speed effects provides improved feedback on a state of a computer system, indicating the computer system's capabilities with respect to modifying playback speed of video media items.

[0547] In some embodiments, the graphical indication is displayed in a media editing user interface (e.g., 1214). In some embodiments, the graphical indication includes a selectable user interface object that, when selected, initiates a process for changing a playback speed of the at least one portion of the video media item during playback (e.g., as described with respect to FIG. 12I). In some embodiments, selecting the graphical indication enables decreasing the speed of the selected portion during playback (e.g., enables the cinematic speed effects). In some embodiments, selecting the graphical indication disables decreasing the speed of the selected portion during playback (e.g., turns off the cinematic speed effects). In some embodiments, selecting the graphical indication causes the computer system to display a user interface for editing the speed profile of the video media item, e.g., including the selectable user interface objects for modifying the speed profile.

[0548] Note that details of the processes described above with respect to method 1300 (e.g., FIG. 13) are also applicable in an analogous manner to the methods described above and below. For example, the processes described with respect to method 1300 can be used when playing back media captured using the methods described with respect to methods 700, 900, 800, 1500, and/or 1700. For brevity, these details are not repeated below.

[0549] FIGS. 14A-14Z illustrate example techniques and systems for controlling settings of a computer system based on movement characteristics of hardware inputs in accordance with some embodiments. For example, FIGS. 14A-14Z illustrate adjusting settings continuously (e.g., through an ordered set of values) based on movement detected during contact with the hardware button and/or touch-sensitive display, continuing to adjust settings after contact ends based on movement detected near the end of contact, and “snapping” to particular settings values when movement detected during contact and/or near the end of contact satisfies certain conditions, such as moving in the direction of or with enough “momentum” to reach the next particular settings value.

[0550] As illustrated in FIG. 14A, computer system 600 displays camera user interface 612 (e.g., in the quiet or ready-to-capture mode) and settings control 622 for an exposure setting of camera user interface 612, for example, as described with respect to FIGS. 6A-6AM, 7, 10A-10V, and 11. For clarity, the lower panel of FIG. 14A and FIGS. 14B-14Z depict the only portion of computer system 600 including first button 602A and the display of settings control 622 (e.g., the region of display 606 proximate to first button 602A); it is to be understood that, during the processes described with respect to FIGS. 14A-14B-14Z, camera user interface 612 is displayed and updated, for instance, as described with respect to FIGS. 6A-6AM, 7, 10A-10V, and 11. Additionally, in FIGS. 14A-14Z, first button 602A is depicted with dotted lines demarcating quadrants of the touch-sensitive surface of first button 602A in order to better illustrate movement inputs detected via first button 602A. In the foregoing description of FIGS. 14A-14Z, directional terms such as “right,” “left,” “up,” and “down” are used with respect to the page. Accordingly, in the embodiment of computer system 600 illustrated in these figures, “left” refers to the direction approaching (e.g., moving closer to) to the set of cameras (e.g., first camera 604A, second camera 604B, third camera 604C, and fourth camera 604D), “right” refers to the direction moving away from the set of cameras, “up” refers to the direction away from computer system 600/out from the surface of first button 602A, and “down” refers to the direction towards computer system 600/into the surface of first button 602A.

[0551] At FIG. 14A, while displaying settings control 622 for the exposure setting, computer system 600 detects contact 1402, where finger 608 contacts (e.g., touches and/or lightly presses) first button 602A. Contact 1402 is detected at a first location on first button 602A, starting at a point near the right side of first button 602A between the middle-right and right quadrants of the touch-sensitive surface of first button 602A.

[0552] Alternatively, in some embodiments, computer system 600 detects contact 1403 directed to settings control 622 on the touch-sensitive surface of display 606, in particular, to a location on settings control 622 that corresponds to the location of contact 1402 on first button 602A. For example, settings control 622 is displayed below first button 602A, and contact 1402 is directed to a point on settings control 622 directly below the point near the right side of first button 602A between the middle-right and right quadrants. Accordingly, in some embodiments, the techniques described herein as being applied based on particular locations and movements of contact directed to first button 602A can likewise be applied based on corresponding locations and movements of contact directed to settings control 622 on the touch-sensitive surface of display 606. For illustrative purposes, finger 608 is not depicted in all of FIGS. 14B-14Z; instead, a filled dot (such as contact 1402) is used to illustrate the current location of an ongoing contact with first button 602A (e.g., and/or a corresponding location of an ongoing contact with settings control 622 via the touch-sensitive surface of display 606) and an open dot is used to illustrate a lifted contact, e.g., when finger 608 is no longer touching first button 602A and/or settings control 622. In some embodiments, ongoing contact with first button 602A is registered while first button 602A is in hardware button state (B), (C), and/or (D) (e.g., finger 608 rests on or lightly presses first button 602A), and lifted contact is registered when first button 602A enters hardware button state (A).

[0553] As described with respect to FIGS. 6A-6AM and 10A-10W, while first button 602A is associated with (e.g., customized to perform) particular settings adjustment operations, computer system 600 displays settings control 622 with a representation of a scale of values for the associated setting, including tick marks representing ordered values in consistent intervals. FIG. 14B provides more detailed views of the scales of values and the representations of the scales of values situated within settings control 622 for (e.g., from top to bottom) the exposure setting, the zoom setting, and the filter intensity setting. The top of FIG. 14B depicts full scale of exposure values 1404, ranging from −1.0 (e.g., corresponding to the darkest provided exposure setting, e.g., the fastest simulated shutter speed, fastest ISO speed, and/or smallest aperture size) to +1.0 (corresponding to the brightest provided exposure setting, e.g., the slowest simulated shutter speed, slowest ISO speed, and/or largest aperture size), where each tick mark represents an interval of 0.1. The center of FIG. 14B depicts full scale of zoom values, 1406 ranging from 0.5× (e.g., a wide-angle magnification, e.g., captured using a wide-angle lens) to 12× (e.g., a telephoto magnification, e.g., captured using an 8× zoom lens and further digital magnification), where each tick mark represents an interval of 0.1×. As illustrated in FIG. 14B, although the value intervals between each tick mark are consistent (e.g., 0.1× zoom), the scale of zoom values is displayed with the tick marks spaced increasingly close together as the zoom level increases, such that the distance between 0.5× and 1.0× on the scale is the same as the distance between 1.0× and 2.0×, between 0.2× and 4.0×, and between 4.0× and 8.0×. In some embodiments, the spacing between subsequent tick marks is successively compressed, for instance, as a logarithmic scale of values. The bottom of FIG. 14B depicts full scale of filter intensity values 1408, ranging from 0% (e.g., not applying the filter effects) to 100% (e.g., applying the filter effects to their greatest extent), where each tick mark represents an interval of 2.5%.

[0554] The representations of the scales of settings values displayed within settings control 622 include a fixed-width “window” of the full scales of values, represented in FIG. 14B by dashed boxes, which is centered on the tick mark representing the current setting value. As shown below full scale of exposure values 1404, at an exposure value of 0.0, settings control 622 is displayed with the tick mark representing 0.0 at the center and tick marks ranging from −1.0 to +1.0 on either side within the window. As shown below full scale of zoom values 1406, at a zoom level of 1×, settings control 622 is displayed with the tick mark representing 1× at the center and tick marks ranging from 0.5× to 2.0× on either side within the window; accordingly, although 1× is not the middle zoom value within the window, the 1× tick mark is spatially centered within the window due to the successively compressed spacing. As shown below full scale of filter intensity values 1408, at a filter intensity level of 100%, settings control 622 is displayed with the tick mark representing 100% at the center, with tick marks ranging down to 75% displayed to the left within the window and the right of the window left empty. In some embodiments, computer system 600 displays settings control 622 on display 606 such that the width of the window within settings control 622 corresponds to the width of the touch-sensitive surface first button 602A and/or the center of the window within settings control 622 corresponds to the center of the touch-sensitive surface of first button 602A. For example, at an exposure value of 0.0, the tick mark representing −1.0× falls below the left-most edge of first button 602A, the tick mark representing 1.0× falls below the right-most edge of first button 602A, and the tick mark representing 0.0× falls below the center of first button 602A (e.g., right between the middle-left and middle-right quadrants).

[0555] At FIG. 14C, computer system 600 detects movement 1402A of contact 1402, where contact 1402 moves from the initial location illustrated in FIG. 14A at the right side of first button 602A to a new location at the left side of first button 602A, between the left and middle-left quadrants. Computer system 600 adjusts the exposure value to +0.7 based on movement 1402A and, as illustrated in FIG. 14C, displays settings control 622 with the tick mark representing +0.7 at the center, above the updated text “+0.7.” In particular, based on the direction of movement 1402A from right to left, computer system 600 increases the exposure value, as if contact 1402 were “dragging” the tick marks of the exposure scale representing higher exposure values towards the center of settings control 622. Additionally, based on the magnitude of movement 1402A, computer system 600 changes the exposure value by a magnitude of 0.7, as the distance from the initial location of contact 1402 between the middle-right and right quadrants of first button 602A and the new location between the left and middle-left quadrants corresponds to (e.g., matches, approximately matches, and/or is proportional to) the distance between the tick marks representing 0.0 and +0.7 in settings control 622, as if contact 1402 were moving a physical knob, dial, or slider with the same scale of exposure values.

[0556] FIG. 14D illustrates the display of settings control 622 during movement 1402A, e.g., as contact 1402 slides from right to left across the surface of first button 602A from the initial location illustrated in FIG. 14A to the new location illustrated in FIG. 14C. As illustrated in first panel 1410A, upon initially detecting contact 1402, computer system 600 displays the tick mark corresponding to the initial exposure value, 0.0, with increased visual emphasis, depicted in panel 1410A by the increased length and width of the center tick mark.

[0557] As illustrated in second panel 1410B, during right-to-left movement 1402B, the initial portion of movement 1402A, computer system 600 adjusts the exposure value from 0.0 to +0.2 and animates the representation of the exposure scale (e.g., full scale of exposure values 1404) sliding right to left through the window of settings control 622 along with contact 1402 (e.g., at a similar speed to movement 1402B), moving the tick mark representing +0.2 from its initial position in first panel 1410A to the center of settings control 622. As computer system 600 animates the representation of the exposure scale sliding from right to left, computer system displays the tick mark at the center of settings control 622 with increased visual emphasis, then gradually reverts the tick mark to its non-emphasized appearance once the tick mark is no longer at the center of settings control 622. Accordingly, during the adjustment from 0.0 to +0.2, computer system emphasizes the tick mark corresponding to 0.0 as shown in panel 1410A, then emphasizes the tick mark corresponding to +0.1 while slightly deemphasizing (e.g., shortening and/or narrowing) the tick mark corresponding to 0.0, then, as illustrated in second panel 1410B, emphasizes the tick mark corresponding to +0.2 while slightly deemphasizing the tick mark corresponding to 0.1 and further deemphasizing the tick mark corresponding to 0.0, creating a “tail” of emphasis running through the previously-selected exposure values within the representation of scale of exposure values 1404.

[0558] As illustrated in third panel 1410C, during right-to-left movement 1402C, the latter portion of movement 1402A, computer system adjusts the exposure value from +0.2 to +0.7 and animates scale of exposure values 1404 as described with respect to second panel 1410B, sliding scale of exposure values 1404 to move the tick mark representing +0.7 to the center of settings control 622. While animating scale of exposure values 1404, computer system 600 continues to adjust the emphasis of the tick marks as described above, emphasizing the tick marks as they cross the center of settings control 622 before gradually reverting the emphasis. As illustrated in third panel 1410C, the “tail” of emphasis appears to lengthen as more tick marks move past the center of settings control 622. For example, the length of the “tail” depends on the speed of movement 1402A (e.g., the speed at which tick marks are animated moving past the center of settings control 622) relative to the rate at which emphasis is decreased (e.g., the time taken for a tick mark to return to its initial appearance, representing the end of the “tail”). In some embodiments, computer system 600 reverts the emphasis of the tick marks based on simulated physics, for instance, modeling the tick marks using spring physics, where the tick marks spring back to their initial length after being “stretched” when crossing the center point.

[0559] Accordingly, by animating settings control 622 as illustrated in FIG. 14B, computer system 600 provides a “live” depiction of the adjustment to the exposure value responsive to movement 1402A. In some embodiments, while adjusting the exposure, computer system 600 adjusts the display of a camera preview (e.g., camera preview 614 and/or camera preview 1046) to reflect the exposure value represented by the tick mark currently at the center (e.g., the current exposure value at a given time during movement 1402A). For example, during movement 1402A, the brightness of the camera preview increases (e.g., by increasing the number of frames combined to digitally produce a brighter capture) at a rate corresponding to the speed of movement 1402A.

[0560] FIG. 14E illustrates the display of settings control 622 if contact 1402 stopped on the surface of first button 602A following movement 1402A. As described above, as a result of movement 1402A, the tick mark representing the exposure level of +0.7 is displayed at the center of settings control 622 in an emphasized state. As illustrated in first panel 1412A and second panel 1412B of FIG. 14E, while contact 1402 remains at the same location, the tick marks passed on the way to +0.7 (e.g., corresponding to +0.5 and +0.6) gradually revert to their un-emphasized appearances. Accordingly, at third panel 1412C, after a period of time without movement, the representation of the scale of exposure values is displayed with the tick mark corresponding to +0.7 emphasized and all other displayed tick marks with their original, un-emphasized appearances.

[0561] At FIG. 14F, immediately following movement 1402A and without first stopping contact 1402 on the surface of first button 602A (e.g., as described with respect to FIG. 14E), computer system 600 detects lift-off 1402′ of contact 1402 from the surface of first button 602A (e.g., the end of contact 1402). For example, movement 1402A turns into a flick movement, where contact 1402 is lifted with some forward momentum while moving from right to left. As illustrated in FIG. 14F, computer system 600 continues to adjust the exposure setting after detecting the end of contact 1402, further increasing the exposure to +1.0. The adjustment following lift-off of contact 1402 is based on movement detected near (e.g., within 0.05 s, 0.1 s, and/or 0.2 s of detecting) the lift-off 1402′. In some embodiments, the movement near the end of contact 1402 includes the last portion of movement 1402A detected before the end of contact 1402, e.g., via the touch-sensitive surface of first button 602A. In some embodiments, the movement near lift-off 1402′ includes movement detected after the end of contact 1402, for instance, using proximity sensors or other non-contact motion sensors.

[0562] In some embodiments, the adjustment to +1.0 following lift-off 1402′ is based on movement 1402A adjusting the exposure setting towards a predetermined “snapping” value near the end of contact 1402. For example, the snapping values for the exposure setting are +1.0, 0.0, and −1.0. When lift-off 1402′ is detected while at an exposure value of +0.7, movement 1402A is moving from right to left (e.g., corresponding to increasing the exposure value), towards the snapping value of +1.0. Accordingly, computer system 600 may “snap” the exposure value to the next snapping value after contact 1402 ends.

[0563] In some embodiments, the adjustment to +1.0 following lift-off of contact 1402 is a simulated physical adjustment based on movement 1402A. For example, computer system 600 simulates the adjustment of the exposure setting as a physical control being actuated by contact 1402, such as a dial with the scale of exposure values that can be rotated clockwise and counter-clockwise by lateral movement across first button 602A. Upon detecting lift-off 1402′, computer system 600 models a transfer of momentum from movement 1402A of contact 1402 to the simulated physical control, such that the simulated physical control continues to move with simulated movement 1402A′, e.g., based off of the velocity of movement 1402A at the time of lift-off 1402′ and one or more simulated physical characteristics of the settings control (e.g., mass and/or coefficient of friction). For example, computer system 600 models the dial with the scale of exposure values continuing to spin far enough to adjust the exposure value by an amount corresponding to simulated movement 1402A′ before stopping at +1.0. In some embodiments, the “snapping” value of +1.0 acts as a brake point for the simulated physical control, where computer system 600 stops the adjustment of the exposure value at +1.0 if simulated movement 1402A′ would continue spinning (e.g., has a great enough magnitude) the dial past the tick mark representing +1.0.

[0564] At FIG. 14G, after adjusting the exposure value to +1.0, while displaying settings control 622 for the exposure setting, computer system 600 detects contact 1414 at the center point of first button 602A. In some embodiments, contact 1414 is detected less than a threshold period of time after detecting the end of contact 1402, e.g., before computer system 600 dismisses settings control 622 following lift-off. At FIG. 14H, computer system 600 detects movement 1414A of contact 1414, where contact 1414 moves from the initial location at the center of first button 602A to the left, between the left and middle-left quadrants. Although movement from right to left corresponds to increasing the exposure value, as described with respect to FIG. 14C, as indicated by full scale of exposure values 1404, the current exposure value of +1.0 is the maximum (e.g., brightest/longest) exposure value available via settings control 622, and accordingly, computer system 600 does not further increase the exposure value beyond +1.0.

[0565] At FIG. 14H, as the exposure value is not adjusted in response to movement 1414A, instead of sliding the representation of the exposure scale right to left through the window of settings control 622 (e.g., as described with respect to FIGS. 14C-14D), computer system 600 displays settings control 622 sliding to the left with along with contact 1414. As illustrated in FIG. 14H, all elements of settings control 622, including the representation of the exposure scale, the text indicating the current exposure value, the icon corresponding to the exposure setting, and the cut-out tab all slide left together, offsetting from the center of first button 602A. In some embodiments, computer system 600 models settings control 622 moving with some “resistance,” e.g., not sliding settings control 622 to the left to the full extent of movement 1414A. For example, computer system 600 simulates the movement of settings control 622 with spring physics, animating settings control 622 sliding with more resistance the further settings control 622 displaces from the center of first button 602A. For example, computer system 600 only animates settings control 622 sliding in response to movement 1414A over to a maximum displacement, even if movement 1414A continues after displaying settings control at the maximum displacement.

[0566] At FIG. 14I, while displaying settings control 622 displaced from the center of computer system 600, detects lift-off 1414′ of contact 1414 from the surface of first button 602A (e.g., the end of contact 1414). In response to detecting lift-off 1414′, computer system 600 displays settings control 622 sliding back to the right to re-center below first button 602A.

[0567] At FIG. 14J, while the exposure value is set to +1.0 and while displaying settings control 622 for the exposure setting, computer system 600 detects contact 1416 at the left edge of first button 602A. At FIG. 14K, computer system 600 detects movement 1416A, where contact 1416 moves from the left edge of first button 602A towards the center of first button 602A. Computer system 600 adjusts the exposure value based on movement 1416A as described with respect to FIGS. 14C-14D, reducing the exposure value to +0.2 and displaying settings control 622 with the tick mark representing +0.2 at the center, above the updated text “+0.2.” For example, computer system 600 animates the scale of exposure values dragging left-to-right along with movement 1416A, with the text of the current exposure value updating and the corresponding tick marks elongating then retracting as they cross the center of settings control 622.