mirzaaghazadeh/iphone-duo-skills

iphone-duo-camera

Build camera capture for iPhone Duo's two front cameras — the virtual front camera, the inner under-display and outer ultra-wide devices, AVCaptureDeviceDirectionCoordinator, preview mirroring and video gravity, and dual-display capture.

Ver código fuente

Cómo usar

  1. Copia el comando y revisa el paquete antes de instalarlo en tu entorno de agente.
  2. Consulta las herramientas, credenciales y entornos necesarios en el documento original.
  3. Describe las entradas y el resultado deseado; contrasta la salida con las fuentes.
npx skills add https://github.com/mirzaaghazadeh/iphone-duo-skills --skill iphone-duo-camera

Antes de empezar

  • La instalación no incluye suscripción al modelo, cuota API ni permisos sobre tus archivos.
  • Las estrellas e instalaciones reflejan actividad, no una prueba independiente de calidad o seguridad.
Documento original del Skill

Contenido del repositorio de origen con títulos, ejemplos, código, tablas, enlaces e imágenes preservados.

Camera on iPhone Duo

iPhone Duo is the first iPhone with two front cameras. Both are square sensors with an ultra-wide field of view: one on the outer display, and one beneath the inner display — the first under-display camera on iPhone.

That creates a problem no previous iPhone had. "Front" no longer means "pointing at the user."

Pick a strategy first

Everything downstream follows from this choice.

The virtual front camera — automatic, limited

Discover a front camera the ordinary way — an AVCaptureDevice.DiscoverySession requesting position .front with a Wide or Ultra Wide device type — and on iPhone Duo you resolve to a new virtual front camera. It switches between the two physical cameras by itself: inner camera when open, outer camera when closed.

It always uses the most relevant camera, and you write no switching code.

The cost is that it exposes only what both physical cameras can do:

  • max 1080p, 60 fps
  • no depth

If the app needs 4K, high frame rates, or any depth-based feature, this is not enough.

The individual cameras — full capability, your responsibility

Address each physically, via the built-in outer ultra-wide and built-in inner ultra-wide device types:

Inner (under-display)Outer
Max video1080p @ 60 fps4K @ 120 fps
Depthsupportedsupported

Full capabilities, but now you must switch cameras when the user opens or closes the device. Which brings us to the hard part.

Which way is a camera actually facing?

AVCaptureDevice has always had a fixed position — on iPhone, .back or .front. Both of iPhone Duo's front cameras report .front. That property describes where a camera sits on the hardware, and on a device whose displays can face opposite directions it no longer tells you where the camera points relative to the person looking at your UI.

Three situations make this concrete:

  • The user is looking at the inner display while the app streams the outer front

camera — a "front" camera facing away from them.

  • The device closes while that camera is streaming, and the same camera swings

around to face them directly.

  • The device is open and flipped, so a rear camera is now the selfie camera.

AVCaptureDeviceDirectionCoordinator

AVCaptureDeviceDirectionCoordinator (in AVKit) answers the real question: which cameras are forward-facing right now, relative to a given view. Build one from three things — your app's UIView, the device types to monitor, and a change handler — and it keeps you current as the device moves.

Because it is anchored to a view, it reports facing relative to the display that view is on. When the view is on the outer display, the outer front cameras are forward-facing and the rear cameras are backward-facing. Open the device, the view moves to the inner display, your handler fires, and now the inner front camera is forward-facing while the outer front and rear cameras are backward-facing.

Driving both displays at once? Create one coordinator per view. Each reports relative to its own display, so the same rear camera is forward-facing to the outer view's coordinator and backward-facing to the inner view's. That is correct, not contradictory — it is the whole point. (Dual-display camera UI comes from the scene accessories API; see ../iphone-duo-hinge-and-scenes/SKILL.md.)

Concurrency

The coordinator is tied to a view, so it is isolated to the main actor. Your change handler must not call AVFoundation APIs directly.

It never hands you an AVCaptureDevice. The handler receives an `AVCaptureDeviceDirectionMap`, which sorts the tracked cameras into two arrays:

swift
var forwardFacingDeviceDescriptors: [AVCaptureDeviceDescriptor]
var backwardFacingDeviceDescriptors: [AVCaptureDeviceDescriptor]

The same map is also readable at any time from the coordinator's deviceDirections property, so you aren't limited to reacting inside the handler.

An `AVCaptureDeviceDescriptor` is a sendable stand-in for a capture device, carrying uniqueID, localizedName, deviceType, mediaTypes and position. Pass a descriptor to your camera actor and construct the AVCaptureDevice there. That is the intended path; don't try to smuggle a device across the boundary.

Note that both of these types live in AVKit, alongside the coordinator — not in AVFoundation, where you might reasonably go looking first.

Because you get arrays rather than a single device, your handler has to choose: typically the first forward-facing descriptor whose deviceType matches what you're streaming. Don't assume exactly one camera faces forward.

What the handler should do

  1. Reconfigure the AVCaptureSession to keep streaming from whichever camera is

now forward-facing.

  1. Re-evaluate mirroring. Mirroring should follow the direction, not the

position: when a rear camera has become the forward-facing one, mirror the preview so it feels like a normal selfie view.

  1. Apply any UI updates the camera change implies.

Preview polish

Streaming the rear camera's full field of view on the inner display leaves extra room around the preview. Two reasonable choices: offset the preview and group controls in the space left over, or let the preview fill the display. Control this with videoGravity on AVCaptureVideoPreviewLayer.

Streaming an ultra-wide front camera, exploit the square sensor — set dynamicAspectRatio on the AVCaptureDevice to pick a landscape aspect ratio that fills the inner display.

Rotation. Adopt AVCaptureDeviceRotationCoordinator so previews and captures stay upright. On iPhone Duo it updates when the app moves between displays, which is what keeps rotation consistent across both. Once you have adopted it, turn off camera-sensor-orientation compensation — it is enabled on all of iPhone Duo's front cameras and is redundant work once the rotation coordinator is doing the job.

Note that direction and rotation are separate coordinators solving separate problems. Which camera to stream is direction; which way its output is oriented is rotation. Most camera apps on this device want both.

Checklist

  1. Build against the iOS 27.1 SDK.
  2. Decide: virtual front camera (automatic, 1080p60, no depth) or individual

cameras (full capability, manual switching).

  1. If individual, adopt AVCaptureDeviceDirectionCoordinator — one per view.
  2. In the change handler, read the AVCaptureDeviceDirectionMap, pick a

forward-facing descriptor, reconfigure the session, re-decide mirroring, and update UI. Move devices across actors as AVCaptureDeviceDescriptor.

  1. Set videoGravity, and dynamicAspectRatio for front-camera capture.
  2. Adopt AVCaptureDeviceRotationCoordinator, then disable sensor-orientation

compensation.

  1. Consider a CameraCaptureAccessory so the subject sees something on the outer

display.

  1. Test opening, closing and flipping the device mid-session in Device Hub.

Apple's related articles: Choosing a Camera by the Direction it Faces and Supporting Device Rotation in Your Camera App. For the square sensor generally, see Support the Center Stage front camera in your iOS app from WWDC26.

del mismo repositorio

Más Skills

Todos los Skills
mirzaaghazadeh
Comunidad

iphone-duo-readiness

Audit and port an iOS app to iPhone Duo, Apple's first foldable iPhone. Use when asked to support, adapt, prepare, test, or review an app for iPhone Duo, foldable iPhone, the inner/outer display, device poses, or the fold. Entry point that routes to the layout, bars, hinge/scenes, camera, and design skills.

instalaciones
3
GitHub Stars
161
Actualizado
11 oct
mirzaaghazadeh
Comunidad

iphone-duo-adaptive-layout

Build layouts that adapt to the iPhone Duo fold using reserved regions, division and occlusion regions, displacement patterns, and the split and overlay ArrangementView containers. Use when content or controls land in the fold, when building a split-like or overlay layout, or when custom manually-positioned UI must avoid the hinge or the under-display camera.

instalaciones
2
GitHub Stars
161
Actualizado
11 oct
mirzaaghazadeh
Comunidad

iphone-duo-design-review

Review or design an iOS interface for iPhone Duo's poses — closed, open, book-folded, tabletop and tent — covering side-mounted controls, asymmetric layouts, fold avoidance, sheets, and how to use the inner display well. Use for design critique, mockup review, or deciding what a screen should look like on a foldable iPhone rather than how to code it.

instalaciones
2
GitHub Stars
161
Actualizado
11 oct
mirzaaghazadeh
Comunidad

iphone-duo-dual-pane-patterns

Design and build two-pane experiences for iPhone Duo — the real pixel and point dimensions of each display and each half, the exact hinge callback types (onHingeChange / UIHingeInteraction), hinge-driven effects, pose-to-pattern mapping (companion pane, dual view, list-detail, tabletop controls), two-pane paywalls and fold-aware onboarding. Use when sizing a layout or asset for iPhone Duo, wiring a hinge callback, choosing what goes in each pane, or designing onboarding and purchase flows that s

instalaciones
2
GitHub Stars
161
Actualizado
11 oct