Blog

APFS, ccc

Yes, you can have bootable backups on macOS Big Sur

Mike's picture by Mike | November 3, 2020

CCC 5.1.23+ can make bootable backups of Big Sur on Intel and Apple Silicon Macs.

Update May 13, 2021: CCC 5.1.27 can now make bootable backups of a Big Sur startup disk on all Macs.

Update Nov 24, 2020: CCC 5.1.23 can now make bootable backups of a Big Sur startup disk on Intel-based Macs. Support for System volume cloning on Apple Silicon Macs is disabled for now because Apple's APFS replication utility does not currently work on that platform. When Apple fixes that, we'll post an update to CCC that restores support for making bootable backups on Apple Silicon Macs.

CCC is a native application on Apple Silicon and is 100% compatible with Apple Silicon Macs
CCC will automatically proceed with a Data Volume backup when backing up an APFS Volume Group on Apple Silicon Macs — that's a complete backup of your data, applications, and system settings. If you would like to make your Apple Silicon Mac backup bootable, you can install Big Sur onto the CCC Data Volume backup. Please keep in mind, however, that your CCC backup does not have to be bootable for you to be able to restore data from it.

With the announcement of macOS Big Sur, Apple has retired Mac OS X (10) and replaced it with macOS 11. As with every upgrade since the original release of Mac OS X, we have to make changes to CCC to accommodate the changes in this new OS. As the numeric change would suggest, though, this is the biggest change to macOS since Apple introduced Mac OS X roughly 20 years ago. The system now resides on a "Signed System Volume". This volume is cryptographically sealed, and that seal can only be applied by Apple; ordinary copies of the System volume are non-bootable without Apple's seal. To create a functional copy of the macOS 11 System volume, we have to use an Apple tool to copy the system, or install macOS onto the backup.

Does this mean that we can no longer have bootable backups?

I can certainly understand why people are concerned about the future of this solution. Thanks to these massive system changes and some bugs in the version of Big Sur that Apple intends to ship, nobody can make a proper copy of the System volume right now, not even with Apple's proprietary utilities. Based on that statement alone, and a suggestion from one of my competitors to just give up and use Time Machine instead (which does not make bootable backups, nor back up the System), someone could falsely conclude that it's impossible to ... Read More

APFS

A bug in macOS 10.15.5 impacts bootable backups, but we've got you covered

Mike's picture by Mike | May 27, 2020

Update (July 16, 2020): Apple fixed the underlying OS issue described below in macOS 10.15.6, and the CCC 5.1.20 update puts our workaround on the back burner. Every challenge opens up new opportunities, and that's actually how we're seeing this incident in retrospect. Rather than just hoping for a fix, we invested in a solution, and that solution puts us in a solid position for the next major OS.

Update (May 29, 2020): This issue is now addressed in CCC 5.1.18, which is available for immediate download – CCC can make bootable backups of macOS 10.15.5. Choose "Check for Updates" from the Carbon Copy Cloner menu to get the latest version of CCC. Special thanks to my team members for helping put this release together so quickly, the folks at Wordcrafts for a wicked-fast turnaround on these UI translations, and for several beta testers that helped us knock out some kinks along the way.

Early last week we discovered an APFS filesystem bug in a beta of macOS 10.15.5. The technical details of the bug are laid out below, but the short version is that we're no longer able to use our own file copier to establish an initial bootable backup of a macOS Catalina System volume. To be very clear – existing backups are unaffected, and this has no effect on CCC's ability to preserve your data, nor any effect on the integrity of the filesystems on your startup disk or your backup disk. The impact of this bug is limited to the initial creation of a bootable backup.

So that's a lemon... But hey, summer has arrived here in the northern hemisphere, so let's make some lemonade!

Creating bootable backups on macOS 10.15.5

Last year at Apple's Developer Conference, Apple suggested that backup software could use Apple's "Apple Software Restore" (ASR) for cloning APFS volume groups. Initially I dismissed this – I shouldn't have to use Apple's black-box utility to do my job, I prefer to take full responsibility for my backups. Anticipating a world in which Apple continues to restrict access to APFS rather than grant it, though, we decided to invest a fair amount of time evaluating this functionality, and we've been beta testing it for the last 8 months. I don't like to lean on ASR for general backups because it has some shortcomings and doesn't give any insight into its internal activity (e.g. files copied, errors encountered), but in this very narrowly-defined case, we can leverage Apple's proprietary utility just to establish bootable backups. We posted a beta last Sunday with new UI around this functionality, and we intend to... Read More

company

2019 Holiday Closure

Sarah's picture by Sarah | December 24, 2019

We will be closed December 24 and remain closed December 25 to spend the holidays with our families. We will also be closed December 31 through January 1. 

Limited staff are available to respond to customer requests until January 2. We appreciate your patience if it takes a bit longer for us to respond than is typical.

ccc, APFS

Cloning Catalina with Carbon Copy Cloner

Mike's picture by Mike | October 7, 2019

We posted our Catalina-certified build of CCC way back in August, so the last few weeks have been eerily calm. Now that Apple has made the OS release schedule so consistent, we find this time of year to be a lot less stressful by simply being ready for it, on time. Since about Catalina Beta 9, the OS has been feeling pretty polished and ready for prime time. I think I have just one gripe with Catalina — Spotlight is so persistently annoying when it prevents volume unmount requests! That's a pretty trivial complaint though, and easy enough to work around. On the whole, Catalina seems to be working pretty well, and CCC is 100% ready to make bootable backups of the new read-only System volume and its Data volume sibling. If you're wondering what those are, we put together an article to explain how the new System/Data volume group works:

Working with APFS Volume Groups

Getting Ready to Upgrade to Catalina

Before you upgrade to Catalina, it is important to understand that downgrading to your previous OS will be impossible without a bootable backup of the previous OS. Before you apply the upgrade, we recommend that you establish a bootable backup of your current OS on an external USB or Thunderbolt hard drive, then verify that you can boot your Mac from that backup disk. Before you pull the trigger on the upgrade, detach that external disk from your Mac and set it aside. This is a really simple step that you can do to save potentially a lot of headache in the future. And you need a backup anyway right? Make it a CCC bootable backup.

For more detailed advice on preparing for the upgrade and instructions on how to downgrade, check out this CCC knowledgebase article:

Best practices for updating your Mac's OS

When should I upgrade?

As with every major upgrade, I recommend that any users that rely heavily upon the availability of their Mac for work or other productivity consider waiting for at least one OS update before making the upgrade. The early releases are exciting, but with any excitement there's usually a bit of risk. Early adopters will surely find some shortcomings and bugs which will be resolved in the next month or so with minor OS updates. Does this upgrade fix a problem that causes me daily grief? Will this upgrade improve my productivity or security, outweighing the time I may have to invest in fixing early-adopter problems? Those are the key questions I ask myself before applying any upgrade.

What should I expect after I have upgraded? How will my backups be affected?

In most cases, you... Read More

APFS

An analysis of APFS enumeration performance on rotational hard drives

Mike's picture by Mike | September 12, 2019

 

My APFS-formatted rotational disks have always felt slower than when they were HFS+ formatted. The speed of copying files to them felt about the same, but slogging through folders in the Finder was taking a lot longer. At first I shrugged it off to the filesystem being new; "It just needs some tuning, it will come along." But that performance hasn't come along, and after running some tests and collecting a lot more data, I'm convinced that Apple made a fundamental design choice in APFS that makes its performance worse than HFS+ on rotational disks. Performance starts out at a significant deficit to HFS+ (OS X Extended) and declines linearly as you add files to the volume.

The rest of this article is fairly technical, here are the key takeaways:

  • Enumerating an APFS filesystem on a traditional HDD (rotational disk) will take 3-20X longer than HFS+ on the same hardware.
  • This performance difference is most noticeable on a macOS startup disk that is (or includes) a rotational disk.
  • If Apple doesn't make some concessions in the APFS filesystem to accommodate the slower seek performance of HDD devices, then a rotational device will never be able to provide acceptable performance as a production macOS startup disk.

Test Setup

I wanted to see how an APFS formatted volume performs over time under "normal" usage conditions and how that compares to an HFS+ formatted volume under the exact same conditions. To do this, I had to set up a simulation that would produce identical changes on two volumes to allow for a consistent, objective analysis of the filesystem performance. When I refer to "filesystem performance," I'm specifically referring to how long it takes the filesystem to do transactional tasks. Read and write performance depends almost entirely on the speed of the media, so I wanted to factor that out of my tests. Enumerating the contents of the filesystem is a good exercise of filesystem transactional performance, so I decided to test the enumeration of 1 million files on each an APFS and HFS+ filesystem over a period of simulated modifications to the filesystem.

The destination device in these tests is a 2TB Western Digital MyBook Duo split into two equal partitions. One partition is formatted HFS+, the other APFS. Spotlight was disabled on both volumes. Snapshot support and APFS defragmentation were varied in different tests to determine whether they had any effect on filesystem performance.

The number of files in the file set is constant – 1 million files, 111,000 directories (files nested three directories deep). To make the simulation closer to real-life, the file size distribution roughly follows 1/x2 – it’s weighted more heavily towards smaller files. Each individual file size is determined randomly, but in a pattern that follows that size distribution histogram. Average data set size is ~18GB. Max file size is 20GB... Read More

Categories

APFS
beta
ccc
company
Design
el capitan
Performance
Philosophy
Promotion
sales
Trending Topics
World Backup Day
yosemite

Recent Articles

RSS Feed