How to create a bootable installer for macOS

In the process of upgrading a Mac mini to be a server, I installed two SSDs to be configured as a RAID 1. One of the caveats to this approach is that a recovery partition is not supported when using a RAID as your boot volume. I had previously come across these instructions from Apple but looked them back up in order to install OS X. Even with my extremely fast fiber connection, it is still much slower to install from the recovery partition than it is from a local USB drive.

Update: This link was originally shared in 2014 but the guide has been updated by Apple for the latest versions of macOS as well so the title of this post has been updated to reflect that change.

Xserve G5 and WD2003FYYS 2TB Drives

Over the past couple of weeks, I have been working with a school on getting a 2GHz Xserve G5 up and running to replace a PowerMac G5 operating as a server. The Xserve had no memory so we acquired 4GB of memory. In early 2011, I had upgraded the PowerMac G5 to dual Western Digital WD2003FYYS 2TB drives in a RAID 1 configuration.<! data-preserve-html-node="true"--more-->

All of this had been working perfectly but then the Xserve G5 was donated to the school and it was time to move the drives. After the memory arrived I installed it and attempted to just move the drives over. I had also initially setup the RAID 1 using SoftRAID (an excellent product by the way).

When I attempted to boot the Xserve with the 2TB drives, it just refused to boot and flashed the infamous folder error meaning it cannot find a boot drive. Although unlikely, I thought perhaps SoftRAID was preventing the drives from booting in the Xserve G5 and so I used SoftRAID to convert the on-disk format to Apple RAID.

I was also unable to boot from the Mac OS X 10.5 boot DVD. After some additional research, it occurred to me that the Xserve only had a CD drive and not a DVD drive. With that discovery, I decided to create a bootable FireWire drive with Mac OS X 10.5.8 as a means of booting the system.

Using the FireWire drive worked perfectly and allowed me to boot the system and get a better idea of what could be keeping the 2TB drives from being recognized. Oddly, one of the 2TB drives would finally mount in the Xserve after a considerable delay but the second drive would only mount after a long wait and only once in every ten reboots or so. If the second drive ever mounted, its paritions would never be properly recognized as part of a RAID set.

I started digging for more information about what could be causing this very strange behavior. Contrary to what some other users experienced, the drive trays did not show an orange light but instead showed a normal green light but only one drive would show any activity as indicated by the blue light.

After some searching and a great deal of trial and error, I came across a post on the Apple discussion forums detailing how another user had the very same WD2003FYYS drives and was able to get them to work perfectly by putting a jumper on pins 5 and 6 which causes the drive to only operate at 1.5Gb/s instead of the typical SATA II speed of 3.0Gb/s.

Once I set these jumpers, the drives came right up. Both RAID sets showed as degraded even though each RAID set had two partitions as expected. Disk Utility showed no further information so I moved to the Terminal. I ran:

diskutil listRAID

The output showed me that each RAID set had three partitions and one was marked as missing. I used the following command to remove the extra parition:

diskutil removeFromRAID (replace with missing partition's UUID) disk3

Obviously "replace with partition's UUID" refers to the UUID of the extra partition. The RAID set itself will also have a disk reference such as disk3, disk4, etc. In this case, both disk3 and disk4 are RAID sets made up of two partitions, one from each 2TB drive. This allows a separate boot RAID set and data RAID set.

Once I had removed the extra partitions from each set, the RAID sets immediately changed to online from the previous degraded state. This whole process was more complex than I expected but finally works as expected.

If you are facing a similar upgrade, I have read in a variety of posts that Seagate drives seem to work without issues while Western Digital drives tend to require the 1.5Gb/s jumper workaround. Hopefully I will not run into this exact problem again, but if I do, it should be an easy fix.

Taming the Lion: First Week In

I have been using Mac OS X Lion for a little over a week now and have some thoughts on what is great and what is not. Most reviews have been positive but some particular sticking points have emerged.

Install

First off, the Mac App Store purchase and install went very smoothly. I was impressed with how easy the process was. My experience has all been with my 2010 11-inch MacBook Air with 1.4GHz Core 2 Duo, 4GB of memory, and 64GB SSD. This machine is not a powerhouse but does great for most basic tasks which mostly consist of surfing the web, writing email, writing, and lots of terminal work.

Performance

One of the major concerns with any new operating system release is performance. When Apple moved from 10.4 to 10.5 performance seemed to suffer but ever since then, each successive release seems to feature better performance. The 10.5 to 10.6 transition was a big step in the right direction. Now the 10.6 to 10.7 progression is equally impressive. I have found that performance for the large number of apps I typically run is better under Lion than under Snow Leopard.

Multi-Touch Gestures, Mission Control, Launchpad, and Resume

I am pretty impressed with the new Multi-Touch Gestures that makes moving between "desktops" and full screen apps a breeze. I am using the left and right three finger swipe constantly to switch between the primary apps I use. Mission Control is also interesting but I am not using it too frequently.

Launchpad is nice but I have not found a good reason to use it very much yet. Eventually I may transition to using it more but I have to organize all my apps first. Resume is also a nice feature, particularly for Safari. All the other browsers I use automatically bring whatever tabs were open back up when I re-launch them but Safari needed an extra step of selecting "Reopen All Windows from Last Session" in the History menu. All that is fixed by Resume.

Full-Screen Apps

Other than performance, the best feature of Lion is Full-Screen Apps. Although some consider them nothing more than a gimmick brought over from iOS, I find them extremely useful and a great way to work and have increased focus and fewer distractions. One thing I would like to see resolved is that when you use an app in full-screen mode, a second display will only show a "linen" background and nothing else. It would be nice to be able to use the second display for something other than a very large "linen" background.

{% img left /images/old/Sparrow-Icon.png %}

There are a few specific apps that I use constantly in full-screen mode. First off, I have almost completely stopped using Apple's Mail program in favor of Sparrow. Sparrow takes a conversation-style view similar to Gmail and applies it to your regular email. It is fantastic and the best email client I have ever used. It is the first full-screen app I launch.

{% img right /images/old/Socialite-Icon.png %}

The second full-screen app I use is Socialite. Socialite has become my go-to app for monitoring Twitter and Facebook. It also supports Google Reader but I prefer another app for that purpose. Socialite is impressive and allows me to keep track of Twitter lists and mark Tweets "read" after I see them. In versions prior to 1.3.5, there were some performance issues that initially caused me to move to another appliactions for social media but version 1.3.6 has addressed all of my issues. All in all Socialite is a fantastic social media client and is the second full-screen app I launch.

{% img left /images/old/Reeder-Icon.png %}

The third full-screen app I launch is Reeder, the best Google Reader client I have ever used. Until recently, I have been using NewsRack in both Mac and iOS versions but started looking for an alternative. At this time, NewRack does not support full-screen mode and it does not have the clean user interface that Reeder employs. Reeder in both its Mac and iOS version has become my essential feed client.

{% img right /images/old/iTerm-App-Icon1.png %}

The fourth and critical full-screen app I use constantly is iTerm (actually iTerm2). Although Apple's own Terminal does a pretty good job and I do find it to be very good. iTerm just adds some additional refinements that I really like. Try it out and see what you think.

{% img left /images/old/Fluid-App-Icon.png %}

The last full-screen app I use all the time can actually be considered many apps in one. Fluid App allows you to take any web site and turn it into its own launchable app that can support full-screen mode with the $5 paid version. The free version is still excellent but lacks full-screen mode and some other additional features. I use Fluid-created apps constantly for things like my own My eBay app, an Instapaper app, a FaceBook app, and a Netflix app. Fluid App provides an excellent way to segment your browsing experience particularly with sites you visit often. This leaves it easy to check often-used sites without using Safari itself which leaves the browser ready for whatever other browsing needs to be done.

Conclusion

Overall, I think Lion is the best upgrade we have seen to Mac OS X in a long time. As always, there are some bugs that will be worked out. Overall, I can say my experience has been great and I look forward to continuing to use Lion and also working with Lion Server soon. Check back for additional thoughts as I continue using Lion.

You can purchase Mac OS X 10.7 Lion and Lion Server from the Mac App Store.

5 Reasons the Optical Drive is Going Extinct

Although most of us may not fully realize the implications, the optical drive in all its forms is going extinct on the Mac platform. In another year or two at the most, the optical drive will be no more and these are five reasons why.

1) Broadband is Getting Faster

If you are a lucky resident of London, you might be able to try out Virgin Media's 1.5Gbps/150Mbps cable internet service. If you are on this side of the pond, you might be looking at Verizon's FiOS, AT&T's U-Verse, or possibly even great fiber or ADSL2+ service from an independent ISP like Sonic.net. In years past, many of us were thrilled to have access to 1.5Mbps DSL. These days, 6Mbps is the low end of what allows you to optimally experience online media and we are moving toward a new 10Mbps baseline.

2) The Mac App Store is a Sign of Things to Come

Apple's amazing success with the iOS App Store is now followed up by the Mac App Store. Software distribution has been changed forever. Although Windows is still behind this curve, the Mac is now quickly moving toward all digital software distribution. The runaway success of Mac OS X 10.7 Lion is a strong indicator of how well this model works. Recent releases of Final Cut Pro X and Motion are also good examples.

3) Blu-ray on the Mac is Never Coming

In June 2010, Steve Jobs made it clear that Blu-ray is still not coming to the Mac anytime soon. Even though Blu-ray has been out for some time now, it has never been offered in any Mac and never will be. It is possible to use a Blu-ray drive with a Mac but this is likely only to be of interest to the technologically-inclined. The success of Netflix Instant Streaming and iTunes HD rentals along with others such Amazon Instant Video and Hulu make it clear that streaming media is here to stay. Instant gratification is winning which is no surprise to anyone.

If you compare a 720p iTunes HD movie to a 1080p Blu-ray release, you might notice a slight difference in quality on some movies if you look very closely. For the vast majority of users, 720p looks great and 1080p does not give you much more in terms of movie-enjoying experience, especially if you view it from a reasonable viewing distance. Apple has been rumored to be offering an HD+ option in iTunes which would provide 1080p rentals and purchases and would make this argument moot for at least some titles. Once again, fast broadband of at least 10Mbps would be needed to allow streaming of 1080p content.

4) The Optical Drive is Impractical for Storage

The next time you use 228 DVD-R discs to backup your 1TB media collection, please take pictures and send us a link. Although Blu-ray might be a good option for backups, the cost of discs compared to the costs of hard drive storage make it impractical for the majority of users. In addition, adding a Blu-ray is not seamless like it was for DVDs. Although much better than the number of discs for DVD backups, twenty 50GB Blu-ray discs for 1TB of backup storage is still excessive and impractical.

When a 1.5TB hard drive costs $50, a 2TB hard drive costs $70, and a 3TB hard drive costs $120, it just makes sense to buy a few extra hard drives for backup purposes. With the ever-increasing storage demands of multimedia content, this trend will not change. Last year, before the big clean, my iTunes Library grew to nearly 3TB. This is surprisingly easy to reach when you download anything in HD from the iTunes Store since you end up with both HD and SD copies of everything.

5) The Optical Drive is Leaving the Mac for Good

The trends in Mac models clearly indicate that the optical drive is leaving the Mac for good. With the release of the new MacBook Air models came the discontinuation of the white MacBook except for educational institutions. The low-end MacBook Air model now takes the low-end slot in Apple's laptop lineup and of course lacks an optical drive.

In addition, the new Mac mini models also completely lack any built-in optical drives. This is a sign of things to come. This leaves only the MacBook Pro models, which are rumored to be getting thinner without an optical drive, iMacs, and Mac Pros as the final models with built-in optical drives. New Mac Pro models may be around the corner but it could be into next year before we see a new model. The iMac has recently been updated but, like the Mac Pro, has been in the same case design for many model revisions. Both of these models are likely to sport new case designs soons and they may very well drop the optical drive entirely.

What Next?

It is time to get ready for the optical drive to go away. Now might be a great time to make disk images of your DVDs and use a utility such as Handbrake to convert them to a digital format. If you are still using CDs or DVDs for backup, look at moving to a collectin of hard drives (large storage requirements) or even USB flash drives (small storage requirements) for backup purposes.

Also, expect that only software that has incredibly large media associated with it will come on physical media. Even then, it is likely that such software will come on USB flash drive rather than optical media. With the advent of faster broadband this will also turn into digital distribution.

The next few years will likely see an increase in the availability of fast broadband to users that now only have access to basic DSL. Use of online streaming media at home and on-the-road will increase dramatically. In a few more years, optical media will likely go the way of the cassette tape and VHS.


Purchase Recommendations

As mentioned in the article, there are some fantastic deals on hard drives if you are willing to go with the reduced performance "Green" models. Most often this means a decreased rotational speed (5400RPM instead of 7200RPM) which affects access time a little bit. For bulk storage, it will not be noticable. If you are looking at high performance main storage, it is probably worth it to look at faster storage. Take a look at the 3TB Hard Drive Buyer's Guide for more on performance drives.

We have three specific recommendations that are a fantastic value. First is the Samsung Spinpoint F4EG 1.5TB hard drive. It is a 5400RPM drive and is respectable performance-wise but is absolutely amazing in its price of only $50. At about $0.033/GB, this is an excellent value.

The second drive is the Hitachi Deskstar 5K3000 CoolSpin 2TB hard drive. This drive is once again 5400RPM and also a great value at $70. At about $0.035/GB, this is still a very good value, but not quite as good as the Samsung 1.5TB drive although it is very close.

The final recommendation for bulk storage is the Hitachi Deskstar 5K3000 CoolSpin 3TB hard drive. This drive runs about $120 but has dropped to as low as $106. At its current $120 price it is about $0.04/GB. This is a good value but does not match the incredible value of the Samsung 1.5TB drive or the still excellent value of the Hitachi 2TB drive.

The bottom line is that cost per GB is only one indicator when you buy a drive. If you need less than a 1TB of backup space, the 1.5TB drive is the best option. If you want a little headroom then moving up to a 2TB or 3TB drive makes a lot of sense.

iCloud to be New Digital Hub, Computer Just a Device

At WWDC 2011, Apple has announced iCloud, the new digital hub to replace your computer as the center and make it just another device. Essentially iCloud is a way to revolutionize the way you sync your content and push it to the cloud so it can easily sync with all your devices.

This is completely integrated with apps and even has an iCloud Storage API. It works for Macs, PCs, and iOS devices. Pages, Keynote, and Numbers support Documents in the Cloud which allows you to edit a document on one device and have all changes synced to your other devices so you can grab your iPad and keep editing.

Your App Store purchase history can be viewed on all devices and contacts and calendars are synced as well. Along with these changes, MobileMe in its present form is gone and mail, contacts, and calendar are now free. iBooks will sync your progress between devices and keep everything in sync.

Photo Stream will allow your last 1000 photos to be synced instantly between all your devices and stored in the cloud for 30 days. All photos are stored to your Mac or PC.

The final and rumored feature previewed was iTunes in iCloud. Whenever you purchase music on any device or computer and the music is automatically downloaded to your other devices and computers instantly.

One surprise is that all of this is free. You have 5GB of free storage which covers mail, docs, and backups. Other data such as purchased music, apps, books, and Photo Stream don't count toward that 5GB.

The only part of this that costs anything is the new iTunes Match service which is $24.99 per year. iTunes Match will scan your library of music for ripped tracks and provide the same music as 256Kbps AAC DRM-free files for that one fee even if it is 20,000 files.

iCloud will be available this fall. Apple is very serious about this whole process with their new North Carolina data center. Apple emphasized how "Green" this data center is. This puts an end to the WWDC 2011 keynote address. Thanks again to MacRumors for live coverage.

The iCloud page at Apple.com should be up shortly since iCloud.com already redirects to apple.com/icloud.

Update: The iCloud page is now up.

WARNING: Inability to Upgrade Hard Drive on 2011 iMacs

Other World Computing's OWC Blog has revealed that Apple has severely limited the ability to upgrade the 2011 iMac's hard drive in the main drive bay. There have been various issues from 2009 on due to the way Apple utilizes an internal temperature sensors in hard drives. The problem is much worse in the 2011 iMac.

From the OWC Blog post,

With the release of the Late 2009 iMac, Apple changed the way the iMac communicates with the drive for that heat-sensing information. Each brand of hard drive Apple used had its own specific thermal sensor cable which connected to certain drives that featured internal temperature sensing. We found that you could still change the drive, albeit with a limited selection. Seagate drives could be swapped with larger capacity Seagate drives; Western Digital could be swapped with other Western Digital Drives; and so forth. There were also reports of other workarounds which included replacing the internal sensor with an external sensor (like the one from the optical drive bay), controlling the fans with software, or purchasing a replacement cable that matched your brand of new hard drive. In any event, there were perhaps a few convoluted ways to upgrade your iMac’s main drive outside of Apple’s offerings for greater speed, more capacity or to quickly restore a machine from a drive failure yourself.

In the new 2011 models, things are even worse.

For the main 3.5″ SATA hard drive bay in the new 2011 machines, Apple has altered the SATA power connector itself from a standard 4-pin power configuration to a 7-pin configuration. Hard drive temperature control is regulated by a combination of this cable and Apple proprietary firmware on the hard drive itself. From our testing, we’ve found that removing this drive from the system, or even from that bay itself, causes the machine’s hard drive fans to spin at maximum speed and replacing the drive with any non-Apple original drive will result in the iMac failing the Apple Hardware Test (AHT).

As usual, OWC went through everything very carefully to see if there are any workarounds.

In examining the 2011 27″ iMac’s viability for our Turnkey Upgrade Service, every workaround we’ve tried thus far to allow us to upgrade the main bay factory hard drive still resulted in spinning fans and an Apple Hardware Test failure. We swapped the main drive out (in this case a Western Digital Black WD1001FALS) with the exact same model drive from our inventory which resulted in a failure. We’ve installed our Mercury Pro 6G SSD in that bay, it too results in ludicrous speed engaged fans and an AHT failure. In short, the Apple-branded main hard drive cannot be moved, removed or replaced.

Reading the whole OWC blog post is well worth your time. This is the time to provide feedback to Apple and complain about this major limitation. Hopefully it can be solved with a software update but Apple needs to know what you think. We have been on the verge of recommending the new iMac models in place of Mac Pro systems for many tasks but this can be a major show-stopper. We were all very excited about Thunderbolt on the desktop but this is a big problem if you have any desire to replace the stock drive with a larger one such as the Hitachi 3TB hard drive which is a size not available at all from Apple.