Sugar Loaf is a mixed-use hamlet in Orange County, New York, United States. It is located in the Town of Chester, within view of Sugar Loaf mountain. The hamlet of Sugar Loaf, New York, was founded in the late 1740s as a waypoint along Kings Highway. Businesses supplied food and other goods, and horses to travelers.