The Garden Club of Ellijay was founded in 1991 as an offshoot of the Gilmer Arts and Heritage Association. It was originally named Gilmer Garden Gatherers, but in 1993 became an independent entity and was renamed Gilmer Garden Club. The clubs name changed again in 2003 to The Garden Club of Ellijay.

During Linda Ragland's term as president in 2003-2004 the monthly meetings and plant sale were moved to the Ellijay Lion's Club Building. Other significant changes included amending the By-Laws to restrict membership to sixty members and renaming the club from Gilmer Garden Club to The Garden Club of Ellijay. In 2003, on Georgia Arbor Day, a tree was planted to honor the Club's three charter members: Nancy Bankston, Annetta Bunch, and Jean Weaver. On behalf of the Club, the Litter Control and Recycling Committee joined the Georgia DOT Adopt-A-Highway Program. The Club adopted a one-mile section of Georgia Highway 282. The Apple Festival Committee was created in 2003. The Club's float won Second Prize in 2003, and First Prize in 2004, in the Apple Festival Parade. Past President Victoria Chandler was honored as Member of the Year in 2003 and our Treasurer, Barbara Dunson, received this honor in 2004. The 2004 Annual Plant Sale was the most successful to date, raising over $4000.00.