Rite Aid is launching new flavors of its private label Thrifty Ice Cream in California stores, the retail pharmacy chain said Wednesday.