Short answer: yes, if you book a tour designed for beginners — which is exactly how our standard horseback tours (Jeti-Oguz, Karakol Yurt Visit) are run.
A calm, steady pace (mostly walking, occasionally a gentle trot), horses used regularly with first-time riders, and a guide riding with the group the whole time. You don't need any prior experience.
Expect some soreness the next day if you're not used to riding — that's normal. Wear long trousers and closed shoes, and let your guide know if you're nervous; they'll adjust the pace.
Some of our multi-day routes (Song-Kul, Chon-Kemin) involve longer hours in the saddle over rougher terrain — those are marked "Moderate" rather than "Easy" on the tour page, so check the difficulty rating before booking if you're a first-timer.