In my experience, this does require some extra care as both herbaceous and tree peonies have deep root systems and prefer spacious environments, so choosing the right pot and conditions is crucial ...
I always get really excited about peonies, a favourite of mine to grow. They mainly flower in May with a beautiful display.