Go with Wordpress. I used Ghost for my blog for a little over a year (started using it immediately after it was first released) and, despite it being a solid blog engine, it's very limiting if you want to do anything other than that.
Ghost does not yet have plugin support, so adding social meta data to your blog is much less intuitive than if you were to use something like WP's 'Yoast SEO plugin'. The Ghost team has made some great improvements that have resolved the woes of manually entering meta attributes to your posts, but Yoast's SEO plugin is still taking the lead with optimizing your page for sharing/SEO.
I had several woes when I used Ghost. At one point, I decided that I wanted to make a static splash page as my root page '(mysite).com', with a 'blog' button that takes you to the blog section at '(mysite.com)/blog' Turns out it's impossible to do this on Ghost. It would have to be implemented on Apache.
Next, I wanted to make a separate page to showcase my artwork. I was thinking of making a nice gallery page. The best way to do it with Ghost would be making a new blog post, setting it to be a static page, then embedding the pictures manually with Markdown. I could have made a photo gallery with Javascript and tucked it under the Markdown, but it just felt unnecessarily hacky and I didn't want to deal with it. It would have been nice to just have a simple out-of-the-box feature plugin that would do that for me.
Wordpress is a massive, well-seasoned Goliath, and Ghost is the smaller, younger David. Like I said, Ghost is great for what it is: a blog engine. But if you want to add anything else to your blog and maybe make it work more like a website, you'll have to either write up your own theme for it or crawl under the code to tweak it around to your taste.
When I moved to Wordpress, I imported my posts, added a picture gallery, splash page, fully customized everything and it took just a few hours and it looked great. It was such a sigh of relief.