I'm a web developer and I actually did this a few years ago. The steps were, roughly, as follows:
Decided on bespoke vs CMS. CMS is Wordpress/Wix/whatever and is so dead-simple that even a noob with zero coding experience can do it. I went for bespoke because, well, I'm a developer and I wanted the experience. I also didn't want a .wordpress.com sub domain, and I wanted full control over the website.
Decided on a hosting solution. I went with AWS EC2, mostly because I hadn't heard of the concept of explore/exploit back then. But in retrospect I think AWS was a perfectly reasonable choice, and my heuristic of "pick the big one" worked out. The really nice thing about AWS is that there's no CMS-like stuff -- it's just a cloud server that you can do anything on. The cheapest option will cost you ~$30/year.
Buy a domain. AWS sells domains (the keyword to google is "route53") for about $12/year for a .com (unless you want a high-demand one). There are other sites, but the benefit of doing it through AWS is simplicity (assuming you decided on AWS hosting). If you buy from a different provider, you'll have to transfer it.
If you don't already have good design skills, you'll need to spend a lot of time googling the basics of light vs dark themes (no it's not as simple as color inversion), saturation, contrast, whitespace, gestalt, typography, and a whole bunch of stuff I'm probably forgetting. The most important part is not to rely entirely on your own sense of aesthetics. If it was that simple, the field of graphic design wouldn't exist -- the meme "engineers are bad at art" survives because it's often true.
I also highly recommend using Markdown for the text. I wrote my posts in Google Docs and pandoced it into html, but Markdown is way easier and you can more easily mess with the styling.
Of course, after reading all this, you may be feeling lost and overwhelmed and wondering if it's all worth it. If that's the case, I strongly recommend that you consider the CMS option. No, it's not as glamorous or high quality as a bespoke site but it'll get the job done.