Too Confusing?

I have this general plot of having my character move through time and space. It would start in a modern Earth setting, then go to a steampunk slash medieval fantasy setting and end up in a futuristic (spaceflight) setting before going back to a modern or post-apocalyptic setting. I have a basic understanding of timetravel (I know 3 kinds of theories, not sure if there are more) and I have a decent understanding of medieval times. Steampunk not so much but I figure by the time I get to the specifics, I'll have done some serious research. I'm rather excited about it but there's a nagging voice in the back of my head that it'll get too confusing and thus not that interesting at all. Do I listen to that voice and limit or cut the different time-settings? Or do I just go with it, confusion be damned?

I don't enjoy asking for feedback but I would really appreciate any opinion, negative or positive. You can PM me or just post in this thread.
Thanks in advance

Hi RavenMorbisk, I think that this is a cool idea but it does sound like a large undertaking, that is a lot of worlds to make realistic but if you already have an idea then go for it. I personally like reading about new worlds, how they work and so on but WHY is your character moving through space/time. What is the point? Is it like the tv series 'the sliders' or what?
A reader will follow you if you have a good, original storyline, relatable characters and if there is a reason they are doing whatever they are doing. If you believe in your worlds and characters then so will your audience. I would work on making a BIBLE - all the information, rules, etc that are related to your worlds to make it an easy reference.
Also, with so many worlds, are you planning on several 'short stories', a long novel, trilogy. Break it up into sections so that it will be 1) easier for you to write and plan, 2) the reader has something to look forward to if there are multiple books(stories).
Food for thought

@Penstorm Thanks a bunch. You've got a point with creating a bible for my universe. It is getting harder to keep track of every specific. I was planning to split each "world" into a different novel, it's a huge undertaking which is why I needed some reassurance that it wouldn't be a waste of time and energy.
It is similar to "Sliders" (flashback to childhood, fyi, never thought I'd see someone bring that show up again) but only in the way that both they and my character are simply trying to get back home.

Anyways, thank you so much for providing an answer I can work with.