There are all sorts of hierarchies and classes of computing models that are "infinite" in any of a large set of different ways. However, Gödel's theorems apply regardless because Gödel's theorems are about mathematics, not computing.
You can in principle devise extensions of formal systems in which you allow infinite numbers of axioms and/or axiom schemata, but they're actually boring in many ways. Gödel's 1st incompleteness theorem doesn't apply because you can just list every sentence of the complete theory in the axioms. Such a theory still can't prove its own consistency though, since it can't even express its own consistency - its infinitely many axioms can't be expressed in one proposition.
Things get messier when you allow infinitely complex sentences. This is related to some forms of hyper-computation in the sense that any operation on such sentences would require both infinite memory and more computation than a Turing machine. There are theorems analogous to Gödel's for such infinitary logics, even for arbitrary infinite cardinalities, but also plenty of unresolved problems including somewhat arbitrary choices in how finite logic should be extended to infinitary.
Computing uncountably infinite "stuff" is not well defined as stated. So all I can say to if it can "solve undecidable problems" is "Yes, some of them." Which ones depends on what level of hypercomputer you've made, and how high up the arithmetical hierarchy it can take you.
There is a generalized halting problem: no oracle can solve its own halting problem.
Since you mentioned countability, I'll say I do not know whether any particular type pf hypercomputer would be capable of assigning a specific cardinality (-n for some n) to the reals.
Turing's undecidable problems, Godel's Incompleteness theorems, and more show that arbitrarily powerful computers can't do certain things, like map all of the mathematical multiverse.
But what happens if we modify it to make a hypercomputer? Specifically such a machine can do the following:
Can compute uncountably infinite stuff in finite time.
Now, the question. Can it evade Godel's Incompleteness theorems and solve undecidable problems?
(If you want a story, imagine a different universe where the dark energy constant is set to zero, resulting in a Tiplerian scenario of Omega, or where Planck's constant is zero.)
EDIT: I'll also augment the computer with an infinite memory bank.