A bit of background: The theory of $({\mathbb Z}, =, >, 0, 1, +, \phi)$ is decidable (where here $\phi$ is restricted to natural numbers). This is a result of Semenov; see my answer to the question Beyond Presburger Arithmetic for more.

On the other hand, what I've described is pretty close to undecidable theories. If I included a predicate $f: {\mathbb Z} \times p^{-\infty} {\mathbb Z} \rightarrow p^{-\infty} {\mathbb Z}$ sending $(n,x)$ to $2^n \cdot x$, it would be undecidable by a result of Delon ("${\mathbb Q}$ Muni de l'Arithmetique Faible de Penzin est Decidable," Proc. of AMS, vol. 125, no 9, 1997).

I can't quite answer my own question, but I just found the paper "Describing Groups" by Andre Nies, in Bull. Symbolic Logic 13 (2007), no. 3. It seems like the theory $(p^{- \infty} {\mathbb Z}, =, +, 0)$ is decidable since it is "finite-automaton presentable" (FA-presentable). A quick guess is that the additional structure, $1$, ${\mathbb Z}$, and the predicate $\phi$ might also fit into the FA-presentable framework and give a proof of decidability. But I'd still apreciate the opinion of an expert!
–
MartySep 6 '12 at 22:13