All acid-base behaviour is qualified by the identity of the solvent. In water (the most common and convenient solvent) we rationalize acid/base behaviour by invoking #H_3O^+# and #HO^-# ions as the characteristic cation and anion of the SOLVENT.
For a given acid series #H-A#, we might consider the strength of the #H-A# bond as the determinant. Let's look at the strength of the #H-X# bond:
#H-F#; #570# #mol^-1#
#H-Cl#; #432# #mol^-1#
#H-Br#; #366# #mol^-1#
#H-I#; #298# #mol^-1#
The weakest bond, #H-I#, is also the STRONGEST acid. The weakest acid, #H-F#, has the strongest bond. Of course, entropy approximations are important too, as the small fluoride ion is definitely entropically DISFAVOURED (as it is smaller and more polarizing). So the answer to your question is that, for weak acids, the hydrogen-hetero-atom bond should be relatively strong. (This assumes "all things being equal" , which they never are!)