The Co-op store in Debenham was targeted by ram raiders in the early hours of the morning.
Police were called to the store in Chancery Lane at 3.33am and discovered a JCB had been used in the attack.
The ATM had been ripped from the wall, the officers from Suffolk police said.
Police have arrested one person in connection with the raid.
It is not the first time that a ram raid has occurred at the store. A cash machine was taken from the side of the store back in February 2018.
James Newson from Henry Abbott Hardware next to Coop and he said: "I'm surprised, I didn't think they were going to put another cash machine in.
"There will be an impact, people think that we are shut then they can't get cash out either.
"It was a concern as last time there was a hole in the wall for a long time."
A neighbour said: "I am dumbfounded, I don't get why they do that. It just puts everything on hold."
Other businesses surrounding the Co-op remain open and unaffected. See more here
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here