I Retired at 62, Then Went Back to Work at 64 – The Costly Mistake I Didn’t Expect

Honestly, I thought I had it all figured out. Two years into retirement felt like freedom – waking up without an alarm, coffee on the porch, maybe a round of golf midweek. Yet here’s the thing nobody warned me about: sitting still gets old fast. By 64, boredom crept in, my budget felt tighter than expected, and when an old colleague reached out with a part-time opportunity, I jumped at it. Seemed like an easy win.

Turns out, going back to work after claiming Social Security early came with financial surprises I never saw coming. What looked like extra income quickly became a lesson in penalties, hidden taxes, and Medicare surcharges I didn’t even know existed.

The Social Security Earnings Test Hit Harder Than I Realized

For 2026, if you’re under full retirement age and earning above $24,480, the Social Security Administration subtracts $1 for every $2 you earn over that threshold. I was making nearly double that in my part-time consulting gig. The math wasn’t pretty.

Let’s be real – when you’re 64 and working again, you’re not at full retirement age yet. In 2025, the earnings limit stood at $23,400, meaning even modest employment could trigger benefit reductions. Social Security withholds full monthly benefit payments until the total penalty amount is recovered, so some months I received nothing at all. It felt like the government was taking back what I’d already earned, even though technically those benefits would be adjusted later.

My Medicare Premiums Spiked Because of IRMAA

Here’s where it gets messy. For 2025, beneficiaries whose 2023 income exceeded $106,000 for individuals or $212,000 for joint filers pay a higher Medicare Part B premium, with the basic rate at $185 plus surcharges ranging from $74 to $443.90. My new income from consulting pushed me just over that first threshold.

The 2025 IRMAA brackets are based on your modified adjusted gross income from two years prior – so for 2025, it’s your 2023 income. That two-year lag meant my premium increase came as a complete shock. I thought I was being smart by working in 2024, but the income spike caught up with me in 2025.

The worst part? If your income crosses into the next IRMAA bracket by even $1, your Medicare premiums can suddenly jump by over $1,000 per year – and if you’re married and both on Medicare, that doubles. Nobody mentions this stuff when you’re weighing whether to take that job offer.

The Tax Bite on My Social Security Benefits Got Bigger

I’d been paying some taxes on my Social Security already, but adding work income made it worse. Single filers with provisional income between $25,000 and $34,000 pay federal income tax on up to half of their Social Security benefits, while those above $34,000 can see up to 85% of benefits taxed. My consulting pushed me well into that higher tier.

An estimated half of Social Security recipients pay federal income tax on their benefits, and I was definitely part of that group now. What stung most was realizing my extra work income wasn’t just reducing my Social Security checks temporarily – it was also increasing the portion of those benefits subject to taxation. Talk about a double whammy.

The combined effect of reduced benefits and higher taxes meant my actual take-home wasn’t nearly what I’d expected when I signed that contract. I remember staring at my bank statements thinking, “Where did all that money go?”

The Hidden Costs Nobody Talks About

Beyond the government penalties, there were expenses I completely overlooked. Income taxes, costs associated with employment like commuting and clothing expenses, and the loss of free time can make returning to work not worth the reduction in benefits. Suddenly I needed business clothes again, gas money for the commute, and lunches that weren’t just leftovers from my fridge.

Roughly half – 48% – of those working in retirement felt they needed to work for financial reasons, while a similar portion, 45%, chose to work for social and emotional benefits. I fell somewhere in between, but looking back, the financial math didn’t add up like I’d hoped. The mental stimulation was nice, sure, but I could’ve found that through volunteering without the tax headaches.

I think the real mistake was not running the numbers beforehand. A financial advisor could have mapped this out, shown me exactly what I’d lose in Social Security reductions, Medicare surcharges, and taxes. Instead, I learned by painful experience.

What I Wish I’d Known Before Going Back

Sometimes the pitfalls may be worse than what you gain from that job, as one financial planner bluntly put it. I wish someone had told me that before I jumped back in. Social Security recalculates your benefit when you reach full retirement age, giving credit for months when benefits were reduced due to excess earnings – but that didn’t help me pay bills in the meantime.

According to a 2023 SSA report, older workers are increasingly moving in and out of the labor force before permanently leaving, and I’m proof of that trend. Yet most of us don’t understand the financial traps waiting if we claim benefits early and then “unretire.” The IRMAA surcharge alone was a concept I’d never heard of until it showed up on my Medicare bill.

If I could do it over, I’d have waited until 67 to claim Social Security, or at least consulted a professional before taking that job at 64. The short-term income wasn’t worth the long-term headaches and the months where I felt like I was working for free while the government clawed back my benefits.

Going back to work in retirement isn’t automatically a bad move, but timing matters. Income limits matter. Understanding the two-year IRMAA lag matters. And honestly? Sometimes staying retired, even if it’s boring, is the smarter financial choice. Did you expect all these hidden costs when going back to work? Most people don’t – and that’s exactly the problem.