
Jake Charles' neat finish, the striker's fourth goal of the 2025/26 season, fired the Seasiders into a first-half lead in South Tyneside before Martin's angled finish drew the Hornets level straight after the second-half restart.
A dramatic conclusion followed as the Seasiders fell behind through Martin's spot-kick, with Connor Smith punished for a blatant push on Kian Foreman inside the box, before Foreman's strike twelve minutes from time confirmed a second consecutive league defeat on away soil for Gary Liddle's side.
After a slow start to proceedings, Hebburn created the opening goalscoring opportunity in front of goal as Martin collected a through pass in a dangerous area, but the Hornets' frontman was unable to connect cleanly under tight challenge from Frankie Whelan.
Whitby survived a quick break later as Campbell Darcy's low, drilled ball was miraculously missed by Martin with the forward striking the post of debutant goalkeeper Isaac Allan's post. The young shot-stopper had signed on loan from Sunderland earlier in the day, replacing the injured Shane Bland.
After striking the crossbar moments earlier with a lobbed attempt, Whitby took the lead with an almost carbon copy effort in the 37th minute through Charles' chip after spotting Daniel Cameron off his line.
As Whitby struggled to deal with a free-kick from out wide, Liam Murray found himself in space six-yards out before slamming the ball over Allan's crossbar as the home side, with the carrot of going top of the league with a win, looked to respond.
Whitby maintained their one-goal cushion despite the North East outfit almost drawing level again before half-time, with Allan pushing Oliver Martin's curling effort around the post before Jack Donaghy's header following the resulting corner was nodded wide.
Straight from the second-half kick-off, though, Whitby found themselves back on level terms through Gary Martin's leveller. After a throw-in on half-way, the ball found its way into the striker's path who fired home into the net from an angle.
Whitby were fortunate not to concede again just after the hour mark as Murray peeled into space on the edge of the box, but could only side-foot wide.
In the 65th minute, Whitby fell behind through Martin's penalty. After Smith clearly brought Foreman down inside the box, referee Samuel Packer pointed to the spot and Whitby's new gloveman was sent the wrong way, with Martin slotting the ball into the opposite corner.
Allan delivered a timely save to prevent Darcy from firing Hebburn further ahead as the former Whitby man's low effort forced the Seasiders' 'keeper into a low smother.
With the clock ticking and Whitby struggling for attacking invention, Liddle's hopes of an equaliser were distinguished as Foreman netted Hebburn's third goal of the evening in the 78th minute. After Whitby's defence kept backing off and backing off, Foreman found space to round Allan before slotting the ball into the bottom corner.
Allan produced a key stop to prevent Foreman extending the hosts' lead in the 83rd minute as the 18-year-old 'keeper blocked the substitute's low strike with his body one-on-one, capping off a difficult evening in the North East for the visitors.