Once you have set up your Employer Allowance Claim, NICs will still be calculated and your Employer NIC liability to HMRC will be shown in column 6 of your Employer Payment Record however your payment due to HMRC each month/quarter will be reduced accordingly. The £5,000 claim will be a reducing balance over time. i.e. the £5,000 claim will be offset against your Employer NIC liability to HMRC until the £5,000 is used up. Your full Employer NIC liabilities will continue to be detailed on payslips and other reports.

Once the £5,000 has been used up the claim will automatically stop. You do not need to tell HMRC that you are stopping the claim unless you are stopping the claim early before the full £5,000 has been claimed.

Road Map - To view Employment Payment Record - EPR
Reports -> Payslips, Payroll and PAYE -View/Print -> Employer Payment Record (EPR) link.
( 'Reports' is the button positioned in the tasking zone menu at the top. It is the second button from the right)

or

Finance -> Pay HMRC (Tax & NI) -> Employer Payment Record - EPR -> View EPR link.
( 'Finance' is the button positioned in the tasking zone menu at the top. It is the fourth button from the right)