He said security forces killed six of the attackers after two of them carried out suicide attacks near the building's entrance.
Earlier, health department officials in the city said hospitals had received at least four dead bodies and 20 wounded people.
There has been a coordinated attack by suicide bombers and gunmen at a government building in the city of Jalalabad, where a gunbattle is under way. Most have been in the capital Kabul, but in January, gunmen attacked an office of aid group Save the Children in Jalalabad, killing at least five people and wounding 25.
A auto bomb was detonated at the entrance to the state accounts office before a group of about six attackers armed with machine guns and rocket-propelled grenades rushed the building, the officials said. No one has claimed responsibility for the attack.
It was the latest deadly violence to strike Afghanistan as terror groups step up attacks and US-backed Afghan forces intensify airstrikes and ground offensives.More news: Heavy showers, thunderstorms expected Saturday
Earlier, an explosion at a mosque in the eastern Afghan province of Khost killed at least 13 people and wounded 31 and the casualty total may rise.
But ISIS has also stepped up its attacks in recent months, particularly in Kabul.
Heavy security forces arrived at the spot of the attack.
This article has been adapted from its original source.