If you are late in registering for Goods & Services Tax (GST), you will be guilty of an offence and be liable on conviction to a fine up to S$10,000 and to a penalty equal to 10% of the tax due in respect of each year commencing from the date on which you are required to make the notification or to apply for registration.
FAQ : Singapore GST / Taxation & Accounting