A good way to check which registrations you need across all levels of government is to use the Business Registration Services on business.gov.au.

You enter some basic details about your business and activities to get a personalised list with links to the registrations you will need.