Yes, it is that simple.

Contracts are optional, but may be useful to be clear.

Invoices are easy, you can make them in word or excel, or notepad, or on a napkin.

Regarding expenses, more info is required (eg where you are, do you have a company, ect)