To customize and format page margins in OneNote Online, you can use the following steps:

1. Open the page where you want to change the margins.
2. Select View from the top toolbar.
3. Choose Page Setup from the dropdown menu.
4. In the Page Setup window, select new margins or type in your custom margins in the Margin & Padding section.
5. Select Ok when settings are complete.