Hi,
You can do that by creating one product listing module for each category and then adding them with the loadposition system of joomla in a joomla article:
docs.joomla.org/How_do_you_put_a_module_inside_an_article%3F
For each module, you will have a set of options where you will be able to select the number of columns, the display layout, the category information which will be display etc.
And if you need to do some cosmetic changes, you will be able to do it by editing the files of the view product via the menu Display->Views.