Liferay doesn't actually set limitation on HSQL size but you shouldn't use HSQL in production because data is not safe.
There is also a size limitation in HSQL. See the following:
http://database-management-systems.findthebest.com/q/15/2791/What-limits-does-the-database-management-system-HSQLDB-by-HSQL-Development-have
