luatableoptimizer's Introduction

LuaTableOptimizer

Simple readonly lua table optimizer

Lua Table 通常被用来存储游戏的配置数据，如果配置中有很多冗余重复的数据那么将占用较多的内存，严重影响加载速度

Lua table commonly use to store configuration data for games. it takes a lot of memory if it contains many fields with same value. this optimization could improve memory usage and loading speed.

功能

获取字段中使用最多次数的值作为默认值，并且删除默认值字段
使用了非ASCII字符集字符的字段被视为需要做多语言化处理并提取替换成特殊标识符
唯一化所有的子table，并且指向同一个引用，以节约内存

Features

remove default value fields ( store them into metatable )
auto localization
reuse all table values to save memory

Require

The key of root table must be all string or number type

Before

{
	{
		1,
		2,
		3,
		a = "123",
		b = "123"
	},
	{
		1,
		2,
		3,
		a = "123",
		b = "123"
	},
	{
		1,
		2,
		5,
		a = "123",
		b = "123"
	},
	[9] = {
		1,
		2,
		5,
		a = "123",
		b = "123"
	},
	[11] = {
		1,
		2,
		3,
		a = "123",
		b = "123",
		c = {
			{
				1
			},
			{
				1
			},
			{
				2
			},
			{
				2
			}
		},
		d = {
			{
				1,
				a = 1
			},
			{
				2,
				a = 2
			}
		},
		e = {
			{
				1,
				a = 1
			},
			{
				2,
				a = 2
			}
		}
	},
	[100] = {
		1,
		2,
		3,
		a = "tttt",
		b = "123"
	}
}

Optimized

local __rt_1 = {
}
local __rt_2 = {
	1,
	2,
	3
}
local __rt_3 = {
	1,
	2,
	5
}
local __rt_4 = {
	{
		1,
		a = 1
	},
	{
		2,
		a = 2
	}
}
local __rt_5 = {
	1
}
local __rt_6 = {
	2
}
local test = 
{
	__rt_2,
	__rt_2,
	__rt_3,
	[9] = __rt_3,
	[11] = {
		1,
		2,
		3,
		c = {
			__rt_5,
			__rt_5,
			__rt_6,
			__rt_6
		},
		d = __rt_4,
		e = __rt_4
	},
	[100] = {
		1,
		2,
		3,
		a = "tttt"
	}
}
local __default_values = {
	a = "123",
	b = "123",
	c = __rt_1,
	d = __rt_1,
	e = __rt_1
}
do
	local base = { __index = __default_values, __newindex = function() error( "Attempt to modify read-only table" ) end }
	for k, v in pairs( test ) do
		setmetatable( v, base )
	end
	base.__metatable = false
end

return test

luatableoptimizer's Issues

串行化table 以数字开始key失败

如果导出表的key以数字开始如 100_s，就失败，因为lua不允许以数字为前缀的变量，建议修改为：

if string.match(name,'^%d+') then
    append( "[\"")
    append( name )
    append("\"]" )
else
    ...

运行示例报错

我用lua5.1运行lua DataTableOptimizer.lua，得到一个报错。

lua: DataTableOptimizer.lua:1345: bad argument #2 to 'format' (string expected, got nil)
stack traceback:
        [C]: in function 'format'
        DataTableOptimizer.lua:1345: in function 'postOutput'
        DataTableOptimizer.lua:1250: in function 'SaveDatasetToFile'
        DataTableOptimizer.lua:1455: in main chunk
        [C]: ?

datasetName是一个空值
我觉得1257行应该改为