优化多个sed语句

时间:2014-01-21 17:21:24

标签: python perl bash sed awk

我想用这种结构优化我对文件的处理:

2014-01-21 14:26:05.900,2014-01-21 14:26:05.740,    0.000,    192.168.40.2,   192.168.40.26,6    ,  8000, 33311,  172000,    2000,.A..S.,  0
2014-01-21 14:29:23.900,2014-01-21 14:29:23.340,    0.000,   192.168.40.26,    192.168.40.2,6    , 33317,  8000, 3052000,    2000,.A....,  0
2014-01-21 14:30:25.900,2014-01-21 14:30:25.330,    0.000,   192.168.40.26,    192.168.40.2,17   , 36193,   514,  558000,    2000,......,  0
2014-01-21 14:31:04.901,2014-01-21 14:31:04.222,    0.000,  192.168.40.242,    192.168.40.2,17   , 57516,   514,  422000,    2000,......,  0
2014-01-21 14:31:13.900,2014-01-21 14:31:13.143,    0.000,   192.168.40.16,    192.168.40.2,17   , 53313,   514,  540000,    2000,......,  0

到具有此结构的文件:

2014-01-21 14:26:05.900,900,0.000,192.168.40.2,192.168.40.26,6,8000,33311,172000,2000,.A..S.,0
2014-01-21 14:29:23.900,900,0.000,192.168.40.26,192.168.40.2,6,33317,8000,3052000,2000,.A....,0
2014-01-21 14:30:25.900,900,0.000,192.168.40.26,192.168.40.2,17,36193,514,558000,2000,......,0
2014-01-21 14:31:04.901,901,0.000,192.168.40.242,192.168.40.2,17,57516,514,422000,2000,......,0
2014-01-21 14:31:13.900,900,0.000,192.168.40.16,192.168.40.2,17,53313,514,540000,2000,......,0

要优化的命令:

sed -e 's/,\s\+/,/g' -i /tmp/to_filter
sed -e 's/\s\+,/,/g' -i /tmp/to_filter
while IFS=, read -r f1 f2 f3 f4 f5 f6 f7 f8 f9 f10; do
    echo "$f1,${f1##*.},$f3,$f4,$f5,$f6,$f7,$f8,$f9,$f10"
done < /tmp/to_filter

4 个答案:

答案 0 :(得分:5)

awk 'BEGIN{FS=OFS=","} {t=$2=$1; sub(/.*\./,"",$2); gsub(/ /,""); $1=t} 1' file      
2014-01-21 14:26:05.900,900,0.000,192.168.40.2,192.168.40.26,6,8000,33311,172000,2000,.A..S.,0
2014-01-21 14:29:23.900,900,0.000,192.168.40.26,192.168.40.2,6,33317,8000,3052000,2000,.A....,0
2014-01-21 14:30:25.900,900,0.000,192.168.40.26,192.168.40.2,17,36193,514,558000,2000,......,0
2014-01-21 14:31:04.901,901,0.000,192.168.40.242,192.168.40.2,17,57516,514,422000,2000,......,0
2014-01-21 14:31:13.900,900,0.000,192.168.40.16,192.168.40.2,17,53313,514,540000,2000,......,0

答案 1 :(得分:3)

这可能适合你(GNU sed):

sed -r 's/^([^,.]*\.([^,]*)),[^,]*/\1,\2/;s/\s*,\s*/,/g' file

编辑:

sed -r 's/\.([^,]*),[^,]*/.\1,\1/;s/\s*,\s*/,/g' file

答案 2 :(得分:2)

我会使用单行。它映射每个字段以删除前导和尾随空格,然后从第二个字段中删除所有字符,直到最后.,然后使用逗号连接的所有字段进行打印:

perl -F, -ane '
    @F = map { s/\A\s+//; s/\s+\Z//; $_ } @F; 
    $F[1] =~ s/\A.*\.//; 
    printf qq|%s\n|, join q|,|, @F
' infile

它产生:

2014-01-21 14:26:05.900,900,0.000,192.168.40.2,192.168.40.26,6,8000,33311,172000,2000,.A..S.,0
2014-01-21 14:29:23.900,900,0.000,192.168.40.26,192.168.40.2,6,33317,8000,3052000,2000,.A....,0
2014-01-21 14:30:25.900,900,0.000,192.168.40.26,192.168.40.2,17,36193,514,558000,2000,......,0
2014-01-21 14:31:04.901,901,0.000,192.168.40.242,192.168.40.2,17,57516,514,422000,2000,......,0
2014-01-21 14:31:13.900,900,0.000,192.168.40.16,192.168.40.2,17,53313,514,540000,2000,......,0

答案 3 :(得分:0)

使用awk

awk '{t=$1;gsub(/ /,"");split($1,a,".");$1=t;$2=a[2]}1' FS=, OFS=, file