perl 文件内容分析?

我有一文件ww.txt内容如下

02,10,11,18,27,30
06,09,11,14,20,31
02,10,11,18,27,33
01,03,04,16,18,22
07,14,22,27,28,32
02,10,11,16,18,27,
04,05,09,15,21,30
12,13,17,20,22,23
04,05,09,15,21,30

通过perl执行,把六个数中匹配5个及以上的去掉,就留一个,运行结果如下:

02,10,11,18,27,30
06,09,11,14,20,31
01,03,04,16,18,22
07,14,22,27,28,32
04,05,09,15,21,30
12,13,17,20,22,23

初学 线等 谢谢

一行里用逗号隔开有六个数,其中有5个或6个重复的,就把重复的去掉

02,10,11,18,27,30
06,09,11,14,20,31
02,10,11,18,27,33(和第一重复5个,去掉)
01,03,04,16,18,22
07,14,22,27,28,32
02,10,11,16,18,27(和第一重复5个,去掉)
04,05,09,15,21,30
12,13,17,20,22,23
04,05,09,15,21,30(和倒数3条重复6个,去掉)

每一条和其余的条目对比

饭前 再顶

awk:

echo '02,10,11,18,27,30
06,09,11,14,20,31
02,10,11,18,27,33
01,03,04,16,18,22
07,14,22,27,28,32
02,10,11,16,18,27
04,05,09,15,21,30
12,13,17,20,22,23
04,05,09,15,21,30'|awk '
NR==1{a[NR]=$0;next}
{ len=split($0,b,",");
  e=0
  {
  for(i=1;i<NR;i++){
  c=0
  t=gensub(",",",,","g",a[i])
  t=","t","
  for(j=1;j<=len;j++){
  d=","b[j]","
  c+=sub(d,d,t)
  }
  if(c>=5)e=1}
  }
  if(!e)a[NR]=$0
}
END{for(i=1;i<=NR;i++)printf a[i]?a[i] RS:""}'

02,10,11,18,27,30
06,09,11,14,20,31
01,03,04,16,18,22
07,14,22,27,28,32
04,05,09,15,21,30
12,13,17,20,22,23