以前的blog有几篇好的文章,转回来~
如何删除文本文件中相同的行!
删除文本文件中相同的行!
如果不使用数据库,怎么样才能删除文本文件中相同的行呢?手工?!!10w行的记录你试试手工!??
下面这个脚本演示了如果删除 文本文件中 相同的行!
Const adOpenStatic = 3
Const adLockOptimistic = 3
Const adCmdText = &H0001
Set objConnection = CreateObject(”ADODB.Connection”)
Set objRecordSet = CreateObject(”ADODB.Recordset”)
Const ForReading = 1, ForWriting = 2, ForAppending = 8
strPathToTextFile = “D:\”
strFile = “done.txt”
objConnection.Open “Provider=Microsoft.Jet.OLEDB.4.0;” & _
“Data Source=” & strPathtoTextFile & “;” & _
“Extended Properties=”"text;HDR=NO;FMT=Delimited”"”
objRecordSet.Open “Select DISTINCT * FROM ” & strFile, _
objConnection, adOpenStatic, adLockOptimistic, adCmdText
Do Until objRecordSet.EOF
str = objRecordSet.Fields.Item(0).Value
Dim fso, f
Set fso = CreateObject(”Scripting.FileSystemObject”)
Set f = fso.OpenTextFile(”D:\namelist.txt”, ForAppending, True)
f.WriteLine str
f.Close
objRecordSet.MoveNext
Loop
D:\done.txt 是原始文件
D:\namelist.txt 是生成后的文件
参照:http://www.microsoft.com/china/technet/community/scriptcenter/resources/
hey050819.mspx