Read between tags in txt file.

[Andy E]

Hi,

I've been strugling with a problem I hope some of you can help me with. It's probably fairly easy but i haven't been able to crack the nut. I have a file with tags like shown below (or attached). I'm interested in the information between the tags.

The information is dynamic so the number of lines between the tags can change but the schema is always the same. Any ideas on how to solve this?
I have been experiencing with readline and readlines() but either i get to much or to little information out.

<--table GenerelStatistics starts-->
Name Count Maximum Minimum Mean
ContextCreated 3521 23.9259986877441 0 0.341778182875057 1.75451453132994 1203.40098190308
ContextCreationFailed 2 0.671998977661133 0.562999725341797 0.617499351501465 0.077074110459266 1.23499870300293
ContextCreationTimeout 0 0 0 0 0 0
<--table GenerelStatistics ends-->

<--table ContextCreated starts-->
Name Count Maximum Minimum Mean StandardDeviation Sum
AGS10SetupTest/KomColumbia 0 0 0 0 0 0
AGS10SetupTest/Kommuner 19 0.0159988403320313 0 0.00247363040321752 0.00587228232873751 0.0469989776611328
AGS10SetupTest/KomWebberville 0 0 0 0 0 0
<--table ContextCreated ends-->

<--table ContextCreationFailed starts-->
Name Count Maximum Minimum Mean
0 0
AppMan/elfaville 0 0 0 0 0 0
Dimension 0 0 0 0 0 0
Dimension1 0 0 0 0 0 0
<--table ContextCreationFailed ends-->

Cheers

[dwblas]

You can use groupby to do that. This is a test program where the data was changed to the sample you posted. For further help, post the code you are using as it is impossible to guess which parts of Python you want to use on this problem.

from itertools import groupby
 
def key_func(rec):
    if rec.strip().startswith("<--"):
        return True
    return False
 
test_data="""<--table GenerelStatistics starts-->
 Name Count Maximum Minimum Mean
 ContextCreated 3521 23.9259986877441 0 0.341778182875057 1.75451453132994 1203.40098190308
 ContextCreationFailed 2 0.671998977661133 0.562999725341797 0.617499351501465 0.077074110459266 1.23499870300293
 ContextCreationTimeout 0 0 0 0 0 0
 <--table GenerelStatistics ends-->
 
 <--table ContextCreated starts-->
 Name Count Maximum Minimum Mean StandardDeviation Sum
 AGS10SetupTest/KomColumbia 0 0 0 0 0 0
 AGS10SetupTest/Kommuner 19 0.0159988403320313 0 0.00247363040321752 0.00587228232873751 0.0469989776611328
 AGS10SetupTest/KomWebberville 0 0 0 0 0 0
 <--table ContextCreated ends-->
 
 <--table ContextCreationFailed starts-->
 Name Count Maximum Minimum Mean
 0 0
 AppMan/elfaville 0 0 0 0 0 0
 Dimension 0 0 0 0 0 0
 Dimension1 0 0 0 0 0 0
 <--table ContextCreationFailed ends-->
"""
 
test_list=test_data.split("\n")
groups=[]
for k, g in groupby(test_list, key=key_func):
    groups.append(list(g))      # Store group iterator as a list
for group in groups:
    print group, "\n"
 
## or
print "-"*50
for ctr in range(0, len(groups), 2):
    print groups[ctr]
    print groups[ctr+1]
    print "-"*50 

[Andy E]

Hi Dwblas,

Thanks for the answer. I made it work using the following to identify the tags.

#Input data
f = open(r'C:\Projekter\AGS_Statistics\output.txt')
line = f.readlines()

for position, item in enumerate(line):
if item == "<--table ArcGISConfiguration starts-->\n":
print position

However i would have to do that for every tag. Your way seems a lot smarter so I'll try to implement that instead. Thanks a lot