Functors for complex tasks

[hgrecco]

Hello,

I am working on a program that must perform a certain task on numeric data stored in a file. The task is given by user input from a list of possible tasks.

The file has some particular format and I have already a loop that is able to read sequentially data from the file. The question is how to operate with the data inside the loop in an efficient way.

The straight forward way (which I did) is creating as many functions as tasks are defined, each function containing the same file reading loop but with a different part inside.

To give a simple example, let's say that I want to sum all the content of the file

double Task1(string &filename) {
// Opening part of the reading loop
// Code to operate on one element at a time and perform task 1
// Closing part of the reading loop
}
 
double TaskSum(string &filename) {
 
double sum = 0;
 
// Opening part of the reading loop Identical!!!
// the value of the last read element is stored in el
 
sum += el;
 
// Closing part of the reading loop Identical !!!
 
return sum;
}
 
 

And this for all tasks.

However, this is a nightmare to maintain and to expand. It will be also very annoying to perform the same tasks in other file type. That's why I would like to use function objects to do it. However, I am not sure how to do it in an appropriate way. The tasks that I need to perform most of the time need to keep some persistent information. Going back to my example before, Is the following code the most efficient way to do it using function objects? Will the performance be the same as the previous case?

class tasks
   {
   public:
 
      virtual void do(double el)=0;  
      virtual double result()=0;
   };
 
 
 
class sumtask : public tasks
   private:
    double current;
 
   public:
 
      sumtask(): current(0) {} ;
      void do(double el) { current += el; };
      double result() { return current; };
 
   };
 
 
 
void Task(string &filename, tasks &t) {
// Opening part of the reading loop Identical!!!
// the value of the last read element is stored in el
 
t.do(el);
 
// Closing part of the reading loop Identical !!!
return t.result();
}
 
 
int main(int argc, char* argv[]) {
string f = "file.bin";
sumtask t;
double result = Task(f, t);
}
 
 

I am using c++ compiled with gcc 4.0.1.

Thanks in advance,

Hernán

[arnaudk]

I'm not sure what you mean by function objects since you don't use them in your example; function objects or functors overload operator(). It seems like you need to come up with a suitable abstraction for the file and the task so that the internals of the file abstraction can change depending on the file type independently to its interface as used by the task, which can then treat all file objects in the same way.

[JosAH]

Remove the reading of the file part from your tasks and read up on the 'strategy'
pattern. Basically you want to do something with a sequence of numbers. Define
an abstract class Task that represents the number processing:

public:
   void preprocess() = 0;
   void process(double x) = 0;
   double postprocess() = 0;
 

All your 'concrete' tasks inherit from this abstract class and implement the
methods mentioned above.

Define a 'driver' class that does the file reading; the driver class is passed one
or more task class. While reading those numbers it activates the methods
defined in the task class.

Basically your driver class doesn't know what task it calls and the task(s) doesn't
know where these numbers come from but both do what they have to do. You
can call your driver class with different tasks without changing any code at all.
This is the strategy pattern in a nutshell.

kind regards,

Jos

[hgrecco]

I'm not sure what you mean by function objects since you don't use them in your example; function objects or functors overload operator(). It seems like you need to come up with a suitable abstraction for the file and the task so that the internals of the file abstraction can change depending on the file type independently to its interface as used by the task, which can then treat all file objects in the same way.

Thanks for the answer. This is exactly one of the problems. All examples that I have seen overloading operator() involve operations without memory, they do what they have to do in the current element and they do not remember anything of the past. Which is the efficient way to define a functor with state?

Thanks,

Hernan

[hgrecco]

Hi Jos,

Thanks for the reply. I tried your idea and is working fine. I wrote it using iterators so I can also use vectors or other STL containers.

As I pointed out in my other reply, I still would like to know how to implement efficient functors with state. Please do not close the thread.

Thanks,

Hernan

[JosAH]

Thanks for the reply. I tried your idea and is working fine. I wrote it using iterators so I can also use vectors or other STL containers.

As I pointed out in my other reply, I still would like to know how to implement efficient functors with state. Please do not close the thread.

There's no reason at all to close this thread; it's a nice change compared to. all
the crap that is posted in here ;-)

A functor is just a class that overloads the operator() operator, so you're free to
do in that method whatever you want. I don't see the problem. Care to elaborate?

kind regards,

Jos

[arnaudk]

Which is the efficient way to define a functor with state?

I don't see why you can't have a functor class with data members, then objects of that class will be function objects which retain a state. If you need to share a state across all function objects of a certain class, then you can use a static member. This being said, I don't see how function objects are really relevant to your specific problem; implementing the suggestions in post#3 should do it.

[hgrecco]

Thanks for all the comments and suggestions. My problem is not how to do a specific task, but how to do it in a maintainable and efficient (fast executing code) way.

While trying to understand what was bothering me, I found (again) something that I read sometime ago (and I forgot because I never used it) in Stroustrup faq

class Sum {
int val;
public:
Sum(int i) :val(i) { }
operator int() const { return val; } // extract value
int operator()(int i) { return val+=i; } // application
};

Note that a function object with an inline application operator inlines beautifully because there are no pointers involved that might confuse optimizers.

What I do not know is how to write function objects (or other classes) in a way that the mentioned optimization always take place. Of course I can profile (and indeed I do) but it would be nice to have some a priori guidelines.

Let me give another example. Let's say I need to populate a vector (vOut) with calculations that come from subsets of another one (vIn). How the subsets are defined are part of my outer loop and it is the same for all tasks. What to do with the subset changes from task to task.

So:

void task(vector<double> &vIn, vector<double> &vOut, tasks &t) {
 
// Outer Loop.
// The following variables are updated in each iteration
//  i is the iteration index
//  start is the iterator of vIn that define the start of the subset 
//  end is the iterator of vIn that define the end of the subset
 
vOut[i] = t(start, end);
 
// End of the outer loop
 
}
 
 

If t is an STL function like accumulate, the resulting binary will be the same as if I had written the code to do this operation directly inside the loop. How can I write function that keep this characteristic? For example, Will the following task also be inlined?

class sometask {
    double val;
    vector <double> v;
public:
    sometask (double i) :val(i) { }
 
    operator double() const {
         return val;
         }
 
    double operator()(iterator start, iterator end ) {        
        vector <double> tmp;
        set_difference(start, end, v.begin(), v.end(), tmp);
        v.swap(tmp);
        return val+=accumulate(v.begin(), v.end());
     }
};
 

Regards,

H

[safaaa]

hi how are you?????
i hope to u all the best in your life....
please i want course in java (console application)
thanks

[JosAH]

hi how are you?????
i hope to u all the best in your life....
please i want course in java (console application)
thanks

1) This is the C and C++ forum;
2) you're hijacking someone else's thread; that is rude.

kind regards,

Jos (moderator)