需要帮助理解Perl代码 - 多进程/分叉

时间:2015-07-07 06:55:48

标签: perl fork multiprocess

我正在寻找一个示例来限制同时运行的分叉进程数量,并且我遇到了这个旧代码

#!/usr/bin/perl
#total forks, max childs, what to run
#function takes 2 scalars and a reference to code to run
sub mfork ($$&) {
        my ($count, $max, $code) = @_;
        # total number of processes to spawn
        foreach my $c (1 .. $count) {
                #what is happening here? why wait vs waitpid?
                wait unless $c <= $max;
                die "Fork failed: $!\n" unless defined (my $pid = fork);
                # i don't undestand the arrow notation here and how it calls a function, 
                #also unless $pid is saying run function unless you're the parent
                exit $code -> ($c) unless $pid;
        }
        #no idea what's happening here, why are we waiting twice? for the last process?
        #why 1 until (-1 == wait)? what's 1 doing here
        1 until -1 == wait;
}


#code to run
mfork 10, 3, sub {
        print "$$: " . localtime() . ": Starting\n";
        select undef, undef, undef, rand 2;
        print "$$: " . localtime() . ": Exiting\n";
};

1 个答案:

答案 0 :(得分:4)

我们来看看代码。代码是您的,删除了大部分注释。所有其他评论都是我的。

#!/usr/bin/perl
# total forks, max childs, what to run
# function takes 2 scalars and a reference to code to run

sub mfork ($$&) {
        my ($count, $max, $code) = @_;

      # total number of processes to spawn
        foreach my $c (1 .. $count) {

                # wait waits for any child to return,
                # waitpid for a specific one
                wait unless $c <= $max;

                die "Fork failed: $!\n" unless defined (my $pid = fork);

                # the arrow is used to call the coderef in $code
                # and the argument is $c. It's confusing because it has
                # the space. It's a deref arrow, but looks like OOp.
                # You're right about the 'unless $pid' part.
                # If there is $pid it's in the parent, so it does
                # nothing. If it is the child, it will run the
                # code and exit.

                exit $code -> ($c) unless $pid;
        }

        # This is reached after the parent is done with the foreach.
        # It will wait in the first line of the foreach while there are
        # still $count tasks remaining. Once it has spawned all of those
        # (some finish and exit and make room for new ones inside the
        # loop) it gets here, where it waits for the remaining ones.
        # wait will return -1 when there are no more children.
        # The '1 until' is just short for having an until loop that
        # doesn't have the block. The 1; is not a costly operation.
        # When wait == -1 it passes the line, returning from the sub.
        1 until -1 == wait;
}


# because of the prototype above there are no () needed here
mfork 10, 3, sub {
        print "$$: " . localtime() . ": Starting\n";
        select undef, undef, undef, rand 2;
        print "$$: " . localtime() . ": Exiting\n";
};

让我们详细看看。

  • waitwaitpidwait等待直到任何一个孩子返回。这很有用,因为程序不关心哪个 slot 被释放。一旦完成,就可以生成一个新的。 waitpid采用特定$pid的参数。这在这里没有用。
  • $code->($c)语法运行coderef。就像%{ $foo }{bar}将取消引用hashref一样,&{ $baz }()将取消引用(并运行,即())coderef。更容易阅读的方式是$foo->{bar}$baz->()也是如此。 arraow derefs它。请参阅perlrefperlreftut

虽然这很好用,但使用Parallel::Forkmanager更有意义,它可以在更少的代码行中提供这种功能,而且你不必担心它是如何工作的。

use strict;
use warnings;
use Parallel::ForkManager;

my $pm = Parallel::ForkManager->new(3); # max 3 at the same time

DATA_LOOP:
foreach my $data (1 .. 10) {
  # Forks and returns the pid for the child:
  my $pid = $pm->start and next DATA_LOOP;

  ... do some work with $data in the child process ...
  print "$$: " . localtime() . ": Starting\n";
  select undef, undef, undef, rand 2;
  print "$$: " . localtime() . ": Exiting\n";

  $pm->finish; # Terminates the child process
}

就是这样。方式更清晰阅读。 :)