B ›³ëbº@ã@s¾dZddlZddlZddlZddlZddlZdZdZdZ Gdd„dƒZ Gdd„dƒZ Gd d „d ƒZ yddl Z ddlZWnek rŠYn0XGd d „d ejƒZGd d„dƒZGdd„dƒZdS)zˆSerial and Parallel classes to execute build tasks. The Jobs class provides a higher level interface to start, stop, and wait on jobs. éNézBuild interrupted.c@s$eZdZdd„Zdd„Zdd„ZdS)ÚInterruptStatecCs d|_dS)NF)Ú interrupted)Úself©rú(lib/python3.7/site-packages/SCons/Job.pyÚ__init__5szInterruptState.__init__cCs d|_dS)NT)r)rrrrÚset8szInterruptState.setcCs|jS)N)r)rrrrÚ__call__;szInterruptState.__call__N)Ú__name__Ú __module__Ú __qualname__rr r rrrrr4src@s@eZdZdZdd„Zdd„fdd„Zdd „Zd d „Zd d „ZdS)ÚJobsz~An instance of this class initializes N jobs, and provides methods for starting, stopping, and waiting on all N jobs. cCsjd|_|dkrLt}|dkrt}yt|||ƒ|_||_Wntk rJYnX|jdkrft|ƒ|_d|_dS)aó Create 'num' jobs using the given taskmaster. If 'num' is 1 or less, then a serial job will be used, otherwise a parallel job with 'num' worker threads will be used. The 'num_jobs' attribute will be set to the actual number of jobs allocated. If more than one job is requested but the Parallel class can't do it, it gets reset to 1. Wrapping interfaces that care should check the value of 'num_jobs' after initialization. Né)ÚjobÚexplicit_stack_sizeÚdefault_stack_sizeÚParallelZnum_jobsÚ NameErrorÚSerial)rÚnumÚ taskmasterÚ stack_sizerrrrDs   z Jobs.__init__cCsdS)NrrrrrÚaóz Jobs.cCs,| ¡z|j ¡Wd|ƒ| ¡XdS)apRun the jobs. postfunc() will be invoked after the jobs has run. It will be invoked even if the jobs are interrupted by a keyboard interrupt (well, in fact by a signal such as either SIGINT, SIGTERM or SIGHUP). The execution of postfunc() is protected against keyboard interrupts and is guaranteed to run to completion.N)Ú_setup_sig_handlerrÚstartÚ_reset_sig_handler)rZpostfuncrrrÚrunas zJobs.runcCs |j ¡S)z6Returns whether the jobs were interrupted by a signal.)rr)rrrrÚwere_interruptedqszJobs.were_interruptedcCsž|t ¡fdd„}t tj|¡|_t tj|¡|_yt tj|¡|_Wnt k rZYnX|jdks„|jdks„t |dƒrš|jdkršd}t j   t j j|¡dS)a‰Setup an interrupt handler so that SCons can shutdown cleanly in various conditions: a) SIGINT: Keyboard interrupt b) SIGTERM: kill or system shutdown c) SIGHUP: Controlling shell exiting We handle all of these cases by stopping the taskmaster. It turns out that it's very difficult to stop the build process by throwing asynchronously an exception such as KeyboardInterrupt. For example, the python Condition variables (threading.Condition) and queues do not seem to be asynchronous-exception-safe. It would require adding a whole bunch of try/finally block and except KeyboardInterrupt all over the place. Note also that we have to be careful to handle the case when SCons forks before executing another process. In that case, we want the child to exit immediately. cSs4t ¡|kr&|jj ¡|jj ¡n t d¡dS)Né)ÚosÚgetpidrrÚstoprr Ú_exit)ZsignumÚstackrZ parentpidrrrÚhandlerŠs  z(Jobs._setup_sig_handler..handlerNÚ old_sighupzŽOverwritting previous signal handler which was not installed from Python. Will not be able to reinstate and so will return to default handler.)r!r"ÚsignalÚSIGINTÚ old_sigintÚSIGTERMÚ old_sigtermÚSIGHUPr'ÚAttributeErrorÚhasattrÚSConsÚWarningsÚwarnZ SConsWarning)rr&ÚmsgrrrruszJobs._setup_sig_handlercCsŠ|jdk r|jntj}|jdk r&|jntj}t tj|¡t tj|¡y(|jdk rZ|jntj}t tj|¡Wntk r„YnXdS)zfRestore the signal handlers to their previous state (before the call to _setup_sig_handler().N) r*r(ÚSIG_DFLr,r)r+r'r-r.)rZ sigint_to_useZsigterm_to_userrrrszJobs._reset_sig_handlerN) r r r Ú__doc__rrrrrrrrrr?s (rc@s eZdZdZdd„Zdd„ZdS)rz÷This class is used to execute tasks in series, and is more efficient than Parallel, but is only appropriate for non-parallel builds. Only one instance of this class should be in existence at a time. This class is not thread safe. cCs||_tƒ|_dS)aŽCreate a new serial job given a taskmaster. The taskmaster's next_task() method should return the next task that needs to be executed, or None if there are no more tasks. The taskmaster's executed() method will be called for each task when it is successfully executed, or failed() will be called if it failed to execute (e.g. execute() raised an exception).N)rrr)rrrrrr²s zSerial.__init__c Cs´x¤|j ¡}|dkrPy| ¡| ¡r0| ¡Wn^tk r| ¡r|ytjj |j dt d‚Wq„|  ¡Yq„Xn|  ¡|  ¡Yn X| ¡| ¡qW|j ¡dS)zîStart the job. This will begin pulling tasks from the taskmaster and executing them, and return when there are no more tasks. If a task fails to execute (i.e. execute() raises an exception), then the job will stop.Nr)Úerrstr)rÚ next_taskÚprepareÚ needs_executeÚexecuteÚ Exceptionrr0ÚErrorsÚ BuildErrorÚtargetsÚ interrupt_msgÚ exception_setÚfailedÚexecutedÚ postprocessÚcleanup)rÚtaskrrrr¾s(   z Serial.startN)r r r r5rrrrrrrªs rcs(eZdZdZ‡fdd„Zdd„Z‡ZS)ÚWorkerzÙA worker thread waits on a task to be posted to its request queue, dequeues the task, executes it, and posts a tuple including the task and a boolean indicating whether the task executed successfully. cs.tƒ ¡d|_||_||_||_| ¡dS)NT)ÚsuperrZdaemonÚ requestQueueÚ resultsQueuerr)rrHrIr)Ú __class__rrrðs  zWorker.__init__cCsvxp|j ¡}|dkrPy*| ¡r6tjj|jdtd‚| ¡Wn|  ¡d}YnXd}|j   ||f¡qWdS)Nr)r6FT) rHÚgetrr0r<r=r>r?r:r@rIÚput)rrEÚokrrrrøs   z Worker.run)r r r r5rrÚ __classcell__rr)rJrrFës rFc@s8eZdZdZdd„Zdd„Zdd„Zdd „Zd d „Zd S) Ú ThreadPoolzCThis class is responsible for spawning and managing worker threads.c Cst d¡|_t d¡|_yt |d¡}Wnˆtk rt}z,tdk rdd|jd}t j   t j j |¡Wdd}~XYn@t k r²}z"dt|ƒ}t j   t j j |¡Wdd}~XYnXg|_x,t|ƒD] }t|j|j|ƒ}|j |¡qÄWdtƒkrüt |¡dS)zÅCreate the request and reply queues, and 'num' worker threads. One must specify the stack size of the worker threads. The stack size is specified in kilobytes. riNzASetting stack size is unsupported by this version of Python: zSetting stack size failed: Ú prev_size)ÚqueueZQueuerHrIÚ threadingrr.rÚargsr0r1r2ZStackSizeWarningÚ ValueErrorÚstrÚworkersÚrangerFÚappendÚlocals) rrrrrPÚer3Ú_Úworkerrrrrs$   " $ zThreadPool.__init__cCs|j |¡dS)zPut task into request queue.N)rHrL)rrErrrrL1szThreadPool.putcCs |j ¡S)z8Remove and return a result tuple from the results queue.)rIrK)rrrrrK5szThreadPool.getcCs|j |df¡dS)NF)rIrL)rrErrrÚpreparation_failed9szThreadPool.preparation_failedcCs@x|jD]}|j d¡qWx|jD]}| d¡q$Wg|_dS)z} Shuts down the thread pool, giving each worker thread a chance to shut down gracefully. Ngð?)rVrHrLÚjoin)rr[r\rrrrD<s  zThreadPool.cleanupN) r r r r5rrLrKr]rDrrrrrOs rOc@s eZdZdZdd„Zdd„ZdS)rz¹This class is used to execute tasks in parallel, and is somewhat less efficient than Serial, but is appropriate for parallel builds. This class is thread safe. cCs(||_tƒ|_t|||jƒ|_||_dS)a±Create a new parallel job given a taskmaster. The taskmaster's next_task() method should return the next task that needs to be executed, or None if there are no more tasks. The taskmaster's executed() method will be called for each task when it is successfully executed, or failed() will be called if the task failed to execute (i.e. execute() raised an exception). Note: calls to taskmaster are serialized, but calls to execute() on distinct tasks are not serialized, because that is the whole point of parallel jobs: they can execute multiple tasks simultaneously. N)rrrrOÚtpÚmaxjobs)rrrrrrrr`szParallel.__init__cCs2d}xx‚||jkrŠ|j ¡}|dkr(Py | ¡Wn$| ¡| ¡| ¡Yq X| ¡rx|j  |¡|d7}q |  ¡| ¡q W|s–|s–Px~|j  ¡\}}|d8}|r¼|  ¡n@|  ¡rôyt jj|jdtd‚Wn| ¡YnX| ¡| ¡|jj ¡r˜Pq˜WqW|j ¡|j ¡dS)zúStart the job. This will begin pulling tasks from the taskmaster and executing them, and return when there are no more tasks. If a task fails to execute (i.e. execute() raises an exception), then the job will stop.rNr)r6)r`rr7r8r@rArCr9r_rLrBrKrr0r<r=r>r?rIÚemptyrD)rZjobsrErMrrrrusH          zParallel.startN)r r r r5rrrrrrrYsr)r5Z SCons.compatr0r!r(Z SCons.ErrorsZSCons.Warningsrrr?rrrrQrRÚ ImportErrorZThreadrFrOrrrrrÚs&  k; $J