<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>&#8220;scheduler&#8221; &#8211; bablick.de</title>
	<atom:link href="https://bablick.de/tag/scheduler/feed/" rel="self" type="application/rss+xml" />
	<link>https://bablick.de</link>
	<description>Writing About Clusters, Curiosity, and Everything in Between.</description>
	<lastBuildDate>Wed, 05 Nov 2025 06:12:53 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.8.3</generator>

<image>
	<url>https://bablick.de/wp-content/uploads/2025/08/cropped-BablickLogo-1-32x32.png</url>
	<title>&#8220;scheduler&#8221; &#8211; bablick.de</title>
	<link>https://bablick.de</link>
	<width>32</width>
	<height>32</height>
</image> 
	<item>
		<title>Qontrol – A Modern Web UI for Gridware Cluster Scheduler</title>
		<link>https://bablick.de/qontrol-a-modern-web-ui-for-gridware-cluster-scheduler/</link>
		
		<dc:creator><![CDATA[ernst.bablick]]></dc:creator>
		<pubDate>Mon, 27 Oct 2025 19:18:19 +0000</pubDate>
				<category><![CDATA[HPC]]></category>
		<category><![CDATA[IT]]></category>
		<category><![CDATA["Cluster Management"]]></category>
		<category><![CDATA["Gridware Cluster Scheduler"]]></category>
		<category><![CDATA["HPC-Gridware"]]></category>
		<category><![CDATA["qmon"]]></category>
		<category><![CDATA["Qontrol"]]></category>
		<category><![CDATA["scheduler"]]></category>
		<category><![CDATA["Web UI"]]></category>
		<guid isPermaLink="false">https://bablick.de/?p=155</guid>

					<description><![CDATA[With our latest announcement at HPC-Gridware, we’re introducing Qontrol — a completely new, web-based user interface for Gridware Cluster Scheduler. For many years, qmon was the graphical management tool for Grid Engine and its derivatives. Maintaining this legacy Motif-based application had become increasingly difficult — both technically and from a usability perspective.With Qontrol, we are...]]></description>
										<content:encoded><![CDATA[
<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:33.33%"><figure class="wp-block-post-featured-image"><img fetchpriority="high" decoding="async" width="512" height="512" src="https://bablick.de/wp-content/uploads/2025/10/Qontrol-Dashboard-Overview-e1761592596433.png" class="attachment-post-thumbnail size-post-thumbnail wp-post-image" alt="Qontrol Web UI for GCS" style="object-fit:cover;" /></figure></div>



<div class="wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:66.66%">
<p>With our latest announcement at <a href="https://hpc-gridware.com/introducing-qontrol-modern-web-ui-for-gridware-cluster-scheduler/">HPC-Gridware</a>, we’re introducing <strong>Qontrol</strong> — a completely new, web-based user interface for <strong>Gridware Cluster Scheduler</strong>.</p>
</div>
</div>



<span id="more-155"></span>



<p>For many years, <em>qmon</em> was the graphical management tool for Grid Engine and its derivatives. Maintaining this legacy Motif-based application had become increasingly difficult — both technically and from a usability perspective.<br>With <strong>Qontrol</strong>, we are starting fresh: a <strong>modern, responsive, browser-based</strong> interface designed to support administrators and users of large HPC environments.</p>



<p>Qontrol provides direct insight into cluster status, jobs, queues, and resource usage — all presented through a clean and flexible UI that can adapt to a wide range of display environments.<br>It is built to integrate seamlessly with existing <strong>Gridware Cluster Scheduler</strong> installations, requiring no additional client software.</p>



<p>The initial release focuses on <strong>monitoring and visualization</strong>, but we are actively working on <strong>interactive management capabilities</strong> and <strong>customizable dashboards</strong> for upcoming versions.</p>



<p>You can find the full introduction and feature overview in our main post:<br>👉 <a href="https://hpc-gridware.com/introducing-qontrol-modern-web-ui-for-gridware-cluster-scheduler/">Introducing Qontrol – A Modern Web UI for Gridware Cluster Scheduler</a></p>



<p>Stay tuned — this marks the beginning of a new generation of tools built around <strong>Gridware Cluster Scheduler</strong>.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Understanding Binding in Gridware Cluster Scheduler</title>
		<link>https://bablick.de/understanding-binding-in-gridware-cluster-scheduler/</link>
		
		<dc:creator><![CDATA[ernst.bablick]]></dc:creator>
		<pubDate>Sat, 25 Oct 2025 20:13:16 +0000</pubDate>
				<category><![CDATA[HPC]]></category>
		<category><![CDATA[IT]]></category>
		<category><![CDATA["chiplet"]]></category>
		<category><![CDATA["core binding"]]></category>
		<category><![CDATA["Gridware Cluster Scheduler"]]></category>
		<category><![CDATA["parallel computing"]]></category>
		<category><![CDATA["scheduler"]]></category>
		<category><![CDATA["socket binding"]]></category>
		<category><![CDATA["thread binding"]]></category>
		<category><![CDATA[Binding]]></category>
		<category><![CDATA[NUMA]]></category>
		<guid isPermaLink="false">https://bablick.de/?p=133</guid>

					<description><![CDATA[Modern compute nodes have grown increasingly complex — featuring heterogeneous cores, multi-level caches, and intricate NUMA topologies. In the previous post, Compute Nodes with Heterogeneous Topology in Gridware Cluster Scheduler, we looked at how these topologies are detected and represented in Gridware Cluster Scheduler. This post explores binding — how the scheduler decides where exactly...]]></description>
										<content:encoded><![CDATA[
<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:33.33%"><figure class="wp-block-post-featured-image"><img decoding="async" width="512" height="512" src="https://bablick.de/wp-content/uploads/2025/10/Brain-Topology-Binding-e1761421460621.png" class="attachment-post-thumbnail size-post-thumbnail wp-post-image" alt="Binding Topology" style="object-fit:cover;" /></figure></div>



<div class="wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:66.66%">
<p>Modern compute nodes have grown increasingly complex — featuring heterogeneous cores, multi-level caches, and intricate NUMA topologies. In the previous post, <a href="https://bablick.de/compute-nodes-with-heterogenious-topology-in-gridware-cluster-scheduler/"><em>Compute Nodes with Heterogeneous Topology in Gridware Cluster Scheduler</em></a>, we looked at how these topologies are detected and represented in <strong>Gridware Cluster Scheduler</strong>.</p>



<p>This post explores <strong>binding</strong> — how the scheduler decides <em>where</em> exactly a job runs within a node, and how users can control this behavior for optimal performance.</p>
</div>
</div>



<span id="more-133"></span>



<h2 class="wp-block-heading">Why Binding Matters</h2>



<p>In high-performance computing (HPC), <strong>resource binding</strong> defines how processes or threads are mapped to specific CPU resources. Effective binding ensures predictable performance by preventing multiple jobs from competing for the same core, cache, or memory subsystem. It also enhances bandwidth utilization for attached devices such as network interfaces, InfiniBand adapters, and GPUs by maintaining locality between compute tasks and their associated hardware resources..</p>



<p><strong>Gridware Cluster Scheduler</strong> treats binding as a <strong>first-class resource</strong>. Unlike traditional schedulers where binding was merely a hint, in Gridware Cluster Scheduler it is a <strong>hard requirement</strong> — a job will only start once the requested binding can be fulfilled.</p>



<h2 class="wp-block-heading">From Slots to Binding</h2>



<p>If you’ve read the previous post, you already know about the <strong>slot concept</strong> — where each slot represents a unit of computational capacity on a node. Here’s the full analogy that makes the difference between <em>slots</em> and <em>binding</em> concrete:</p>



<ul class="wp-block-list">
<li><strong>Slots = seats on an airplane.</strong> A compute node has a fixed number of slots, just as a plane has a fixed number of seats. Each sequential job and each task of a parallel job needs <strong>one slot</strong>, like each passenger needs <strong>one seat</strong>.</li>



<li><strong>Binding = weight-balanced placement and freight.</strong> Binding determines <em>where</em> the job runs within the node. In the airplane analogy, that’s like <strong>assigning specific rows/sections</strong> and <strong>placing freight in defined compartments</strong> to maintain balance. Similarly, binding pins tasks to <strong>threads, cores, sockets, dies (L3), or NUMA nodes</strong> so they benefit from nearby caches and memory and don’t interfere with other workloads.</li>
</ul>



<p>In short: slots define <strong>how many</strong>, binding defines <strong>where</strong> — the placement that preserves locality and stability.</p>



<h2 class="wp-block-heading">Binding Units and Amounts</h2>



<p>Binding behavior is primarily controlled with the <code>-bunit</code> and <code>-bamount</code> parameters during job submission.</p>



<h3 class="wp-block-heading">Define the Binding Level with <code>-bunit &lt;unit&gt;</code></h3>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:100%">
<figure class="wp-block-table"><table><thead><tr><th>Unit</th><th>Description</th></tr></thead><tbody><tr><td><strong>T</strong> or <strong>CT</strong></td><td>CPU thread of a power core</td></tr><tr><td><strong>ET</strong></td><td>CPU thread of an efficiency core</td></tr><tr><td><strong>C</strong></td><td>Power core (default)</td></tr><tr><td><strong>E</strong></td><td>Efficiency core</td></tr><tr><td><strong>S</strong> or <strong>CS</strong></td><td>All power cores of a socket</td></tr><tr><td><strong>ES</strong></td><td>All efficiency cores of a socket</td></tr><tr><td><strong>X</strong> or <strong>CX</strong></td><td>All power cores sharing the same L3 cache (chiplet/die)</td></tr><tr><td><strong>EX</strong></td><td>All efficiency cores sharing the same L3 cache</td></tr><tr><td><strong>Y</strong> or <strong>CY</strong></td><td>All power cores sharing the same L2 cache</td></tr><tr><td><strong>EY</strong></td><td>All efficiency cores sharing the same L2 cache</td></tr><tr><td><strong>N</strong> or <strong>CN</strong></td><td>All power cores of a NUMA node</td></tr><tr><td><strong>EN</strong></td><td>All efficiency cores of a NUMA node</td></tr></tbody></table></figure>
</div>
</div>



<p>Each unit level corresponds to a layer in the hardware hierarchy. </p>



<h3 class="wp-block-heading">Specify the Number of Units with <code>-bamount &lt;number&gt;</code></h3>



<p>The <strong>binding amount</strong> defines how many binding units should be assigned per slot (or per host).</p>



<pre class="wp-block-code"><code>qsub -pe mpi_8 16 -bunit C -bamount 2 ...</code></pre>



<p>This job requests 16 slots across two hosts. Each slot binds to <strong>two power cores</strong>, ideal for tasks starting two lightweight threads (or processes).</p>



<p>If the threads are tightly coupled, <strong>thread binding</strong> can be more suitable:</p>



<pre class="wp-block-code"><code>qsub -pe mpi_8 16 -bunit T -bamount 2 ...</code></pre>



<p>Binding threads instead of cores can enhance total cluster throughput by minimizing stalls from system calls, cache misses, and network delays, and by improving cache locality (especially for producer–consumer pairs). While each job may take up to twice as long to complete, the increased parallelism—running twice as many jobs simultaneously—often results in a net performance improvement of 5–10%.</p>



<p>Chiplet or die binding can be especially beneficial on modern CPUs where groups of cores share a common L3 cache. By aligning tasks to those chiplets, cache locality is preserved and cross-die memory traffic is minimized.</p>



<pre class="wp-block-code"><code>qsub ... -btype host -bunit X -bamount 1</code></pre>



<p>This command binds each job or task to all cores that share the same L3 cache. It ensures that the job exclusively uses that cache domain and its attached resources (e.g. GPU or I/O devices), preventing other jobs from interfering. Also this can result in a performance benefit even if the job might not use all cores of the die.</p>



<h2 class="wp-block-heading">Binding Types: Slot vs. Host</h2>



<p>Binding can be applied <strong>per slot</strong> (as we saw in previous examples) or <strong>per host</strong> using the <code>-btype</code> parameter.</p>



<ul class="wp-block-list">
<li><strong>Slot-based binding</strong> (default):<br>Each slot gets its own binding. This maximizes flexibility and is ideal for mixed workloads.</li>



<li><strong>Host-based binding</strong>:<br>Binding is applied collectively for all slots on a host, ensuring consistent placement but reducing flexibility.</li>
</ul>



<pre class="wp-block-code"><code>qsub -pe mpi_8 16 -btype host -bunit X -bamount 1 ...</code></pre>



<p>Here, the job get 16 slots (8 per host) and <strong>Gridware Cluster Scheduler</strong> binds each group to one die (L3-cache). This host-wide approach minimizes fragmentation and improves cache locality.</p>



<p>Once a job (or advance reservation) is scheduled, its actual binding can be inspected with <code>qstat</code> (or <code>qrstat</code>)</p>



<pre class="wp-block-code"><code>qstat -j &lt;job_id&gt;   # or  qrstat -ar &lt;ar_id&gt;
...
binding:               bamount=16,binstance=set,bstrategy=pack,btype=host,bunit=X
exec_binding_list 1:   host1=NSxccccccccXCCCCCCCC,host2=NSxccccccccXCCCCCCCC</code></pre>



<p>The first line shows the binding request; the second lists the binding actually applied per host (lower case letters in the topology string). In this example, all cores below the first L3 cache of the first socket were used.</p>



<h2 class="wp-block-heading">Binding Filters</h2>



<p>Sometimes certain cores or sockets should be left free — for example, one core per host reserved for system tasks. Binding filters, defined with <code>-bfilter</code>, make this possible.</p>



<p>A filter uses a <strong>topology string</strong> where lowercase letters mark excluded units.</p>



<p>Example:</p>



<pre class="wp-block-code"><code>qsub -bfilter ScCCCScCCC ...</code></pre>



<p>Here, the first core of each socket is masked and will not be used for binding. All other cores remain available.</p>



<p>Administrators can also define global filters by keyword:</p>



<pre class="wp-block-code"><code>qconf -sconf | grep binding_params
binding_params ... filter=first_core</code></pre>



<p>Global and job-specific filters are additive, and both restrictions apply simultaneously.</p>



<h2 class="wp-block-heading">Packed Binding (and What Comes Next)</h2>



<p>The <strong>packed binding strategy</strong> is the default in <strong>Gridware Cluster Scheduler</strong>.<br>It assigns available hardware units sequentially from left to right within a node’s topology string, ensuring that each host is filled efficiently while maintaining cache and NUMA locality.</p>



<p>Packed binding automatically groups tasks on nearby cores and within shared cache domains to reduce latency and memory contention.<br>If a host does not have enough free units to satisfy a job’s binding request, the scheduler simply skips that host.</p>



<p>What has been written so far is available in <strong>Open Cluster Scheduler (OCS)</strong>  and <strong>Gridware Cluster Scheduler (GCS)</strong>.</p>



<p>However, Gridware Cluster Scheduler introduces <a href="https://bablick.de/how-binding-order-and-range-shape-job-placement-in-gridware-cluster-scheduler/" data-type="post" data-id="158">extended binding control</a>. Packed binding can be refined through additional options — <strong><code>-bsort</code></strong>, <strong><code>-bstart</code></strong>, and <strong><code>-bstop</code></strong> — which let you influence the <strong>order</strong> and <strong>region</strong> of unit selection.</p>



<p>These <strong>advanced strategies</strong> are available <strong>only in Gridware Cluster Scheduler</strong> and will be discussed in detail in the <strong>next blog post</strong>.</p>



<p>🚀 <strong>Stay connected!</strong><br>Follow me on <strong><a href="https://x.com/ebablick" data-type="link" data-id="https://x.com/ebablick">X (Twitter)</a></strong> or join <strong>HPC-Gridware</strong> on <strong><a href="https://www.linkedin.com/company/hpc-gridware" data-type="link" data-id="https://www.linkedin.com/company/hpc-gridware">LinkedIn</a></strong> and <strong><a href="https://x.com/HPC_Gridware" data-type="link" data-id="https://x.com/HPC_Gridware">X (Twitter)</a></strong> for the latest release announcements, expert tips, and in-depth technical insights from our team.</p>



<p>🔧 <strong>Try it today:</strong> nightly builds featuring the latest <strong>OCS</strong> and <strong>GCS</strong> enhancements discussed in this post are now available from <strong><a href="https://hpc-gridware.com/download-main/" data-type="link" data-id="https://hpc-gridware.com/download-main/">HPC-Gridware</a></strong>.</p>



<p></p>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
