Questions tagged [pipeline]
A pipeline is a sequence of functions (or the equivalent thereof), composed so that the output of one is input for the next, in order to create a compound transformation. Famously, a shell pipeline looks like "command | command2 | command3" (but use the tag "pipe" for this). It's also used in computer architecture to define a sequence of serial stages that execute in parallel over elements being fed into a pipe, in order to increase the overall throughput.
pipeline
5,678
questions
0
votes
0
answers
16
views
How to automatically run pull requests from an Azure DevOps pipeline
I'm trying to write a pipeline in Azure DevOps that can look at some code I write in VSCode and automatically add., commit, and push it without me every having to do anything in the console. Here is ...
- 1
0
votes
0
answers
11
views
How to perform in-place update of CredentialsParameter in jenkins pipeline groovy
Here's a simple stage wherein I'm looping through all jobs and checking if they have a CredentialParameterDefinition
If yes, looping again within each job against all CredentialParameters and trying ...
- 27
1
vote
1
answer
20
views
Why won't snakemake re-run workflow if I touch the input file with size less than 100,000 bytes?
Version
Snakemake version: 8.16.0
Snakefile
rule test:
input:
"input.txt"
output:
"output.txt"
shell:
"""
cat {input} > {...
- 23
0
votes
0
answers
18
views
[MIPS]: branch delay slot is only on Pipeline implementation?
When I was trying to better understand how the jal instruction works, this question came to me.
From what I understand, "Branch delay slot" exists only in MIPS pipeline processor ...
- 25
0
votes
0
answers
15
views
Oracle devops build agent Nodejs 20
Oracle uses Oracle linux 7 as base images for build pipelines,
Looks like oracle linux 7 doesn't support Node 20, what is the best way to build node 20 projects in oracle devops build pipelines,
- 863
0
votes
1
answer
9
views
AWS EventBridge Pipeline - Self Managed Kafka filter not working
I have event coming from self-managed kafka in following format:
{
"topic":"aaa",
"partition":16,
"offset":108687,
"timestamp":1721654305109,
...
- 49
0
votes
0
answers
16
views
Get-childitem is changing TypeName System.IO.DirectoryInfo to System.Management.Automation.PSCustomObject: How to prevent?
Goal of this script?
Need to delete big SQL dump files remotely.
When script is launched, we need to click on ok while parent folder is selected/highlighted.
After then we need click on ok so that we ...
0
votes
1
answer
59
views
Azure DevOps pipeline notification to teams direct message
I am working on pipeline that takes care of pull requests. Everything about it works fine, howerver I would like to notify the developer for which the pull request pipeline is running if the pipeline ...
0
votes
0
answers
128
views
Exit handler never called! This is an error with npm itself
I am trying to run tests in the pipeline for a react application. Script looks as below:
Earlier the first three lines weren't there. I have tried running the command npm install with --force/--legacy-...
- 276
-1
votes
0
answers
16
views
Passing table names as parameters from dataflow to notebook in pipelines
I want to create a pipeline with two elements. One is a dataflow. This dataflow creates 5 tables in my lakehouse. The second element of the pipeline is a notebook. I want the notebook to load each of ...
- 1
0
votes
1
answer
75
views
Make the pipeline fail if a specific sentence appears in the log – Find a substring, but ignore a specific substring
In my first question, the goal was to intentionally make the CI/CD pipeline fail if a transformation is not possible in the Web.Live.Config. I had to save the build in a variable. If a transformation ...
- 497
0
votes
0
answers
31
views
Not able to create job in dataflow for streaming data
I am executing my Apache-beam code in google cloud shell, I am able to execute code without errors, but jobs not creating in data flow.
**below roles I assigned to service account
**
Dataflow Worker, ...
- 13
-1
votes
0
answers
29
views
How do I pass a Java Maven project's version value from the pom.xml to a Bitbucket pipelines YAML file?
I have a Spring Boot Maven Java project. My POM file has a version number property in it of 1.2.3, as seen below:
<project ...>
<modelVersion>#.#.#</modelVersion>
<groupId>...
- 2,474
1
vote
1
answer
66
views
Make the pipeline fail if a specific sentence appears in the log
The goal of the task is to verify a build process in a GitLab CI/CD pipeline using PowerShell without saving any files on the server. Specifically, the task involves checking for configuration ...
- 497
1
vote
1
answer
34
views
Running a gitlab-ci job when a file exists
I'm trying to configure gitlab-ci to run two jobs depending on the presence of a Dockerfile using the exists directive.
I want job01 to be executed by tag, but only if there is no Dockerfile, and ...
- 89