runlyio / core-dotnet Goto Github PK

When one process runs as a result of another process completing, match fields from the output of the first process with the config of the second and copy data (possibly only in the case the config does not have a value for a given field). E.g., if the process DataImport runs after MoveFile and MoveFile's output and DataImport's config have fields named "FilePath", then the value in MoveFile's FilePath would be set in DataImport's config. This allows for simple chaining together of processes where some data needs to be shared between the two.

Similar to how the Node.js version works, it would be great for ease-of-use (and especially for quick demos) to be able to run a job without having to first create a json file first. Something like this:

myapp run helloworld --names Rick --names Morty --execution.parallelTaskCount 3

This would be the equivalent of this json config:

{
  "job": "helloworld",
  "names": ["Rick", "Morty"],
  "execution": {
    "parallelTaskCount": 3
  }
}

Jobs that extend Job<TConfig> fail due to an invalid cast in SingleItemSource.

Show progress bars and better formatting

When writing logs to the console, the formatting of the items processed and also the Press q to quit gets all janked up.

Konsole looks like a cool project that could help.

When a process type cannot be found, throw an exception/alert the users to the issue.

To reproduce:

1. Queue a job and let it start.
2. Sever its connection to the API.
3. Wait for it to timeout on the server.
4. Restore the connection.

The job will be in an ambiguous state where the process is running and there is no feedback in the console.

When an exception is thrown in Initialize:

Unhandled exception. System.NullReferenceException: Object reference not set to an instance of an object.
   at Runly.ResultLog.ToString()
   at System.IO.TextWriter.WriteLine(Object value)
   at System.IO.TextWriter.SyncTextWriter.WriteLine(Object value)
   at System.Console.WriteLine(Object value)
   at Runly.Hosting.RunAction.RunAsync(CancellationToken token)
   at Runly.Hosting.RunAction.RunAsync(CancellationToken token)
   at Runly.System.Program.<Main>(String[] args)

A test harness that will run a process's initialize, process, etc. for integration-style testing.

Also guidance on how to use it and guidance on how to write unit-style tests without the harness.

Runly.Testing?

Update the donet config with changes made in the nodejs lib.

When queuing a run, the config should allow a cluster or node to be specified in order to direct the run to that cluster or node.