Comments (3)
Sure, let me create a document and we can move the discussion on discord.
from beam.
Let me try to work on this task.
One idea immediately comes to my mind is that we may have different PipelineOption
for different Runner
for the users in the future, the macro should be able to take the PipelineOption
or the individual data members of PipelineOption
as parameters.
Something like this:
#[apache_beam::DirectRunner(DirectRunnerOptions)]
fn main(root: PValue) {
root.apply(...);
}
from beam.
@Kelvinyu1117 Thanks!
Since this feature would affect developer experiences so much, could you start from a design doc (that should be listed here) and request reviews in the discord?
from beam.
Related Issues (16)
- How to contribute HOT 18
- [Bug]: test failures HOT 4
- [Feature Request]: Stop using `Any` (statically-typed Pipeline) HOT 3
- Wholistic examples HOT 1
- Wholistic documents
- [Task]: add CI job to run `cargo test` HOT 2
- [Feature Request]: CoderRegistry HOT 1
- [Feature Request]: remove `struct Iterable`
- [Feature Request]: Design adequate yet flexible ways to serialize/deserialize DoFn payloads HOT 1
- [Bug]: Removing `unsafe {}` makes `cargo test` unstoppable
- [Task]: refactor: separate worker and pipeline construction module HOT 4
- [Task]: feat: support Coder with components (internal type parameters)
- [Task]: Pipeline testing framework HOT 2
- [Task]: Use turmoil to simulate client and server environments in tests HOT 5
- [Task]: Benchmark DashMap against Moka
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from beam.