Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Submit Argo workflow #1252

Merged
merged 4 commits into from
Nov 26, 2019

Conversation

Yancey1989
Copy link
Collaborator

@Yancey1989 Yancey1989 commented Nov 26, 2019

This PR is part of #1066, add SubmitWorkflow implement of Run interface to call codegen_couler.go.
TODO:

  1. Implement codegen_couler.go
  2. Execute cmd to submit Argo workflow and fetch workflow ID from stdout.

@Yancey1989 Yancey1989 changed the title [WIP] submit Argo workflow Submit Argo workflow Nov 26, 2019
typhoonzero
typhoonzero previously approved these changes Nov 26, 2019
Copy link
Collaborator

@typhoonzero typhoonzero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve with some enhancement comments

@@ -81,6 +85,7 @@ func main() {
caCrt := flag.String("ca-crt", "", "CA certificate file.")
caKey := flag.String("ca-key", "", "CA private key file.")
port := flag.Int("port", 50051, "TCP port to listen on.")
isArgoMode := flag.Bool("argo-mode", false, "Enable Argo workflow model.")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe also need to configure the k8s API endpoint address in the future?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point and I will add it when implementing the Fetch interface.

//
// 1. Local model
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will the "local mode" move to couler "docker mode"?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The local mode here is the current implementation. Will move to docker mode if the docker mode is ready in Couler.

@@ -82,6 +78,9 @@ func (s *Server) Run(req *pb.Request, stream pb.SQLFlow_RunServer) error {
res, err = encodeRow(s)
case string:
res, err = encodeMessage(s)
case sf.WorkflowJob:
job := r.(sf.WorkflowJob)
res = &pb.Response{Response: &pb.Response_Job{Job: &pb.Job{Id: job.JobID}}}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you also update the pysqlflow, please refer to this PR in the pysqlflow PR.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, there is a task in the TODO list #1066

@Yancey1989 Yancey1989 merged commit 65658cb into sql-machine-learning:develop Nov 26, 2019
@Yancey1989 Yancey1989 deleted the submit_interface branch November 26, 2019 08:26
@Yancey1989 Yancey1989 mentioned this pull request Dec 10, 2019
21 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants