Fork me on GitHub
Parse Spark-submit argument online
Parse your spark-submit easily 😁
Fill in your spark-submit instruction here
spark-submit --deploy-mode cluster --master yarn --driver-memory 1g --executor-cores 2 --executor-memory 2g s3://hello-world-repo/world_temp/aggregate_data_sources.py --data_source_s3_path s3://hello-world-repo/data/pattern_source/ --replay_aggregated_output_s3_path s3://today-prod/hello/pattern_source_aggregate/ --start_at 2020/02/16 --replay_aggregate_day_window 90
Submit
Original Source:
Spark Arguments
Python Arguments