Which of these arguments is specific to the ScoopOperator?
Some of the important parameters/arguments for the SqoopOperator are listed below:
- conn_id: Connection ID
- table: MySQL table name
- cmd_type: Command type
- target_dir: Target directory for HDFS
Apache Airflow MCQ
Apache Airflow: Solutions to Data Pipeline Orchestration: Match the items from Group X with the appropriate items from Group Y.
Group X:
A. Apache Oozie
B. Apache Airflow
C. Manual Orchestration
D. Cron Jobs
Group Y:
- UI for ease of use
- Can use cron expression for schedule intervals
- Can be used to efficiently orchestrate large-scale distributed systems
- Python-based
- Java and XML based
- Large and rapidly growing community support
Apache Airflow: Data Pipeline Phases: Select the correct order in which the following phases should be completed in building data pipelines.
- Validating data
- Extracting/Collecting data using various tools
- Transforming data into a query-worthy format
- Visualisation of KPIs
- Storing raw data