sheets:Spreadsheet sheet = verify spreadsheetClient->createSpreadsheet(sheetName);
_ = verify spreadsheetClient->
appendValue(sheet.spreadsheetId, ["Product", "Sales", "Date"], {sheetName: workSheetName});
foreach var {product, gross sales, date} in salesSummary {
_ = verify spreadsheetClient->
appendValue(sheet.spreadsheetId, [product, sales, date], {sheetName: workSheetName});
}
Deploying and testing ETL flows
Growing particular person ETL duties as microservices permits all the ETL stream to be deployed in a Kubernetes cluster. Every ETL job could be a pod within the Kubernetes deployment, making it potential to extend or lower the variety of pods of particular person ETL duties based mostly on the load. Nonetheless, organizations often have a number of ETL flows, every with many duties. Moreover, these ETL flows might be owned by totally different groups. Due to this fact, it’s essential to have correct CI/CD pipelines, permission fashions, monitoring capabilities, and a number of environments for improvement, testing, efficiency validations, and manufacturing.
Ballerina can work with all widespread CI/CD, monitoring, and deployment applied sciences, making it seamless to combine Ballerina-based ETL flows with a corporation’s present infrastructure. For instance, Ballerina ETL supply code might be maintained in GitHub, CI/CD actions might be applied utilizing Jenkins, ETL flows might be deployed on Amazon EKS, and the executions might be monitored utilizing Prometheus and Grafana.