Identify Bottlenecks, Increase Copy Activity Throughput: ADF

Azure Data Factory (ADF) is a cloud-native ETL tool to process data seamlessly across different sources and sinks. Copy activity is mostly used to copy data from one source to another source. While copying data between two different sources, we...

November 1, 2024

12 Expert Tips for Secure Cloud Deployments – DZone

News

12 Expert Tips for Secure Cloud Deployments – DZone

According to the Thales 2024 Cloud Security Study, 31% of cyberattacks prioritize SaaS applications, followed closely by 30% targeting cloud storage and 26% aimed at cloud management infrastructure. Cloud resources have become the prime targets for hackers — no surprise,...

October 26, 2024

Understanding Server Error (5XX) in Azure Services – DZone

News

Understanding Server Error (5XX) in Azure Services – DZone

Encountering 5XX errors in Azure services? These are server SKU issues such as high CPU and memory. We will focus on how design challenges in workflows as well can lead to 5XX response codes and the steps to mitigate them....

October 23, 2024

Automate Databricks Unity Catalog Permissions – DZone

News

Automate Databricks Unity Catalog Permissions – DZone

Disclaimer: All the views and opinions expressed in the blog belong solely to the author and not necessarily to the author’s employer or any other group or individual. This article is not a promotion for any cloud/data management platform. All the images and code snippets...

October 17, 2024

Event-Driven Microservices in .NET 8 Using Azure Service Bus

News

Event-Driven Microservices in .NET 8 Using Azure Service Bus

Microservices have become a popular architectural style for building scalable applications. By breaking down complex systems into smaller, independent services that communicate via APIs, microservices in .NET enable faster development, better fault tolerance, and easier maintenance. A key component of...

September 18, 2024

News

GitHub to Azure CI Pipelines Migration

Goal: In this project, my goal was to migrate our existing GitHub CI pipeline to Azure CI Pipelines, taking advantage of the robust features and scalability offered by Azure DevOps. Tools and Services: To achieve this goal, I utilized the...

August 15, 2024

Building Optimized ETL Data Pipelines in the Cloud – DZone

News

Building Optimized ETL Data Pipelines in the Cloud – DZone

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines...

August 15, 2024

Ways to load data in DW from External Data Source

News

Ways to load data in DW from External Data Source

Introduction After performing transformation on data, then it needs to save it in Data Warehouse for further analysis. This process comes under ETL (Extract, Transform, Load). It involves extracting data from various sources, transforming it as per business need, and...

July 21, 2024

Setting up a helm OCI registry with ArgoCD hosted on Azure

News

Setting up a helm OCI registry with ArgoCD hosted on Azure

With an increasing number of helm charts, some configuration blocks are bound to get duplicated. This is not usually a big problem when writing Kubernetes configuration as readability and simplicity of the configuration is most of the time more valued...

July 4, 2024

Seamlessly Migrate Your On-Premise Data Pipeline to Azure with These Key Steps | HackerNoon

News

Seamlessly Migrate Your On-Premise Data Pipeline to Azure with These Key Steps | HackerNoon

Today, many groups see the worth of moving their data setups from their own sites to the cloud. Azure, made by Microsoft, offers a strong and wide-reaching stage for data jobs. This write-up aims to give a clear and comprehensive...

June 30, 2024

1 2 … 5 6