azure_cloud_utils

https://docs.microsoft.com/en-us/azure/

Certifications Links:

1. https://github.com/anjijava16/Azure-Certification-DP-200
2. https://www.udemy.com/course/microsoft-azure-database-and-analytics/
3. https://github.com/MicrosoftLearning/AZ-900T0x-MicrosoftAzureFundamentals/tree/master/Instructions/Walkthroughs

Azure Data Storage:

1. https://knowledge-junction.com/2020/12/03/microsoft-azure-storage-and-database-part-1-overview/

CosmosDB

Azure Cosmos DB supports many APIs, such as SQL, MongoDB, Cassandra, Gremlin, and Table. Each API has its own set of database operations. These operations range from simple point reads and writes to complex queries. Each database operation consumes system resources based on the complexity of the operation. https://github.com/cmaneu/Awesome-Azure-Advanced-Analytics#azure-cosmos-db https://azurecosmosdb.github.io/labs/ https://github.com/abhirockzz/cosmosdb-synapse-workshop

Synapse (Data Cloud Anlaytics)

https://github.com/Azure-Samples/Synapse/tree/master/Notebooks/PySpark/Synapse%20Link%20for%20Cosmos%20DB%20samples

Hyperspace http://aka.ms/hellohyperspace

 https://github.com/microsoft/hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Implementing-an-Azure-Data-Solution:

1. https://github.com/MicrosoftLearning/DP-200-Implementing-an-Azure-Data-Solution

Designing-an-Azure-Data-Solution:

1.  https://github.com/MicrosoftLearning/DP-201-Designing-an-Azure-Data-Solution
   

You can do free labs on microsoft learn for handon

1. https://docs.microsoft.com/en-us/learn/
2. https://azure.microsoft.com/en-us/free/

Core principles for creating architectures

1. https://docs.microsoft.com/en-us/learn/modules/pillars-of-a-great-azure-architecture/
2. Big data architectures (imp): Understand why, when and differences
3. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/
4. https://www.blue-granite.com/blog/a-different-way-to-process-data-kappa-architecture

Describe Lambda architectures from a Batch Mode Perspective

1. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/batch-processing
2. https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/batch-processing
3. https://docs.microsoft.com/en-us/azure/cosmos-db/lambda-architecture

. Design an Enterprise BI solution in Azure

1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/enterprise-bi-sqldw
2. https://azure.microsoft.com/en-in/blog/technical-reference-implementation-for-enterprise-bi-and-reporting/

Automate enterprise BI solutions in Azure

1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/enterprise-bi-adf

Architect an Enterprise-grade conversational bot in Azure (understand data/storage requirements)

1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/ai/conversational-bot

#. Lambda architectures for a Real-Time Mode Perspective

1. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/real-time-processing

#. Architect a stream processing pipeline with Azure Stream Analytics

1. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-solution-patterns
2. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/stream-processing-stream-analytics
3. https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/stream-processing

#. Design a stream processing pipeline with Azure Databricks

1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/stream-processing-databricks

#. Security Design Considerations

1. https://docs.microsoft.com/en-us/learn/modules/design-for-security-in-azure/

#. Designing distributed tables in Azure SQL Data Warehouse

1. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-distribute
2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-best-practices

#. Horizontal, vertical, and functional data partitioning

1. https://docs.microsoft.com/en-us/azure/architecture/best-practices/data-partitioning #. Azure Cosmos DB: Designing your data structure
2. https://social.technet.microsoft.com/wiki/contents/articles/39421.azure-cosmos-db-designing-your-data-structure.aspx #. Azure Example Scenarios
3. https://docs.microsoft.com/en-us/azure/architecture/example-scenario/#data-scenarios #. Datasize organizing in one folder
4. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-performance-tuning-guidance
5. https://azure.microsoft.com/en-in/blog/azure-cosmos-db-pushing-the-frontier-of-globally-distributed-databases/
6. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-temporary

#. Transparent data encryption or always encrypted

1. https://azure.microsoft.com/en-in/blog/transparent-data-encryption-or-always-encrypted/ #. SQL database auditing
2. https://docs.microsoft.com/en-us/azure/sql-database/sql-database-auditing
3. https://docs.microsoft.com/en-us/sql/relational-databases/security/auditing/sql-server-audit-database-engine?view=sql-server-2017

#. Azure SQL Database security capabilities

1. https://docs.microsoft.com/en-us/azure/sql-database/sql-database-security-overview #. Data Compression
2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-memory-optimizations-for-columnstore-compression
3. https://blogs.msdn.microsoft.com/sqldw/2016/05/05/the-effects-of-column-level-compression/

#. Storage :

1. https://docs.microsoft.com/en-us/azure/architecture/guide/technology-choices/data-store-comparison
2. https://docs.microsoft.com/en-us/azure/storage/common/storage-account-overview

#. Introduction to Data Lake Storage & Create an Azure Data Lake Storage Gen2

1. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
2. https://www.blue-granite.com/blog/10-things-to-know-about-azure-data-lake-storage-gen2 (Good Article)
3. Enabling Team Based Data Science with Azure Databricks
4. https://www.blue-granite.com/blog/3-reasons-to-choose-azure-databricks-for-data-science-and-big-data-workloads
5. https://www.slideshare.net/databricks/building-an-enterprise-data-platform-with-azure-databricks-to-enable-machine-learning-and-data-science-at-scale-at-sams-club

. Azure Databricks & :

1. https://docs.azuredatabricks.net/getting-started/concepts.html
2. ETL: https://docs.microsoft.com/en-us/azure/azure-databricks/databricks-extract-load-sql-data-warehouse Globally Distributed Database with Azure Cosmos DB,Create an Azure Cosmos DB database built to scale ,Insert and query data in your Azure Cosmos DB database:
3. https://docs.microsoft.com/en-us/azure/cosmos-db/consistency-levels
4. https://docs.microsoft.com/en-us/azure/cosmos-db/whitepapers
5. https://docs.microsoft.com/en-us/azure/cosmos-db/databases-containers-items
6. https://docs.microsoft.com/en-us/azure/cosmos-db/how-to-multi-master

Distribute your Data Globally with Azure Cosmos DB:

1. https://docs.microsoft.com/en-us/azure/cosmos-db/global-dist-under-the-hood
2. https://azure.microsoft.com/en-in/blog/a-technical-overview-of-azure-cosmos-db/ (must read)
3. https://docs.microsoft.com/en-us/azure/architecture/best-practices/data-partitioning (Do read)

Azure SQL Database

1. https://docs.microsoft.com/en-in/azure/sql-database/ (Read only concept section on left hand side)

Azure SQL Data Warehouse :

1. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-partition
2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-best-practices
3. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-overview
4. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/massively-parallel-processing-mpp-architecture (Do read)

Creating and Querying an Azure SQL Data Warehouse :

1. https://azure.microsoft.com/en-in/resources/videos/loading-data-with-polybase-in-azure-sql-data-warehouse/
2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/load-data-wideworldimportersdw

Performing Real Time Analytics with Stream Analytics:

1. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-stream-analytics-query-patterns#query-example-send-data-to-multiple-outputs (one query multiple output possible go through it)
2. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-outputs
3. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-streaming-unit-consumption
4. https://azure.microsoft.com/is-is/blog/maximize-throughput-with-repartitioning-in-azure-stream-analytics/
5. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parallelization (must read)
6. https://docs.microsoft.com/en-us/azure/stream-analytics/streaming-technologies (read all concepts from left hand side)
7. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs#stream-data-from-event-hubs

Orchestrating Data Movement with Azure Data Factory:

1. https://azure.microsoft.com/en-in/resources/videos/azure-data-factory-overview/
2. https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime (super imp: understand when to use what)
3. https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-security-overview

Securing Azure Data Platforms:

1. https://docs.microsoft.com/en-us/azure/security/azure-security-data-encryption-best-practices